Mattermost Handbook
Need help?How to spend company moneyHow to update the HandbookRelease overview
0.2.1
0.2.1
  • Mattermost Handbook
  • Company
    • About Mattermost
      • List of terms
      • Business model
      • Mindsets
    • "How to" guides for staff
      • How to set up a 1-1 channel
      • How to update the handbook
      • How to manage Handbook notifications
      • How to change mobile device
        • How to handle a lost mobile device
      • How to do a mini-retrospective
      • How to autolink keywords in Mattermost
  • Operations
    • Company operations
      • Areas of Responsibility
      • Mattermost Leadership Team (MLT)
        • MLT cadence
      • Company measures
        • Metrics definitions
        • FY23 goals board
        • MLT metrics
      • Company cadence
      • Company policies
        • Community response policy
        • Security policy
      • Company processes
        • Issue/solution process
        • Company agreements
        • Publishing
          • Public web properties
          • Publishing guidelines
            • Brand and visual design guidelines
            • Voice, tone, and writing style guidelines
              • Contribute to documentation
            • Confidentiality guidelines
          • Post-publication quality control process
      • Handbook processes and policies
        • Handbook onboarding
      • Fiscal year planning
    • Research and Development
      • Organization
        • Tech Writing
        • Data engineering
        • Delivery
        • Cloud Platform
        • Site Reliability Engineering
        • GRC
        • Product Security
        • Security Operations
      • Processes
        • Feature Labels
      • Product
        • Product planning
          • Product philosophy and principles
          • Prioritization process
          • Release planning process
          • Roadmap views
          • Release plan
          • Launch plan
          • Feature requests
        • Development process
          • Mobile feature guidelines
          • Deprecation policy
          • Mattermost software requirements process
          • Jira ticket lifecycle
          • Creating new Jira bug tickets
            • Priority levels for tickets
            • Jira fix versions
        • Release process
          • Release overview
          • Feature release process
          • Dot release process
          • Security release process
          • Mobile app release process
          • Desktop app release process
          • Release tips
          • Release scorecard definitions
        • How-to guides for Product
          • How to use productboard
          • How to record a roadmap video
          • How to update integrations directory
          • How to write a feature release announcement
        • Product Management team handbook
          • Product Management Areas of Ownership
          • Product Manager onboarding
          • Product Manager levels
          • Professional development
        • Product Design team handbook
          • Product Design levels
        • Technical Writing team handbook
          • Work with us
          • User interface text guidelines
          • Documentation style guide
          • Our terminology
          • Guidelines for PMs and developers
          • Guidelines for community contributions
          • Technical Writer levels
          • Docathon 2021
            • Getting started with contributing
        • Growth
          • A/B testing methodology
          • PQL definition
        • Analytics
          • Product Analyst Engineer levels
          • Looker
            • Dashboards
            • Explores
          • Telemetry
        • Developer relations
        • Product team hangouts
      • Engineering
        • Infrastructure engineering
          • Cloud infrastructure cost KPIs
          • Cloud data export process
          • Cloud churn process
          • Reliability Manifesto
          • Production Readiness Review
          • Infrastructure Library
        • Integrations team processes
        • Plugin release process
        • Data Engineering
        • Sustained Engineering
          • On call
        • How to go to a conference
        • Public speaking
        • Core contributor expanded access policy
      • Quality Assurance
        • QA workflow
        • QA testing tips and tools
        • Rainforest process
    • Messaging and Math
      • How-to guides for M&M
        • How to create release announcements
        • How to create screenshots and GIFs
        • How to write Mattermost case studies
        • How to write guest blog posts for Mattermost apps and services
        • How to write Mattermost recipes
        • How to compose tweets
        • How to create a split test for web page
        • How to run meetups
        • How to run executive dinners
      • Checklists for M&M
        • Blog post checklist
        • Bio checklist
      • Mattermost websites
      • Demand generation reporting
      • M&M Asana guidelines
      • Content marketing
        • How to use the editorial calendar
        • Content development and distribution
        • Video content guidelines
        • How to contribute content
    • Sales
      • Deal Desk
      • Partner programs
      • Lead management
    • Deployment Engineering
      • Overview
      • Workflows
      • Frequently Asked Questions
      • Playbook for MME Sev 1 Outages
      • Status Update Template
    • Program Management
    • Customer Success
      • Customer Support
    • Legal
      • Contracts
      • Ironclad Basics
        • Company-Wide Workflows
        • Sales Contracts and Workflows
        • Signing a Contract and Contract Repository
    • Finance
      • Budget
      • How to use Airbase
        • Access Airbase
        • Navigate Airbase
        • How to submit a purchase request
        • How to submit a reimbursement request
        • How to review a reimbursement request
        • Vendor portal guide
        • Frequently asked questions
      • Onboarding
        • Vendor onboarding
        • ROW staff onboarding
      • Staff member expenses
        • How to spend company money
        • How to spend company money: Internships
        • Corporate credit card policy
        • How to access Airbase
        • Gifting policy
        • How to book airfare and travel
        • How to reimburse the company
        • How to convert currencies
        • How to get paid
      • Arrange a Bounty Program
      • Naming files and agreements
      • Risk management
        • Mattermost U.S. consulting agreements
      • Operations playbook
    • Security
      • Policies
      • Privacy
        • Data deletion requests
        • Data subject access requests
      • Product Security
        • Product Vulnerability Process
        • Working on security-sensitive pull requests
        • Secure Software Development guide
      • Security Operations
        • User guides
    • Workplace
      • PeopleOps
        • HR cadences
        • HR systems
        • HR Processes
        • Working at Mattermost
          • Onboarding
            • Things everyone must know
            • Staff onboarding
            • Engineer onboarding timeline and expectations
            • Manager onboarding
            • Frequently asked questions
          • Learning and development
          • Mattermost communication best practices
          • Paid time off
            • Out of office email example
          • Travel
            • Business travel insurance
          • Leaves of absence
            • Pregnancy leave
            • Baby bonding parental leave
            • Jury duty
          • Workplace program
          • Relocation
          • Total rewards
        • Performance reviews
          • Formal review process
          • New staff performance review
          • Informal review process
        • Transfers and promotions
        • Offboarding instructions for managers
        • People compliance
      • People policies
      • Groups
        • Staff Resource Groups
      • Approvals and iteration
      • IT
        • IT helpdesk
        • Hardware and software purchases
        • Hardware buy back policy
        • Software systems
  • Contributors
    • Contributors
      • Equity, diversity, and inclusion
      • How to contribute to Mattermost
        • Community Content program
        • Documentation contributions
        • Help Wanted tickets
        • Localization
        • Contribution events
      • Mattermost community
      • Contributor kindness
      • Community systems
      • Guidelines and playbooks
        • Social engagement guidelines
        • Contribution guidelines and code of conduct
        • Mattermost Community playbook
        • How to run a Hackathon
        • Hacktoberfest event organizer guide for Mattermost
    • MatterCon
      • Staff information privacy management
      • Mattermost events code of conduct
      • MatterCon2021
    • Join us
      • Ice-breakers
      • Help Wanted tickets
      • Localization
      • Mattermost GitHub sponsorship
      • Things candidates should know
      • Staff recruiting
      • Recruiting cadences
        • Product Manager hiring process
      • Exec recruiting
        • EA logistics
  • Help and support
    • Contact us
Powered by GitBook
On this page
  • Team mandate
  • FY24 Q2 priorities (May - July)
  • Areas of responsibility (AORs)
  • Links to key documents
  • Deployment Engineering Knowledgebase
  • Performance Debugging Training Series (2023)
  • Additional Resources

Was this helpful?

Edit on Git
Export as PDF
  1. Operations
  2. Deployment Engineering

Overview

PreviousDeployment EngineeringNextWorkflows

Last updated 11 months ago

Was this helpful?

Deployment Engineering provides expertise on how to run and deploy Mattermost and the platform as a whole, and act as extensions of R&D supporting customers in partnership with post-sales and revenue retention teams.

Team mandate

The team's primary mandate is to increase customer seats deployed.

We collect on a quarterly basis where available, and prioritize initiatives based on a) underdeployment with low customer adoption (e.g. 50% of users are active on a monthly basis), and b) customer ARR >$50,000.

FY24 Q2 priorities (May - July)

The Deployment Engineering team has three key priorities for this quarter:

  1. Establish itself as a new team supporting post-sales & revenue retention, including AORs, processes & workflows.

  2. Completing the deployment of the Mattermost solution for Microsoft Teams in a customer environment.

  3. Completing a loadtest scenario of a Sev0 outage scenario in a customer environment, where up to 15,000 users logs in to the system within 15 minutes.

Areas of responsibility (AORs)

The team's primary mandate is to increase customer seats deployed, deeply understanding technical/engineering bottlenecks, and solving for them. Moreover, we are responsible for creating reference architectures, supporting non-standard deployments with complex technical problems, and providing engineering support to post-sales teams with >$50K customers on critical escalations, one-off custom solutions & integrations based on requirements defined by the CSMs/TAMs.

A complete list of AORs is included below:

  1. Customer Seats Deployed: Seats deployed data for our customer base is

  • Technical onboarding: Help customers deploy in non-standard environments, such as configuring and running loadtests, writing documentation for gold standard deployments, complex data migrations, integration configuration and setup, and guiding customers with deployment KPIs to measure long-term ROI.

  • Server upgrades: Support customers with non-standard server upgrades, run system integrity diagnostics before/after upgrade to detect anomalies, create database migration scripts in preparation for upgrades

  • High scale documentation: Enable successful customer deployments at scale, including amendments to deployment documentation, troubleshooting guides, how-to guides & videos, answers to general technical questions on the platform, Mattermost architecture diagrams, and documented deployment KPIs to measure long-term ROI.

  • Customer health checks: Ensure deployments meet recommendations, review performance metrics and share back with R&D to help improve loadtests

  • Loadtest Deployment Tooling: Create a script/guide (e.g. Terraform, Ansible, whitepaper) to automate the use of the loadtest framework, which includes AWS set up, keys, auth, and more. TAM team acts as the first customer, with the plan to support this script in other customer environments.

  • ESR usage & ceiling tests: Run usage & ceiling tests against ESRs (twice a year). Share observations to Server Platform teams and recommend architectural/docs changes, if any.

  1. Custom Solutions:

  • Custom solutions: Workarounds for unique requirements, one-off integrations (e.g. MS Teams integration), one-off solutions (e.g. legal hold).

  1. Customer Escalations:

  • Technical line of defense for deployment escalations: Ensure customer environments have what we need to help (e.g. system diagnostics, performance monitoring), perform deep troubleshooting and data collection, end-to-end handling of some incidents, escalate and partner with R&D for incidents that require more support.

Links to key documents

Deployment Engineering Knowledgebase

Performance Debugging Training Series (2023)

Additional Resources

Reference Architectures: In partnership with core platform team, with a

Expand reference architectures: Continue to expand on available reference architectures, with as a north star

For other references, see , and .

Jira board:

Confluence page of deployment engineering solutions:

Deployed seats data:

Services request template:

Elasticsearch Debugging & Design Best Practices: |

Job Progress Optimization: Deep Dive into Connections, Improvements & Query Analysis: |

Detecting Performance Monitoring Issues in Prometheus & Grafana: |

Internal only: pprof, Grafana: |

seats deployed data
tracked in this spreadsheet
complete plan in this document
GitLab’s documentation
this document for customer reliability engineering
these slides for post-sales & revenue retention AORs
https://mattermost.atlassian.net/jira/software/c/projects/MM/boards/127
https://mattermost.atlassian.net/wiki/spaces/~557058c88c3d11b60143deaba6d3d018132127/pages/2461925377/Deployment+Engineering+Solutions
https://docs.google.com/spreadsheets/d/1ZnjJHWIsT9hIxotCYrSG66XIWsf_usf258Ll8HgVmzU/edit#gid=423031054
https://docs.google.com/document/d/1EbP4Ab7N2hEAv--DRCcZHk0XtlG1MFP8F8F0viaTM7I/edit
YouTube Video
Google Slides
YouTube Video
Google Slides
YouTube Video
Google Slides
Zoom Video Recording
Google Slides
Trimming Operational Costs: Unveiling Mattermost’s Cross-Cluster Migration
Performance Debugging Training Series
CNCF talk on using counters in Prometheus
Full source code for all metrics.go endpoints
TAM Developer Training Call Notes