Cloud infrastructure cost KPIs

Cloud Cost Optimization Reports

Early each month, a cost report is prepared with the spent of the previous month. This report gets inputs from AWS monthly billing and Zesty cost per AWS account information. That information is incorporated into various sheets, from which diagrams are created that are embedded inside the monthly cost report.

The reports - presentations

The Cloud Cost Optimization Reports can be found in Google Slides here. Each month a new one is created, For example the one for the January 2024 is the Cloud Cost Optimization Report #37.

Sheets and tools to create the reports

• The sheet where the all information is combined and then populated into the cost reports: FY24 Cost tracking AWS accounts

• Zesty's report with the savings per account

• From that sheet, the older cost reports were populated and now it is used for the average cost per workspace Monthly costs per environment

• Show the costs analysis in Cloud Production per type, such as S3, ELB, VPCs, NAT etc. Cost analysis by type

• How much each Cluster costs in Production

• Shows the AWS Cost Projection

Cloud Infrastructure Cost KPIs

The Cloud SRE team uses certain KPIs to monitor cloud infrastructure costs from the engineering standpoint. These KPIs are used to help the business and the Cloud SRE team to set goals for cost optimization.

As of July 2021, the goals for the SRE team are to:

• Decrease the Average Cost Per Workspace (APWC).

• Keep development and test environments costs (DM) below 20% of total costs.

• Increase the WB fraction (ratio of paid workspaces relative to total workspaces).

Below are the primary and secondary KPIs used to measure each.

Primary KPIs

Average Production Workspace Cost

• Description: The fraction which compares the amount of Production Environment costs with the number of workspaces which are active in a given month of the Cloud Infrastructure service. Production Environment will be defined as the environment where we host all our customers, including paid and free workspaces.

• Formula: APWC = Production Environment Costs/Number of Workspaces

Average Production Freemium Cost

• Description: An approximation of what free workspaces cost us. The fraction compares the amount of Production Environment costs with the number of active free workspaces.

• Formula: APFC = Production Environment Costs/Freemium Active Workspaces

  Note: Until February 2021 we measured all workspaces as active. Hibernation functionality was introduced in the last three days of February 2021.

Average Subscription Workspace Cost

• Description: The fraction which compares the amount of Production Environment costs with the number of workspaces that have 11 or more users within a given month of the Cloud Infrastructure service. A paid workspace is defined as successful receipt of payment for the time period (e.g. payment for the previous month completed, when measuring ASWC for the previous month).

• Formula: ASWC = Production Environment Costs/Paid Workspaces

Development Metric

• Description: The fraction which compares the amount we spend on environments related to our features testing with the total Cloud infrastructure costs.

• Formula: DM = (Test Environment Costs + Dev Environment Costs)/Total AWS Cloud Costs

Customers Platform Balance Metric

• Description: The fraction which compares the variable costs we have because we run the Cloud product with the costs that are directly correlated with customers' usage (both paid and freemium).

• Formula: CPBM = Customer Specific Costs/Variable Platform Costs

Secondary KPIs

Workspaces Balance Metric

• Description: The fraction which compares the paid workspaces with the total number of workspaces within a given month of the Cloud Infrastructure service.

• Formula: WB = Paid Workspaces/Total Workspaces

Secondary Average Production Workspace Cost

• Description: The fraction which compares the amount of Production Environment and Core Environment costs with the number of workspaces within a given month of the Cloud Infrastructure service.

• Formula: SAPWC = (Production Environment Costs + Core Environment Costs)/Workspaces

Secondary Average Subscription Workspace Cost

• Description: The fraction which compares the amount of Production Environment and Core Environment costs with the number of workspaces that have 11 or more users within a given month of the Cloud Infrastructure service.

• Formula: SASWC = (Production Environment Costs + Core Environment Costs)/Paid Workspaces

Active Average Production Workspace Cost

• Description: The fraction which compares the amount of Production Environment costs with the number of active workspaces within a given month of the Cloud Infrastructure service.

• Formula: AAPWC = Production Environment Costs/Active Workspaces

Secondary Active Average Subscription Workspace Cost

• Description: The fraction which compares the amount of Production Environment and Core Environment costs with the number of active workspaces within a given month of the Cloud Infrastructure service.

• Formula: SAASWC = (Production Environment Costs + Core Environment Costs)/Active Workspaces

Average Total Production Freemium Cost

• Description: Roughly how much free workspaces cost us. The fraction which compares the amount of Production Environment costs with the number of all free workspaces (active and inactive).

• Formula: ATPFC = Production Environment Costs/Freemium Workspaces (Active and Inactive)

Non Production Environment Cost

• Description: The fraction which compares the amount we spend on all non production environments.

• Formula: NPEC = (Test Environment Costs + Dev Environment Costs + Core Environment Costs + Staging Environment Costs)/Total AWS Cloud Costs

Active Hibernated Workspaces Ratio

• Description: The ratio between Active to Hibernated workspaces at any given month

• Formula: AHR = Active Workpaces/Hibernated Workspaces

Note: Until February 2021 we measured all workspaces as active. Hibernation functionality was introduced in the last three days of February 2021.