Skip to main content

4 Insights into Modern Cloud Inefficiency

Bill Buckley
CloudZero

For the last 18 years — through pandemic times, boom times, pullbacks, and more — little has been predictable except one thing: Worldwide cloud spending will be higher this year than last year and a lot higher next year. But as companies spend more, are they spending more intelligently? Just how efficient are our modern SaaS systems?

CloudZero's new report, How Cloud Efficient Are Software Companies In 2024?, found that most companies have limited (or nonexistent) cloud cost management (CCM) programs, which prevent them from making a substantial profit.

This is particularly concerning in the context of AI spending, which will only exacerbate cloud inefficiency. AI, which has gripped the SaaS world as firmly as it has the public imagination, is notoriously difficult to manage. Immature CCM programs will buckle under its complexity and fail to maximize the profitability of AI-driven applications.

The good news is that companies can take some simple steps to remediate these issues. Let's look at some of this survey's key findings and how companies can reverse the trend of inefficiency and maximize their cloud profitability.

Most Companies Don't Proactively Manage Their Cloud Costs

One of the survey's most troubling findings is that 61% of companies don't have a formalized CCM program. This is consistent with The State of FinOps 2024, a report by the FinOps Foundation, which showed that 62% of companies are in the least mature stage (the "Crawl" stage) of FinOps. Formalized CCM spans numerous functions, from the most straightforward budgeting and forecasting to the most complex unit economics calculation, but most fundamental to CCM is cost allocation.

Cost allocation means assigning appropriate costs to individual customers, products, features, teams, microservices, etc. Complete cost allocation shows companies precisely what's driving their spending — and, by extension, where they're most (and least) efficient. The report found that just 9% of companies have complete or near-complete cost allocation.

If you don't know what's driving your spending, it's impossible to drive meaningful efficiencies. Upon instituting a formalized CCM program, companies reduce their cloud costs by 30% in the first year. Low allocation and infrequency of formalized CCM programs would suggest that companies are leaving profit on the table — and the next key finding confirms it.

COGS Inefficiency: Companies Are Leaving Profit on the Table

Roughly three-quarters of survey respondents said their cloud expenses account for at least 20% of their cost of goods sold (COGS), and more than a quarter (28%) said cloud costs account for more than half of their COGS. Since COGS is a key factor in gross margin (i.e., profitability) calculations, and companies that institute CCM programs tend to reduce their cloud costs by 30%, companies are leaving a lot of profit on the table.

A company with $100 million in revenue and $25 million in COGS would have a gross profit of 75% — good, in SaaS terms, but not elite. Now, imagine that their cloud costs represent 50% of their COGS — $12.5 million. A 30% reduction would lower their cloud costs to $8.75 million and their overall COGS to $21.25 million. Their gross profit would grow to 78.75% — near-elite.

Organizations Aren't Using the Most Powerful CCM Methods

An absence of strong CCM also means companies tend not to use its most powerful approaches — namely, software code optimization. While about half of companies take advantage of simple CCM methods — enterprise discounts, bulk purchasing discounts — just 28% of companies practice software code optimization. Software code optimization entails ad-hoc code fixes that make the software run more efficiently and at the highest scale levels, saving companies millions of dollars.

Software code optimization requires well-allocated, real-time, highly granular cost data and systems to notify the correct engineers when costs spike. Given that just 31% of companies have formal CCM programs, it's not surprising that roughly the same portion uses software code optimization.

Elite Cloud Efficiency Rate (CER): 92%+

Cloud Efficiency Rate (CER) is a universal benchmark for cloud cost efficiency. It compares your revenue to your cloud spend and shows you how much of every revenue dollar you keep versus how much you send to cloud providers. A company with an 80% CER sends $0.20 of every revenue dollar to its cloud providers; a company with a 90% CER sends $0.10 of every dollar to its cloud providers. The report shows that the top-quartile CER is 92%, meaning the most cloud-efficient SaaS companies send just $0.08 of every revenue dollar to their cloud providers.

CERs also tend to worsen as companies scale and add engineers. Angel/bootstrapped companies reported the highest median CER (92%), with every other category reporting significantly worse median CERs (80% across public, debt/private equity, and venture capital). Companies with 11–25 engineers have the highest median CER (87%), with 51–100 (75%) and 100+ (80%) representing significant CER declines.

Increase Your Profitability with CCM

Organizations that want to grow, maintain a high pace of innovation, and increase their cloud efficiency need to compare their CER to industry benchmarks, at minimum. To drive elite CER, they will need sophisticated CCM programs. This involves engagement from the engineering function, precise budgeting, complete allocation, and clear unit economics.

Technical teams buy cloud resources and manage their costs, so they're positioned to have the most positive impact on cloud efficiency. Providing technical teams with relevant, real-time cloud cost data will empower them to make better infrastructure and code decisions. This will make innovations more durable and result in a healthier bottom line for the business.

Methodology: CloudZero, in partnership with Benchmarkit, a B2B SaaS research firm, conducted the report. More than 700 cloud operations and finance professionals at SaaS companies throughout North America were surveyed on all things cloud spending.

Bill Buckley is SVP of Engineering at CloudZero

Hot Topics

The Latest

As businesses increasingly rely on high-performance applications to deliver seamless user experiences, the demand for fast, reliable, and scalable data storage systems has never been greater. Redis — an open-source, in-memory data structure store — has emerged as a popular choice for use cases ranging from caching to real-time analytics. But with great performance comes the need for vigilant monitoring ...

Kubernetes was not initially designed with AI's vast resource variability in mind, and the rapid rise of AI has exposed Kubernetes limitations, particularly when it comes to cost and resource efficiency. Indeed, AI workloads differ from traditional applications in that they require a staggering amount and variety of compute resources, and their consumption is far less consistent than traditional workloads ... Considering the speed of AI innovation, teams cannot afford to be bogged down by these constant infrastructure concerns. A solution is needed ...

AI is the catalyst for significant investment in data teams as enterprises require higher-quality data to power their AI applications, according to the State of Analytics Engineering Report from dbt Labs ...

Misaligned architecture can lead to business consequences, with 93% of respondents reporting negative outcomes such as service disruptions, high operational costs and security challenges ...

A Gartner analyst recently suggested that GenAI tools could create 25% time savings for network operational teams. Where might these time savings come from? How are GenAI tools helping NetOps teams today, and what other tasks might they take on in the future as models continue improving? In general, these savings come from automating or streamlining manual NetOps tasks ...

IT and line-of-business teams are increasingly aligned in their efforts to close the data gap and drive greater collaboration to alleviate IT bottlenecks and offload growing demands on IT teams, according to The 2025 Automation Benchmark Report: Insights from IT Leaders on Enterprise Automation & the Future of AI-Driven Businesses from Jitterbit ...

A large majority (86%) of data management and AI decision makers cite protecting data privacy as a top concern, with 76% of respondents citing ROI on data privacy and AI initiatives across their organization, according to a new Harris Poll from Collibra ...

According to Gartner, Inc. the following six trends will shape the future of cloud over the next four years, ultimately resulting in new ways of working that are digital in nature and transformative in impact ...

2020 was the equivalent of a wedding with a top-shelf open bar. As businesses scrambled to adjust to remote work, digital transformation accelerated at breakneck speed. New software categories emerged overnight. Tech stacks ballooned with all sorts of SaaS apps solving ALL the problems — often with little oversight or long-term integration planning, and yes frequently a lot of duplicated functionality ... But now the music's faded. The lights are on. Everyone from the CIO to the CFO is checking the bill. Welcome to the Great SaaS Hangover ...

Regardless of OpenShift being a scalable and flexible software, it can be a pain to monitor since complete visibility into the underlying operations is not guaranteed ... To effectively monitor an OpenShift environment, IT administrators should focus on these five key elements and their associated metrics ...

4 Insights into Modern Cloud Inefficiency

Bill Buckley
CloudZero

For the last 18 years — through pandemic times, boom times, pullbacks, and more — little has been predictable except one thing: Worldwide cloud spending will be higher this year than last year and a lot higher next year. But as companies spend more, are they spending more intelligently? Just how efficient are our modern SaaS systems?

CloudZero's new report, How Cloud Efficient Are Software Companies In 2024?, found that most companies have limited (or nonexistent) cloud cost management (CCM) programs, which prevent them from making a substantial profit.

This is particularly concerning in the context of AI spending, which will only exacerbate cloud inefficiency. AI, which has gripped the SaaS world as firmly as it has the public imagination, is notoriously difficult to manage. Immature CCM programs will buckle under its complexity and fail to maximize the profitability of AI-driven applications.

The good news is that companies can take some simple steps to remediate these issues. Let's look at some of this survey's key findings and how companies can reverse the trend of inefficiency and maximize their cloud profitability.

Most Companies Don't Proactively Manage Their Cloud Costs

One of the survey's most troubling findings is that 61% of companies don't have a formalized CCM program. This is consistent with The State of FinOps 2024, a report by the FinOps Foundation, which showed that 62% of companies are in the least mature stage (the "Crawl" stage) of FinOps. Formalized CCM spans numerous functions, from the most straightforward budgeting and forecasting to the most complex unit economics calculation, but most fundamental to CCM is cost allocation.

Cost allocation means assigning appropriate costs to individual customers, products, features, teams, microservices, etc. Complete cost allocation shows companies precisely what's driving their spending — and, by extension, where they're most (and least) efficient. The report found that just 9% of companies have complete or near-complete cost allocation.

If you don't know what's driving your spending, it's impossible to drive meaningful efficiencies. Upon instituting a formalized CCM program, companies reduce their cloud costs by 30% in the first year. Low allocation and infrequency of formalized CCM programs would suggest that companies are leaving profit on the table — and the next key finding confirms it.

COGS Inefficiency: Companies Are Leaving Profit on the Table

Roughly three-quarters of survey respondents said their cloud expenses account for at least 20% of their cost of goods sold (COGS), and more than a quarter (28%) said cloud costs account for more than half of their COGS. Since COGS is a key factor in gross margin (i.e., profitability) calculations, and companies that institute CCM programs tend to reduce their cloud costs by 30%, companies are leaving a lot of profit on the table.

A company with $100 million in revenue and $25 million in COGS would have a gross profit of 75% — good, in SaaS terms, but not elite. Now, imagine that their cloud costs represent 50% of their COGS — $12.5 million. A 30% reduction would lower their cloud costs to $8.75 million and their overall COGS to $21.25 million. Their gross profit would grow to 78.75% — near-elite.

Organizations Aren't Using the Most Powerful CCM Methods

An absence of strong CCM also means companies tend not to use its most powerful approaches — namely, software code optimization. While about half of companies take advantage of simple CCM methods — enterprise discounts, bulk purchasing discounts — just 28% of companies practice software code optimization. Software code optimization entails ad-hoc code fixes that make the software run more efficiently and at the highest scale levels, saving companies millions of dollars.

Software code optimization requires well-allocated, real-time, highly granular cost data and systems to notify the correct engineers when costs spike. Given that just 31% of companies have formal CCM programs, it's not surprising that roughly the same portion uses software code optimization.

Elite Cloud Efficiency Rate (CER): 92%+

Cloud Efficiency Rate (CER) is a universal benchmark for cloud cost efficiency. It compares your revenue to your cloud spend and shows you how much of every revenue dollar you keep versus how much you send to cloud providers. A company with an 80% CER sends $0.20 of every revenue dollar to its cloud providers; a company with a 90% CER sends $0.10 of every dollar to its cloud providers. The report shows that the top-quartile CER is 92%, meaning the most cloud-efficient SaaS companies send just $0.08 of every revenue dollar to their cloud providers.

CERs also tend to worsen as companies scale and add engineers. Angel/bootstrapped companies reported the highest median CER (92%), with every other category reporting significantly worse median CERs (80% across public, debt/private equity, and venture capital). Companies with 11–25 engineers have the highest median CER (87%), with 51–100 (75%) and 100+ (80%) representing significant CER declines.

Increase Your Profitability with CCM

Organizations that want to grow, maintain a high pace of innovation, and increase their cloud efficiency need to compare their CER to industry benchmarks, at minimum. To drive elite CER, they will need sophisticated CCM programs. This involves engagement from the engineering function, precise budgeting, complete allocation, and clear unit economics.

Technical teams buy cloud resources and manage their costs, so they're positioned to have the most positive impact on cloud efficiency. Providing technical teams with relevant, real-time cloud cost data will empower them to make better infrastructure and code decisions. This will make innovations more durable and result in a healthier bottom line for the business.

Methodology: CloudZero, in partnership with Benchmarkit, a B2B SaaS research firm, conducted the report. More than 700 cloud operations and finance professionals at SaaS companies throughout North America were surveyed on all things cloud spending.

Bill Buckley is SVP of Engineering at CloudZero

Hot Topics

The Latest

As businesses increasingly rely on high-performance applications to deliver seamless user experiences, the demand for fast, reliable, and scalable data storage systems has never been greater. Redis — an open-source, in-memory data structure store — has emerged as a popular choice for use cases ranging from caching to real-time analytics. But with great performance comes the need for vigilant monitoring ...

Kubernetes was not initially designed with AI's vast resource variability in mind, and the rapid rise of AI has exposed Kubernetes limitations, particularly when it comes to cost and resource efficiency. Indeed, AI workloads differ from traditional applications in that they require a staggering amount and variety of compute resources, and their consumption is far less consistent than traditional workloads ... Considering the speed of AI innovation, teams cannot afford to be bogged down by these constant infrastructure concerns. A solution is needed ...

AI is the catalyst for significant investment in data teams as enterprises require higher-quality data to power their AI applications, according to the State of Analytics Engineering Report from dbt Labs ...

Misaligned architecture can lead to business consequences, with 93% of respondents reporting negative outcomes such as service disruptions, high operational costs and security challenges ...

A Gartner analyst recently suggested that GenAI tools could create 25% time savings for network operational teams. Where might these time savings come from? How are GenAI tools helping NetOps teams today, and what other tasks might they take on in the future as models continue improving? In general, these savings come from automating or streamlining manual NetOps tasks ...

IT and line-of-business teams are increasingly aligned in their efforts to close the data gap and drive greater collaboration to alleviate IT bottlenecks and offload growing demands on IT teams, according to The 2025 Automation Benchmark Report: Insights from IT Leaders on Enterprise Automation & the Future of AI-Driven Businesses from Jitterbit ...

A large majority (86%) of data management and AI decision makers cite protecting data privacy as a top concern, with 76% of respondents citing ROI on data privacy and AI initiatives across their organization, according to a new Harris Poll from Collibra ...

According to Gartner, Inc. the following six trends will shape the future of cloud over the next four years, ultimately resulting in new ways of working that are digital in nature and transformative in impact ...

2020 was the equivalent of a wedding with a top-shelf open bar. As businesses scrambled to adjust to remote work, digital transformation accelerated at breakneck speed. New software categories emerged overnight. Tech stacks ballooned with all sorts of SaaS apps solving ALL the problems — often with little oversight or long-term integration planning, and yes frequently a lot of duplicated functionality ... But now the music's faded. The lights are on. Everyone from the CIO to the CFO is checking the bill. Welcome to the Great SaaS Hangover ...

Regardless of OpenShift being a scalable and flexible software, it can be a pain to monitor since complete visibility into the underlying operations is not guaranteed ... To effectively monitor an OpenShift environment, IT administrators should focus on these five key elements and their associated metrics ...