Skip to main content

4 Insights into Modern Cloud Inefficiency

Bill Buckley
CloudZero

For the last 18 years — through pandemic times, boom times, pullbacks, and more — little has been predictable except one thing: Worldwide cloud spending will be higher this year than last year and a lot higher next year. But as companies spend more, are they spending more intelligently? Just how efficient are our modern SaaS systems?

CloudZero's new report, How Cloud Efficient Are Software Companies In 2024?, found that most companies have limited (or nonexistent) cloud cost management (CCM) programs, which prevent them from making a substantial profit.

This is particularly concerning in the context of AI spending, which will only exacerbate cloud inefficiency. AI, which has gripped the SaaS world as firmly as it has the public imagination, is notoriously difficult to manage. Immature CCM programs will buckle under its complexity and fail to maximize the profitability of AI-driven applications.

The good news is that companies can take some simple steps to remediate these issues. Let's look at some of this survey's key findings and how companies can reverse the trend of inefficiency and maximize their cloud profitability.

Most Companies Don't Proactively Manage Their Cloud Costs

One of the survey's most troubling findings is that 61% of companies don't have a formalized CCM program. This is consistent with The State of FinOps 2024, a report by the FinOps Foundation, which showed that 62% of companies are in the least mature stage (the "Crawl" stage) of FinOps. Formalized CCM spans numerous functions, from the most straightforward budgeting and forecasting to the most complex unit economics calculation, but most fundamental to CCM is cost allocation.

Cost allocation means assigning appropriate costs to individual customers, products, features, teams, microservices, etc. Complete cost allocation shows companies precisely what's driving their spending — and, by extension, where they're most (and least) efficient. The report found that just 9% of companies have complete or near-complete cost allocation.

If you don't know what's driving your spending, it's impossible to drive meaningful efficiencies. Upon instituting a formalized CCM program, companies reduce their cloud costs by 30% in the first year. Low allocation and infrequency of formalized CCM programs would suggest that companies are leaving profit on the table — and the next key finding confirms it.

COGS Inefficiency: Companies Are Leaving Profit on the Table

Roughly three-quarters of survey respondents said their cloud expenses account for at least 20% of their cost of goods sold (COGS), and more than a quarter (28%) said cloud costs account for more than half of their COGS. Since COGS is a key factor in gross margin (i.e., profitability) calculations, and companies that institute CCM programs tend to reduce their cloud costs by 30%, companies are leaving a lot of profit on the table.

A company with $100 million in revenue and $25 million in COGS would have a gross profit of 75% — good, in SaaS terms, but not elite. Now, imagine that their cloud costs represent 50% of their COGS — $12.5 million. A 30% reduction would lower their cloud costs to $8.75 million and their overall COGS to $21.25 million. Their gross profit would grow to 78.75% — near-elite.

Organizations Aren't Using the Most Powerful CCM Methods

An absence of strong CCM also means companies tend not to use its most powerful approaches — namely, software code optimization. While about half of companies take advantage of simple CCM methods — enterprise discounts, bulk purchasing discounts — just 28% of companies practice software code optimization. Software code optimization entails ad-hoc code fixes that make the software run more efficiently and at the highest scale levels, saving companies millions of dollars.

Software code optimization requires well-allocated, real-time, highly granular cost data and systems to notify the correct engineers when costs spike. Given that just 31% of companies have formal CCM programs, it's not surprising that roughly the same portion uses software code optimization.

Elite Cloud Efficiency Rate (CER): 92%+

Cloud Efficiency Rate (CER) is a universal benchmark for cloud cost efficiency. It compares your revenue to your cloud spend and shows you how much of every revenue dollar you keep versus how much you send to cloud providers. A company with an 80% CER sends $0.20 of every revenue dollar to its cloud providers; a company with a 90% CER sends $0.10 of every dollar to its cloud providers. The report shows that the top-quartile CER is 92%, meaning the most cloud-efficient SaaS companies send just $0.08 of every revenue dollar to their cloud providers.

CERs also tend to worsen as companies scale and add engineers. Angel/bootstrapped companies reported the highest median CER (92%), with every other category reporting significantly worse median CERs (80% across public, debt/private equity, and venture capital). Companies with 11–25 engineers have the highest median CER (87%), with 51–100 (75%) and 100+ (80%) representing significant CER declines.

Increase Your Profitability with CCM

Organizations that want to grow, maintain a high pace of innovation, and increase their cloud efficiency need to compare their CER to industry benchmarks, at minimum. To drive elite CER, they will need sophisticated CCM programs. This involves engagement from the engineering function, precise budgeting, complete allocation, and clear unit economics.

Technical teams buy cloud resources and manage their costs, so they're positioned to have the most positive impact on cloud efficiency. Providing technical teams with relevant, real-time cloud cost data will empower them to make better infrastructure and code decisions. This will make innovations more durable and result in a healthier bottom line for the business.

Methodology: CloudZero, in partnership with Benchmarkit, a B2B SaaS research firm, conducted the report. More than 700 cloud operations and finance professionals at SaaS companies throughout North America were surveyed on all things cloud spending.

Bill Buckley is SVP of Engineering at CloudZero

Hot Topics

The Latest

Most organizations approach OpenTelemetry as a collection of individual tools they need to assemble from scratch. This view misses the bigger picture. OpenTelemetry is a complete telemetry framework with composable components that address specific problems at different stages of organizational maturity. You start with what you need today and adopt additional pieces as your observability practices evolve ...

One of the earliest lessons I learned from architecting throughput-heavy services is that simplicity wins repeatedly: fewer moving parts, loosely coupled execution (fewer synchronous calls), and precise timing metering. You want data and decisions to travel the shortest possible path. The goal is to build a system where every strategy and each line of code (contention is the key metric) complements the decision trees ...

As discussions around AI "autonomous coworkers" accelerate, many industry projections assume that agents will soon operate alongside human staff in making decisions, taking actions, and managing tasks with minimal oversight. But a growing number of critics (including some of the developers building these systems) argue that the industry still has a long way to go to be able to treat AI agents like fully trusted teammates ...

Enterprise AI has entered a transformational phase where, according to Digitate's recently released survey, Agentic AI and the Future of Enterprise IT, companies are moving beyond traditional automation toward Agentic AI systems designed to reason, adapt, and collaborate alongside human teams ...

The numbers back this urgency up. A recent Zapier survey shows that 92% of enterprises now treat AI as a top priority. Leaders want it, and teams are clamoring for it. But if you look closer at the operations of these companies, you see a different picture. The rollout is slow. The results are often delayed. There's a disconnect between what leaders want and what their technical infrastructure can handle ...

Kyndryl's 2025 Readiness Report revealed that 61% of global business and technology leaders report increasing pressure from boards and regulators to prove AI's ROI. As the technology evolves and expectations continue to rise, leaders are compelled to generate and prove impact before scaling further. This will lead to a decisive turning point in 2026 ...

Cloudflare's disruption illustrates how quickly a single provider's issue cascades into widespread exposure. Many organizations don't fully realize how tightly their systems are coupled to thirdparty services, or how quickly availability and security concerns align when those services falter ... You can't avoid these dependencies, but you can understand them ...

If you work with AI, you know this story. A model performs during testing, looks great in early reviews, works perfectly in production and then slowly loses relevance after operating for a while. Everything on the surface looks perfect — pipelines are running, predictions or recommendations are error-free, data quality checks show green; yet outcomes don't meet the ground reality. This pattern often repeats across enterprise AI programs. Take for example, a mid-sized retail banking and wealth-management firm with heavy investments in AI-powered risk analytics, fraud detection and personalized credit-decisioning systems. The model worked well for a while, but transactions increased, so did false positives by 18% ...

Basic uptime is no longer the gold standard. By 2026, network monitoring must do more than report status, it must explain performance in a hybrid-first world. Networks are no longer just static support systems; they are agile, distributed architectures that sit at the very heart of the customer experience and the business outcomes ... The following five trends represent the new standard for network health, providing a blueprint for teams to move from reactive troubleshooting to a proactive, integrated future ...

APMdigest's Predictions Series concludes with 2026 AI Predictions — industry experts offer predictions on how AI and related technologies will evolve and impact business in 2026. Part 5, the final installment, covers AI's impacts on IT teams ...

4 Insights into Modern Cloud Inefficiency

Bill Buckley
CloudZero

For the last 18 years — through pandemic times, boom times, pullbacks, and more — little has been predictable except one thing: Worldwide cloud spending will be higher this year than last year and a lot higher next year. But as companies spend more, are they spending more intelligently? Just how efficient are our modern SaaS systems?

CloudZero's new report, How Cloud Efficient Are Software Companies In 2024?, found that most companies have limited (or nonexistent) cloud cost management (CCM) programs, which prevent them from making a substantial profit.

This is particularly concerning in the context of AI spending, which will only exacerbate cloud inefficiency. AI, which has gripped the SaaS world as firmly as it has the public imagination, is notoriously difficult to manage. Immature CCM programs will buckle under its complexity and fail to maximize the profitability of AI-driven applications.

The good news is that companies can take some simple steps to remediate these issues. Let's look at some of this survey's key findings and how companies can reverse the trend of inefficiency and maximize their cloud profitability.

Most Companies Don't Proactively Manage Their Cloud Costs

One of the survey's most troubling findings is that 61% of companies don't have a formalized CCM program. This is consistent with The State of FinOps 2024, a report by the FinOps Foundation, which showed that 62% of companies are in the least mature stage (the "Crawl" stage) of FinOps. Formalized CCM spans numerous functions, from the most straightforward budgeting and forecasting to the most complex unit economics calculation, but most fundamental to CCM is cost allocation.

Cost allocation means assigning appropriate costs to individual customers, products, features, teams, microservices, etc. Complete cost allocation shows companies precisely what's driving their spending — and, by extension, where they're most (and least) efficient. The report found that just 9% of companies have complete or near-complete cost allocation.

If you don't know what's driving your spending, it's impossible to drive meaningful efficiencies. Upon instituting a formalized CCM program, companies reduce their cloud costs by 30% in the first year. Low allocation and infrequency of formalized CCM programs would suggest that companies are leaving profit on the table — and the next key finding confirms it.

COGS Inefficiency: Companies Are Leaving Profit on the Table

Roughly three-quarters of survey respondents said their cloud expenses account for at least 20% of their cost of goods sold (COGS), and more than a quarter (28%) said cloud costs account for more than half of their COGS. Since COGS is a key factor in gross margin (i.e., profitability) calculations, and companies that institute CCM programs tend to reduce their cloud costs by 30%, companies are leaving a lot of profit on the table.

A company with $100 million in revenue and $25 million in COGS would have a gross profit of 75% — good, in SaaS terms, but not elite. Now, imagine that their cloud costs represent 50% of their COGS — $12.5 million. A 30% reduction would lower their cloud costs to $8.75 million and their overall COGS to $21.25 million. Their gross profit would grow to 78.75% — near-elite.

Organizations Aren't Using the Most Powerful CCM Methods

An absence of strong CCM also means companies tend not to use its most powerful approaches — namely, software code optimization. While about half of companies take advantage of simple CCM methods — enterprise discounts, bulk purchasing discounts — just 28% of companies practice software code optimization. Software code optimization entails ad-hoc code fixes that make the software run more efficiently and at the highest scale levels, saving companies millions of dollars.

Software code optimization requires well-allocated, real-time, highly granular cost data and systems to notify the correct engineers when costs spike. Given that just 31% of companies have formal CCM programs, it's not surprising that roughly the same portion uses software code optimization.

Elite Cloud Efficiency Rate (CER): 92%+

Cloud Efficiency Rate (CER) is a universal benchmark for cloud cost efficiency. It compares your revenue to your cloud spend and shows you how much of every revenue dollar you keep versus how much you send to cloud providers. A company with an 80% CER sends $0.20 of every revenue dollar to its cloud providers; a company with a 90% CER sends $0.10 of every dollar to its cloud providers. The report shows that the top-quartile CER is 92%, meaning the most cloud-efficient SaaS companies send just $0.08 of every revenue dollar to their cloud providers.

CERs also tend to worsen as companies scale and add engineers. Angel/bootstrapped companies reported the highest median CER (92%), with every other category reporting significantly worse median CERs (80% across public, debt/private equity, and venture capital). Companies with 11–25 engineers have the highest median CER (87%), with 51–100 (75%) and 100+ (80%) representing significant CER declines.

Increase Your Profitability with CCM

Organizations that want to grow, maintain a high pace of innovation, and increase their cloud efficiency need to compare their CER to industry benchmarks, at minimum. To drive elite CER, they will need sophisticated CCM programs. This involves engagement from the engineering function, precise budgeting, complete allocation, and clear unit economics.

Technical teams buy cloud resources and manage their costs, so they're positioned to have the most positive impact on cloud efficiency. Providing technical teams with relevant, real-time cloud cost data will empower them to make better infrastructure and code decisions. This will make innovations more durable and result in a healthier bottom line for the business.

Methodology: CloudZero, in partnership with Benchmarkit, a B2B SaaS research firm, conducted the report. More than 700 cloud operations and finance professionals at SaaS companies throughout North America were surveyed on all things cloud spending.

Bill Buckley is SVP of Engineering at CloudZero

Hot Topics

The Latest

Most organizations approach OpenTelemetry as a collection of individual tools they need to assemble from scratch. This view misses the bigger picture. OpenTelemetry is a complete telemetry framework with composable components that address specific problems at different stages of organizational maturity. You start with what you need today and adopt additional pieces as your observability practices evolve ...

One of the earliest lessons I learned from architecting throughput-heavy services is that simplicity wins repeatedly: fewer moving parts, loosely coupled execution (fewer synchronous calls), and precise timing metering. You want data and decisions to travel the shortest possible path. The goal is to build a system where every strategy and each line of code (contention is the key metric) complements the decision trees ...

As discussions around AI "autonomous coworkers" accelerate, many industry projections assume that agents will soon operate alongside human staff in making decisions, taking actions, and managing tasks with minimal oversight. But a growing number of critics (including some of the developers building these systems) argue that the industry still has a long way to go to be able to treat AI agents like fully trusted teammates ...

Enterprise AI has entered a transformational phase where, according to Digitate's recently released survey, Agentic AI and the Future of Enterprise IT, companies are moving beyond traditional automation toward Agentic AI systems designed to reason, adapt, and collaborate alongside human teams ...

The numbers back this urgency up. A recent Zapier survey shows that 92% of enterprises now treat AI as a top priority. Leaders want it, and teams are clamoring for it. But if you look closer at the operations of these companies, you see a different picture. The rollout is slow. The results are often delayed. There's a disconnect between what leaders want and what their technical infrastructure can handle ...

Kyndryl's 2025 Readiness Report revealed that 61% of global business and technology leaders report increasing pressure from boards and regulators to prove AI's ROI. As the technology evolves and expectations continue to rise, leaders are compelled to generate and prove impact before scaling further. This will lead to a decisive turning point in 2026 ...

Cloudflare's disruption illustrates how quickly a single provider's issue cascades into widespread exposure. Many organizations don't fully realize how tightly their systems are coupled to thirdparty services, or how quickly availability and security concerns align when those services falter ... You can't avoid these dependencies, but you can understand them ...

If you work with AI, you know this story. A model performs during testing, looks great in early reviews, works perfectly in production and then slowly loses relevance after operating for a while. Everything on the surface looks perfect — pipelines are running, predictions or recommendations are error-free, data quality checks show green; yet outcomes don't meet the ground reality. This pattern often repeats across enterprise AI programs. Take for example, a mid-sized retail banking and wealth-management firm with heavy investments in AI-powered risk analytics, fraud detection and personalized credit-decisioning systems. The model worked well for a while, but transactions increased, so did false positives by 18% ...

Basic uptime is no longer the gold standard. By 2026, network monitoring must do more than report status, it must explain performance in a hybrid-first world. Networks are no longer just static support systems; they are agile, distributed architectures that sit at the very heart of the customer experience and the business outcomes ... The following five trends represent the new standard for network health, providing a blueprint for teams to move from reactive troubleshooting to a proactive, integrated future ...

APMdigest's Predictions Series concludes with 2026 AI Predictions — industry experts offer predictions on how AI and related technologies will evolve and impact business in 2026. Part 5, the final installment, covers AI's impacts on IT teams ...