4 Insights into Modern Cloud Inefficiency
September 16, 2024

Bill Buckley
CloudZero

Share this

For the last 18 years — through pandemic times, boom times, pullbacks, and more — little has been predictable except one thing: Worldwide cloud spending will be higher this year than last year and a lot higher next year. But as companies spend more, are they spending more intelligently? Just how efficient are our modern SaaS systems?

CloudZero's new report, How Cloud Efficient Are Software Companies In 2024?, found that most companies have limited (or nonexistent) cloud cost management (CCM) programs, which prevent them from making a substantial profit.

This is particularly concerning in the context of AI spending, which will only exacerbate cloud inefficiency. AI, which has gripped the SaaS world as firmly as it has the public imagination, is notoriously difficult to manage. Immature CCM programs will buckle under its complexity and fail to maximize the profitability of AI-driven applications.

The good news is that companies can take some simple steps to remediate these issues. Let's look at some of this survey's key findings and how companies can reverse the trend of inefficiency and maximize their cloud profitability.

Most Companies Don't Proactively Manage Their Cloud Costs

One of the survey's most troubling findings is that 61% of companies don't have a formalized CCM program. This is consistent with The State of FinOps 2024, a report by the FinOps Foundation, which showed that 62% of companies are in the least mature stage (the "Crawl" stage) of FinOps. Formalized CCM spans numerous functions, from the most straightforward budgeting and forecasting to the most complex unit economics calculation, but most fundamental to CCM is cost allocation.

Cost allocation means assigning appropriate costs to individual customers, products, features, teams, microservices, etc. Complete cost allocation shows companies precisely what's driving their spending — and, by extension, where they're most (and least) efficient. The report found that just 9% of companies have complete or near-complete cost allocation.

If you don't know what's driving your spending, it's impossible to drive meaningful efficiencies. Upon instituting a formalized CCM program, companies reduce their cloud costs by 30% in the first year. Low allocation and infrequency of formalized CCM programs would suggest that companies are leaving profit on the table — and the next key finding confirms it.

COGS Inefficiency: Companies Are Leaving Profit on the Table

Roughly three-quarters of survey respondents said their cloud expenses account for at least 20% of their cost of goods sold (COGS), and more than a quarter (28%) said cloud costs account for more than half of their COGS. Since COGS is a key factor in gross margin (i.e., profitability) calculations, and companies that institute CCM programs tend to reduce their cloud costs by 30%, companies are leaving a lot of profit on the table.

A company with $100 million in revenue and $25 million in COGS would have a gross profit of 75% — good, in SaaS terms, but not elite. Now, imagine that their cloud costs represent 50% of their COGS — $12.5 million. A 30% reduction would lower their cloud costs to $8.75 million and their overall COGS to $21.25 million. Their gross profit would grow to 78.75% — near-elite.

Organizations Aren't Using the Most Powerful CCM Methods

An absence of strong CCM also means companies tend not to use its most powerful approaches — namely, software code optimization. While about half of companies take advantage of simple CCM methods — enterprise discounts, bulk purchasing discounts — just 28% of companies practice software code optimization. Software code optimization entails ad-hoc code fixes that make the software run more efficiently and at the highest scale levels, saving companies millions of dollars.

Software code optimization requires well-allocated, real-time, highly granular cost data and systems to notify the correct engineers when costs spike. Given that just 31% of companies have formal CCM programs, it's not surprising that roughly the same portion uses software code optimization.

Elite Cloud Efficiency Rate (CER): 92%+

Cloud Efficiency Rate (CER) is a universal benchmark for cloud cost efficiency. It compares your revenue to your cloud spend and shows you how much of every revenue dollar you keep versus how much you send to cloud providers. A company with an 80% CER sends $0.20 of every revenue dollar to its cloud providers; a company with a 90% CER sends $0.10 of every dollar to its cloud providers. The report shows that the top-quartile CER is 92%, meaning the most cloud-efficient SaaS companies send just $0.08 of every revenue dollar to their cloud providers.

CERs also tend to worsen as companies scale and add engineers. Angel/bootstrapped companies reported the highest median CER (92%), with every other category reporting significantly worse median CERs (80% across public, debt/private equity, and venture capital). Companies with 11–25 engineers have the highest median CER (87%), with 51–100 (75%) and 100+ (80%) representing significant CER declines.

Increase Your Profitability with CCM

Organizations that want to grow, maintain a high pace of innovation, and increase their cloud efficiency need to compare their CER to industry benchmarks, at minimum. To drive elite CER, they will need sophisticated CCM programs. This involves engagement from the engineering function, precise budgeting, complete allocation, and clear unit economics.

Technical teams buy cloud resources and manage their costs, so they're positioned to have the most positive impact on cloud efficiency. Providing technical teams with relevant, real-time cloud cost data will empower them to make better infrastructure and code decisions. This will make innovations more durable and result in a healthier bottom line for the business.

Methodology: CloudZero, in partnership with Benchmarkit, a B2B SaaS research firm, conducted the report. More than 700 cloud operations and finance professionals at SaaS companies throughout North America were surveyed on all things cloud spending.

Bill Buckley is SVP of Engineering at CloudZero
Share this

The Latest

October 09, 2024
A well-performing application is no longer a luxury; it has become a necessity for many business organizations worldwide. End users expect applications to be fast, reliable, and responsive — anything less can cause user frustration, app abandonment, and ultimately lost revenue. This is where application performance testing comes in ....
October 08, 2024

The demand for real-time AI capabilities is pushing data scientists to develop and manage infrastructure that can handle massive volumes of data in motion. This includes streaming data pipelines, edge computing, scalable cloud architecture, and data quality and governance. These new responsibilities require data scientists to expand their skill sets significantly ...

October 07, 2024

As the digital landscape constantly evolves, it's critical for businesses to stay ahead, especially when it comes to operating systems updates. A recent ControlUp study revealed that 82% of enterprise Windows endpoint devices have yet to migrate to Windows 11. With Microsoft's cutoff date on October 14, 2025, for Windows 10 support fast approaching, the urgency cannot be overstated ...

October 04, 2024

In Part 1 of this two-part series, I defined multi-CDN and explored how and why this approach is used by streaming services, e-commerce platforms, gaming companies and global enterprises for fast and reliable content delivery ... Now, in Part 2 of the series, I'll explore one of the biggest challenges of multi-CDN: observability.

October 03, 2024

CDNs consist of geographically distributed data centers with servers that cache and serve content close to end users to reduce latency and improve load times. Each data center is strategically placed so that digital signals can rapidly travel from one "point of presence" to the next, getting the digital signal to the viewer as fast as possible ... Multi-CDN refers to the strategy of utilizing multiple CDNs to deliver digital content across the internet ...

October 02, 2024

We surveyed IT professionals on their attitudes and practices regarding using Generative AI with databases. We asked how they are layering the technology in with their systems, where it's working the best for them, and what their concerns are ...

October 01, 2024

40% of generative AI (GenAI) solutions will be multimodal (text, image, audio and video) by 2027, up from 1% in 2023, according to Gartner ...

September 30, 2024

Today's digital business landscape evolves rapidly ... Among the areas primed for innovation, the long-standing ticket-based IT support model stands out as particularly outdated. Emerging as a game-changer, the concept of the "ticketless enterprise" promises to shift IT management from a reactive stance to a proactive approach ...

September 27, 2024

In MEAN TIME TO INSIGHT Episode 10, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses Generative AI ...

September 26, 2024

By 2026, 30% of enterprises will automate more than half of their network activities, an increase from under 10% in mid-2023, according to Gartner ...