Earlier this year, New Relic conducted an extensive survey of IT practitioners and decision-makers to understand the current state of observability: the ability to measure how a system is performing and identify issues and errors based on its external outputs. The company surveyed 1,614 IT professionals across 14 countries in North America, Europe and the Asia Pacific region. The findings of the 2022 Observability Forecast offer a detailed view of how this practice is shaping engineering and the technologies of the future.
Here are 10 key takeaways from the forecast:
1. Observability improves service-level metrics. Organizations see its value and plan to invest more
Respondents to the New Relic survey plan aggressive observability deployments, with 72% planning to maintain or increase their observability budgets over the next year. More than half expected their budgets to increase, while 20% expect to maintain current spending levels.
2. Most organizations will have robust observability practices in place by 2025
The 2022 Observability Forecast identified 17 observability capabilities that comprise a mature practice. Nearly all respondents expected to deploy key capabilities like network monitoring, security monitoring and log management by 2025. The majority expected to have 88–97% of the 17 capabilities deployed, but just 3% of respondents already maintain all 17 capabilities today.
3. Observability is now a board-level imperative
Tech executives have recognized the value and importance of observability: 73% of respondents reported that their C-suite executives are supporters of observability, and 78% saw observability as a key enabler for achieving core business goals. Furthermore, of those who had mature observability practices by the report's definition, 100% indicated that observability improves revenue retention by deepening their understanding of customer behaviors.
4. For many organizations, large sections of tech stacks are still not being fully observed or monitored
Despite the overall enthusiasm for observability and the fact that most organizations are practicing some form of observability, only 27% of respondents' organizations have achieved full-stack observability as defined in the report. The overall lack of adoption of full-stack observability signals that many organizations have an opportunity to make rapid improvements to their observability practices over the next year.
5. Organizations must tackle fragmentation of data, tools and teams
Many organizations use a patchwork of tools to monitor their technology stacks, requiring extensive manual effort only to gain a fragmented view of IT systems. More than 80% of respondents used four or more observability tools, and a third of respondents had to detect outages manually or from complaints. Just 7% of respondents said their telemetry data is unified in one place, and only 5% had a mature observability practice. Recognizing the challenges of fragmentation, respondents reported the need for simplicity, integration, seamlessness, and more efficient ways to complete high-value projects.
6. Telemetry data is often siloed
Siloed and fragmented data lead to a painful user experience, but slightly more than half (51%) of respondents still have siloed data in their tech stacks. Of those who have entirely siloed data, 77% stated they would prefer a single, consolidated platform. Those who struggle the most to juggle data across different silos long for more simplicity in their observability solutions.
7. There is a strong correlation between full-stack observability and faster mean time to detection (MTTD)
Respondents from organizations that have achieved full-stack observability, as well as those who have already prioritized full-stack observability, were more likely than others to experience the fastest mean time to detect an outage — less than five minutes. The data supports a strong correlation between achieving or prioritizing full-stack observability and a range of performance benefits, including fewer outages, improved outage detection rates, and improved resolution.
8. One of the biggest roadblocks to achieving observability is a failure to understand the benefits
The 2022 Observability Forecast asked respondents to name the biggest challenges preventing full-stack observability. The top responses were a lack of understanding of the benefits of observability and the belief that current IT performance is adequate (28% for each). Other leading roadblocks were a lack of budget (27%) and too many monitoring tools (25%).
9. Despite that, IT professionals recognize the bottom-line benefits of observability
Survey respondents named a wide range of observability benefits. These include improved uptime and reliability (cited by 36% of respondents), increased operational efficiency (35%), proactive detection of issues (33%) and an improved customer experience (33%). Respondents also said that observability improves the lives of engineers and developers, with 34% saying it helped to increase productivity and 32% crediting observability for supporting cross-team collaboration.
10. Organizations expect to need observability for AI, IoT and key business applications
C-suite executives see observability playing a major role in the development of new technologies. More than half of respondents said they would need observability most for artificial intelligence (AI) applications, while 48% mentioned the Internet of Things, 38% cited edge computing, and 36% highlighted blockchain applications. Observability in AI was mentioned across industries, with a majority of respondents in services/consulting (62%), energy/utilities (60%), government (58%) and IT/telco (51%) mentioning the need for observability in their AI projects.
The Latest
As enterprises work to implement or improve their observability practices, tool sprawl is a very real phenomenon ... Tool sprawl can and does happen all across the organization. In this post, though, we'll focus specifically on how and why observability efforts often result in tool sprawl, some of the possible negative consequences of that sprawl, and we'll offer some advice on how to reduce or even avoid sprawl ...
As companies generate more data across their network footprints, they need network observability tools to help find meaning in that data for better decision-making and problem solving. It seems many companies believe that adding more tools leads to better and faster insights ... And yet, observability tools aren't meeting many companies' needs. In fact, adding more tools introduces new challenges ...
Driven by the need to create scalable, faster, and more agile systems, businesses are adopting cloud native approaches. But cloud native environments also come with an explosion of data and complexity that makes it harder for businesses to detect and remediate issues before everything comes to a screeching halt. Observability, if done right, can make it easier to mitigate these challenges and remediate incidents before they become major customer-impacting problems ...
The spiraling cost of energy is forcing public cloud providers to raise their prices significantly. A recent report by Canalys predicted that public cloud prices will jump by around 20% in the US and more than 30% in Europe in 2023. These steep price increases will test the conventional wisdom that moving to the cloud is a cheap computing alternative ...
Despite strong interest over the past decade, the actual investment in DX has been recent. While 100% of enterprises are now engaged with DX in some way, most (77%) have begun their DX journey within the past two years. And most are early stage, with a fourth (24%) at the discussion stage and half (49%) currently transforming. Only 27% say they have finished their DX efforts ...
While most thought that distraction and motivation would be the main contributors to low productivity in a work-from-home environment, many organizations discovered that it was gaps in their IT systems that created some of the most significant challenges ...
APMdigest and leading IT research firm Enterprise Management Associates (EMA) are teaming up on the EMA-APMdigest Podcast, a new podcast focused on the latest technologies impacting IT Operations. In Episode 1, Dan Twing, President and COO of EMA, discusses Observability and Automation with Will Schoeppner, Research Director covering Application Performance Management and Business Intelligence at EMA ...
APMdigest is following up our list of 2023 Application Performance Management Predictions with predictions from industry experts about how the cloud will evolve in 2023 ...
As demand for digital services increases and distributed systems become more complex, organizations must collect and process a growing amount of observability data (logs, metrics, and traces). Site reliability engineers (SREs), developers, and security engineers use observability data to learn how their applications and environments are performing so they can successfully respond to issues and mitigate risk ...
