Modernization Cannot Succeed without Observability
October 13, 2022

Rachna Srivastava

Share this

As organizations deploy multi-cloud environments and adopt more containers, microservices, and cloud-native technologies, they are facing increasingly distributed systems. As a result, the use of observability is becoming mainstream — with organizations turning to observability solutions to provide an understanding of critical interdependencies across application workloads and infrastructure and address the ever-growing complexity that goes along with modernizing your business.

VMware's 2022 State of Observability found that companies are still grappling with increasing complexity and a lack of visibility — with 97% reporting challenges in their ability to monitor cloud application environments. In this blog, I'll outline key takeaways, including how cloud-native apps have rapidly grown in complexity, why the perception of observability has shifted, and what challenges still need to be addressed. 

Cloud Native Apps Growing in Complexity

Enterprise operations are overwhelmingly hybrid and multi-cloud, with 89% of respondents agreeing that today's cloud applications are significantly more complex than they were five years ago. Development teams are also moving toward microservice architectures and picking up the pace of code delivery, leading to an increased need for observability tools. 

In addition, a vast amount of organizations are releasing or making updates to critical cloud applications multiple times a week or more. With less than 19% of respondents stating they push updates less than once a month. Even with the best processes in place, organizations cannot expect all changes to go smoothly when these changes are happening frequently.

The Shift in Perception of Observability

A clear value sign of how essential observability tools are becoming is the sentiments shared by those using the tools, with 41% of survey respondents claiming it is not just valuable but necessary for daily operations. For those who have already implemented an observability solution, it is clear that it doesn't just benefit one part of the team but the entire team. Almost nine out of ten respondents (88%) agree that cloud services and applications would have better availability and performance if stakeholders — DevOps, developers, SREs, architects, etc. — had visibility into necessary infrastructure and application behavior metrics. 

In the past year, there has been a 32% jump in those just using observability shifting their beliefs to acknowledge the necessity of observability tools. All this to say that the perceived value of observability is at an all-time high. In terms of most valued observability capabilities, the top four were: easy integration with existing tooling including open source (51%), monitoring multi-sourced data at scale including metrics, histograms, traces, and span logs (49%), performing both synthetic and real-user monitoring (48%), and easily correlate customer and business metrics to application and infrastructure performance (48%). 

Some Challenges Still Remain

While the need for organizations to adopt an observability solution is becoming business imperative, it doesn't come without its challenges. As organizations add observability tools, almost half are using more than five separate tools and have no clear consensus on how to rationalize toolsets. This year, two-thirds of respondents (67%) agreed that it is a mistake to monitor applications and infrastructure separately in a cloud environment, up significantly from 57% who felt that way last year. Showing that having separate tools for infrastructure and application monitoring, with no way to correlate metrics across domains, is insufficient in helping troubleshoot accidents. 

While it can be argued that there is value in having individual software tools specifically suited to specific needs, every tool requires energy and effort to deploy and maintain. The group was divided when respondents were asked what they believed was the best way to improve their existing monitoring tools. 48% preferred identifying gaps in the current toolset and acquiring additional capabilities as needed, (38%) preferred integrating existing or new tools to reduce their overall toolset. Lastly, 14% thought evaluating new needs and starting from scratch would be best. Signifying that even though the road to observability isn't always easy, it's necessary. 

What Does All This Mean

Observability has gained significant momentum in the last year. With 70% of those surveyed either using, implementing, or evaluating observability tools, observability has reached a tipping point and is set to enter mainstream adoption.

In today's complex IT landscape, monitoring can tell you and your teams when something is wrong, but observability is the key to figuring out why and how to fix it. Observability provides visibility across the full IT stack and helps resolve cloud complexities, allowing teams to identify problems in complex cloud applications easily. Organizations that are using observability report significant benefits, with 87% rating the technology as either necessary (41%) or very valuable (46%). While there is still a need to simplify monitoring tools ( 46% using five or more tools), the best way to unify those tools is not yet crystallized. 

Complexity as organizations transform their business will only continue to grow. Observability is quickly becoming recognized as a mission-critical component to reducing complexity, delivering business outcomes, and innovating faster. 

Rachna Srivastava is the Director of Product Marketing for Observability at VMware
Share this

The Latest

November 28, 2023

Incident management processes are not keeping pace with the demands of modern operations teams, failing to meet the needs of SREs as well as platform and ops teams. Results from the State of DevOps Automation and AI Survey, commissioned by Transposit, point to an incident management paradox. Despite nearly 60% of ITOps and DevOps professionals reporting they have a defined incident management process that's fully documented in one place and over 70% saying they have a level of automation that meets their needs, teams are unable to quickly resolve incidents ...

November 27, 2023

Today, in the world of enterprise technology, the challenges posed by legacy Virtual Desktop Infrastructure (VDI) systems have long been a source of concern for IT departments. In many instances, this promising solution has become an organizational burden, hindering progress, depleting resources, and taking a psychological and operational toll on employees ...

November 22, 2023

Within retail organizations across the world, IT teams will be bracing themselves for a hectic holiday season ... While this is an exciting opportunity for retailers to boost sales, it also intensifies severe risk. Any application performance slipup will cause consumers to turn their back on brands, possibly forever. Online shoppers will be completely unforgiving to any retailer who doesn't deliver a seamless digital experience ...

November 21, 2023

Black Friday is a time when consumers can cash in on some of the biggest deals retailers offer all year long ... Nearly two-thirds of consumers utilize a retailer's web and mobile app for holiday shopping, raising the stakes for competitors to provide the best online experience to retain customer loyalty. Perforce's 2023 Black Friday survey sheds light on consumers' expectations this time of year and how developers can properly prepare their applications for increased online traffic ...

November 20, 2023

This holiday shopping season, the stakes for online retailers couldn't be higher ... Even an hour or two of downtime for a digital storefront during this critical period can cost millions in lost revenue and has the potential to damage brand credibility. Savvy retailers are increasingly investing in observability to help ensure a seamless, omnichannel customer experience. Just ahead of the holiday season, New Relic released its State of Observability for Retail report, which offers insight and analysis on the adoption and business value of observability for the global retail/consumer industry ...

November 16, 2023

As organizations struggle to find and retain the talent they need to manage complex cloud implementations, many are leaning toward hybrid cloud as a solution ... While it's true that using the cloud is not a "one size fits all" proposition, it is clear that both large and small companies prefer a hybrid cloud model ...

November 15, 2023

In the same way a city is a sum of its districts and neighborhoods, complex IT systems are made of many components that continually interact. Observability requires a comprehensive and connected view of all aspects of the system, including even some that don't directly relate to its technological innards ...

November 14, 2023

Multicasting in this context refers to the process of directing data streams to two or more destinations. This might look like sending the same telemetry data to both an on-premises storage system and a cloud-based observability platform concurrently. The two principal benefits of this strategy are cost savings and service redundancy ...

November 13, 2023

In today's rapidly evolving business environment, Chief Information Officers (CIOs) and Chief Technology Officers (CTOs) are grappling with the challenge of regaining control over their IT roadmap. The constant evolution and introduction of new technology releases, combined with the pressure to deliver innovation on shrinking budgets, has added layers of complexity for executives who must transform the perception of the role of the IT leader from cost managers and maintainers to strategic enablers of growth and profitability ...

November 09, 2023

Artificial intelligence (AI) has saturated the conversation around technology as compelling new tools like ChatGPT produce headlines every day. Enterprise leaders have correctly identified the potential of AI — and its many tributary technologies — to generate new efficiencies at scale, particularly in the cloud era. But as we now know, these technologies are rarely plug-and-play, for reasons both technical and human ...