As companies generate more data across their network footprints, they need network observability tools to help find meaning in that data for better decision-making and problem solving. It seems many companies believe that adding more tools leads to better and faster insights. Earlier this year, the research firm Enterprise Management Associates (EMA) found more than 35% of organizations used 11 or more tools for network operations, and more than 50% used six or more.
And yet, observability tools aren't meeting many companies' needs. In fact, adding more tools introduces new challenges. Only one in four companies say they are successful with their network observability tools, according to a recent EMA and NS1 survey of IT stakeholders, and just 15.2% can identify and fix every network issue before it harms the organization.
Observability strategies are being held back both by the strategies surrounding tool adoption, and the capabilities of the tools themselves. Companies are responding to increased data in ways that add complexity and cost, and networking teams aren't obtaining immediate insight from their observability tools, which leaves them unable to quickly find or remediate network issues.
Let's review the data surrounding these shortcomings:
More Data and More Tools Bring Growing Pains
Increasingly complex networks are now generating more data — 85% of firms report that they have recently increased the amount of data they collect — and many companies are eager to take advantage of this increase. But companies can quickly run out of quota or storage space, resulting in either short retention times or substantial cost increases, and 43.5% of respondents say that data storage is now a major challenge.
Networking teams often respond to more data with more tools because their current ones aren't sufficient. More than 50% of respondents said they don't believe they have a single network observability tool that can fully answer any network question. Yet adding more tools often requires expensive customization, according to 54% of respondents, and even once set up is done, 46% say that conflicts between observability tools are a major problem.
Actionable Insights Remain a Work in Progress
Networking teams need observability tools to provide them with immediate insight so they can take action, but in practice, getting insights often requires excessive time and effort. Only one-third of respondents say obtaining a global view of network operations is very easy, and four in five say they are not fully satisfied with the ability to obtain insights from the tools they use. It's no surprise that 84.8% of respondents cannot detect every network issue before problems arise, and 88.8% cannot remediate every issue before problems occur.
Another significant problem is the high rate of false alarms — tool alerts that are ultimately meaningless but require investigation anyway. Remarkably, respondents report that 53% of all alerts are false alarms. This represents a tremendous time sink that likely contributes to three in four respondents saying they are not fully satisfied with their network tooling.
For companies overwhelmed by data storage and a failure to obtain insight, it may be worth deploying observability agents on the edge where data is generated. Such agents can analyze data in real time, so networking teams can bypass the challenges associated with backhauling potentially unused raw data and obtain real-time insight for rapid issue detection and remediation.
Moving forward, it is essential for the people who build network observability tools to understand what networking teams need. This includes deep but dynamically defined data collection with meaningful insights, especially regarding network and application performance, network security, and the end-user experience.
The Latest
As enterprises work to implement or improve their observability practices, tool sprawl is a very real phenomenon ... Tool sprawl can and does happen all across the organization. In this post, though, we'll focus specifically on how and why observability efforts often result in tool sprawl, some of the possible negative consequences of that sprawl, and we'll offer some advice on how to reduce or even avoid sprawl ...
As companies generate more data across their network footprints, they need network observability tools to help find meaning in that data for better decision-making and problem solving. It seems many companies believe that adding more tools leads to better and faster insights ... And yet, observability tools aren't meeting many companies' needs. In fact, adding more tools introduces new challenges ...
Driven by the need to create scalable, faster, and more agile systems, businesses are adopting cloud native approaches. But cloud native environments also come with an explosion of data and complexity that makes it harder for businesses to detect and remediate issues before everything comes to a screeching halt. Observability, if done right, can make it easier to mitigate these challenges and remediate incidents before they become major customer-impacting problems ...
The spiraling cost of energy is forcing public cloud providers to raise their prices significantly. A recent report by Canalys predicted that public cloud prices will jump by around 20% in the US and more than 30% in Europe in 2023. These steep price increases will test the conventional wisdom that moving to the cloud is a cheap computing alternative ...
Despite strong interest over the past decade, the actual investment in DX has been recent. While 100% of enterprises are now engaged with DX in some way, most (77%) have begun their DX journey within the past two years. And most are early stage, with a fourth (24%) at the discussion stage and half (49%) currently transforming. Only 27% say they have finished their DX efforts ...
While most thought that distraction and motivation would be the main contributors to low productivity in a work-from-home environment, many organizations discovered that it was gaps in their IT systems that created some of the most significant challenges ...
APMdigest and leading IT research firm Enterprise Management Associates (EMA) are teaming up on the EMA-APMdigest Podcast, a new podcast focused on the latest technologies impacting IT Operations. In Episode 1, Dan Twing, President and COO of EMA, discusses Observability and Automation with Will Schoeppner, Research Director covering Application Performance Management and Business Intelligence at EMA ...
APMdigest is following up our list of 2023 Application Performance Management Predictions with predictions from industry experts about how the cloud will evolve in 2023 ...
As demand for digital services increases and distributed systems become more complex, organizations must collect and process a growing amount of observability data (logs, metrics, and traces). Site reliability engineers (SREs), developers, and security engineers use observability data to learn how their applications and environments are performing so they can successfully respond to issues and mitigate risk ...
