Skip to main content

Explainability Is the New Battleground in AI-Powered Observability

Marc Chipouras
Grafana Labs

The observability industry has an evolving relationship with AI. We're not skeptics, but it's clear that trust in AI must be earned. Grafana Labs recently surveyed 1,300+ practitioners around the world for Grafana Labs' annual Observability Survey, and 92% said they see real value in AI surfacing anomalies before they cause downtime. Another 91% endorsed AI for forecasting and root cause analysis. So while the demand is there, customers need it to be trustworthy, as the survey also found that the practitioners most enthusiastic about AI are also the most insistent on explainability.

That's not a contradiction, it's a signal. The people closest to this technology, the ones who actually want to use it, are the ones most loudly demanding that it show its work. 95% of respondents said it's important for AI to explain its reasoning.

We've spent years in observability fighting alert fatigue: the flood of signals with no clear context, no prioritization, no "here's why this matters." Alert fatigue is still the single biggest obstacle to faster incident response, cited by nearly a third of practitioners in our survey. AI that behaves like a black box doesn't solve that problem. It compounds it. You've traded one source of noise for another.

The most common barrier to AI adoption in our survey wasn't cost, and it wasn't technical complexity; it was too much manual input of required context. In other words, practitioners are being asked to do significant work just to make the AI useful. If AI is creating new toil in place of old toil, we haven't made progress; we've just moved the bottleneck.

What practitioners actually want is AI that reduces the cognitive load of on-call work, not AI that adds to it. They want a system that can say: here is the anomaly, here is why I flagged it, here is the likely cause, and here is what I'd recommend (with the reasoning visible at every step). And while that may not be surprising, the question of autonomy is where things get interesting. 77% of respondents support AI taking autonomous actions, but 15% don't yet trust AI to act on their behalf, and another 8% see no value in it at all. That's a meaningful pocket of resistance, and it deserves to be taken seriously rather than steamrolled by hype.

The path to autonomous AI in observability runs directly through explainability. You cannot ask a team to trust a system that won't explain how it reached its conclusion. Especially not in incident response, where the cost of a wrong call (a missed alert, a misdiagnosed root cause, an automated action that makes things worse) is measured in downtime, revenue, and team trust.

The vendors and teams that get this right won't be the ones with the most sophisticated models. They'll be the ones who treat explainability as a first-class engineering requirement, not an afterthought. The AI that wins in observability will be the AI that practitioners can actually reason about, override when necessary, and learn from over time.

Marc Chipouras is VP of Emerging Products at Grafana Labs

Hot Topics

The Latest

Rapid AI adoption and the unique ways AI workloads operate is redefining the scope and structure of what these teams must deliver. This shift is forcing organizations to rethink how they manage scale, automation, and control, according to The State of SRE and Platform Engineering 2026, a new report from Dynatrace ...

AI is usually talked about as a software tool, but it also depends heavily on the network behind it. Whether a company is using AI for chatbots, automation, monitoring, analytics, or employee support, all of that information has to move across the network in a reliable and secure way. That means AI is not just an application decision. It is also an infrastructure decision. Before organizations rush into AI, they should ask a simple question: Is our network ready to support it? ...

Enterprise AI often lacks governed access to where business processes actually execute. Without that access, AI agents may be able to reason, but they cannot operate reliably across enterprise workflows. For AI agents to effectively carry out workflows, they will require integration-layer context and controls. Organizations can implement these prerequisites by providing AI with managed access to the middleware layer ...

Enterprise networks rarely behave the same way for very long. A routing adjustment in one region may unexpectedly alter application performance in another. A cloud migration may introduce hidden dependencies that go unnoticed until an outage occurs. All the while, the network is managed by several different teams, each of whom use different tool sets — and as a result, have different views of the network ... There’s usually an engineer who remembers why traffic fails over a certain way between sites, or which transparent firewall was added where. The problem is that human memory cannot scale alongside enterprise-scale networks ...

Ask an infrastructure team how confident they are in their ability to govern AI, and most will tell you they've got it handled. A recent survey of 406 IT decision-makers and platform engineering leaders found 86% expressing exactly that confidence. Ask the same group whether they have a formal written AI governance policy, and the number drops to 30%, according to Spacelift's Infrastructure Automation Report ...

In MEAN TIME TO INSIGHT Episode 27, Shamus McGillicuddy, EMA VP of Research, Network Infrastructure and Operations, and Parker Hathcock, EMA Research Director covering IT Service/Operations (ServiceOps), discuss observability unification in modern IT operations ... 

Virtual Private Networks became a cornerstone of enterprise security at a time when corporate infrastructure looked very different from today ... For years, this model worked well. But the architecture behind VPNs assumed a centralized corporate environment—one where the network itself was the hub of activity. In a cloud — first world, that assumption no longer holds ...

Website outages get resolved just as fast in August as they do in November. I went looking for the opposite: the summer slowdown everyone assumes is there once the people who fix things are away. It isn't in the data we collected, covering 1.8 million confirmed outages across tens of thousands of websites ...

This year, many of the cloud infrastructure contracts signed in the early days of the AI boom will come up for renewal. As the year goes on, I anticipate we'll see a significant amount of cloud vendor swapouts and multi-cloud adoption, and the reason isn't just GPU depreciation. It's because they're tired of their current cloud providers ...

There's a moment the many observability teams have experienced days into bringing a new service into production: you realize that the vendor's claims of "intelligent" behavior included a large serving of hype. Their dashboards look nice until they don't, the failure modes are a black box, and no one on the team can confidently explain why the system did what it did at 2 am. Agentic AI is about to force every Ops team to relive that moment at web-scale until they start treating these systems as the dependencies they actually are ...

Explainability Is the New Battleground in AI-Powered Observability

Marc Chipouras
Grafana Labs

The observability industry has an evolving relationship with AI. We're not skeptics, but it's clear that trust in AI must be earned. Grafana Labs recently surveyed 1,300+ practitioners around the world for Grafana Labs' annual Observability Survey, and 92% said they see real value in AI surfacing anomalies before they cause downtime. Another 91% endorsed AI for forecasting and root cause analysis. So while the demand is there, customers need it to be trustworthy, as the survey also found that the practitioners most enthusiastic about AI are also the most insistent on explainability.

That's not a contradiction, it's a signal. The people closest to this technology, the ones who actually want to use it, are the ones most loudly demanding that it show its work. 95% of respondents said it's important for AI to explain its reasoning.

We've spent years in observability fighting alert fatigue: the flood of signals with no clear context, no prioritization, no "here's why this matters." Alert fatigue is still the single biggest obstacle to faster incident response, cited by nearly a third of practitioners in our survey. AI that behaves like a black box doesn't solve that problem. It compounds it. You've traded one source of noise for another.

The most common barrier to AI adoption in our survey wasn't cost, and it wasn't technical complexity; it was too much manual input of required context. In other words, practitioners are being asked to do significant work just to make the AI useful. If AI is creating new toil in place of old toil, we haven't made progress; we've just moved the bottleneck.

What practitioners actually want is AI that reduces the cognitive load of on-call work, not AI that adds to it. They want a system that can say: here is the anomaly, here is why I flagged it, here is the likely cause, and here is what I'd recommend (with the reasoning visible at every step). And while that may not be surprising, the question of autonomy is where things get interesting. 77% of respondents support AI taking autonomous actions, but 15% don't yet trust AI to act on their behalf, and another 8% see no value in it at all. That's a meaningful pocket of resistance, and it deserves to be taken seriously rather than steamrolled by hype.

The path to autonomous AI in observability runs directly through explainability. You cannot ask a team to trust a system that won't explain how it reached its conclusion. Especially not in incident response, where the cost of a wrong call (a missed alert, a misdiagnosed root cause, an automated action that makes things worse) is measured in downtime, revenue, and team trust.

The vendors and teams that get this right won't be the ones with the most sophisticated models. They'll be the ones who treat explainability as a first-class engineering requirement, not an afterthought. The AI that wins in observability will be the AI that practitioners can actually reason about, override when necessary, and learn from over time.

Marc Chipouras is VP of Emerging Products at Grafana Labs

Hot Topics

The Latest

Rapid AI adoption and the unique ways AI workloads operate is redefining the scope and structure of what these teams must deliver. This shift is forcing organizations to rethink how they manage scale, automation, and control, according to The State of SRE and Platform Engineering 2026, a new report from Dynatrace ...

AI is usually talked about as a software tool, but it also depends heavily on the network behind it. Whether a company is using AI for chatbots, automation, monitoring, analytics, or employee support, all of that information has to move across the network in a reliable and secure way. That means AI is not just an application decision. It is also an infrastructure decision. Before organizations rush into AI, they should ask a simple question: Is our network ready to support it? ...

Enterprise AI often lacks governed access to where business processes actually execute. Without that access, AI agents may be able to reason, but they cannot operate reliably across enterprise workflows. For AI agents to effectively carry out workflows, they will require integration-layer context and controls. Organizations can implement these prerequisites by providing AI with managed access to the middleware layer ...

Enterprise networks rarely behave the same way for very long. A routing adjustment in one region may unexpectedly alter application performance in another. A cloud migration may introduce hidden dependencies that go unnoticed until an outage occurs. All the while, the network is managed by several different teams, each of whom use different tool sets — and as a result, have different views of the network ... There’s usually an engineer who remembers why traffic fails over a certain way between sites, or which transparent firewall was added where. The problem is that human memory cannot scale alongside enterprise-scale networks ...

Ask an infrastructure team how confident they are in their ability to govern AI, and most will tell you they've got it handled. A recent survey of 406 IT decision-makers and platform engineering leaders found 86% expressing exactly that confidence. Ask the same group whether they have a formal written AI governance policy, and the number drops to 30%, according to Spacelift's Infrastructure Automation Report ...

In MEAN TIME TO INSIGHT Episode 27, Shamus McGillicuddy, EMA VP of Research, Network Infrastructure and Operations, and Parker Hathcock, EMA Research Director covering IT Service/Operations (ServiceOps), discuss observability unification in modern IT operations ... 

Virtual Private Networks became a cornerstone of enterprise security at a time when corporate infrastructure looked very different from today ... For years, this model worked well. But the architecture behind VPNs assumed a centralized corporate environment—one where the network itself was the hub of activity. In a cloud — first world, that assumption no longer holds ...

Website outages get resolved just as fast in August as they do in November. I went looking for the opposite: the summer slowdown everyone assumes is there once the people who fix things are away. It isn't in the data we collected, covering 1.8 million confirmed outages across tens of thousands of websites ...

This year, many of the cloud infrastructure contracts signed in the early days of the AI boom will come up for renewal. As the year goes on, I anticipate we'll see a significant amount of cloud vendor swapouts and multi-cloud adoption, and the reason isn't just GPU depreciation. It's because they're tired of their current cloud providers ...

There's a moment the many observability teams have experienced days into bringing a new service into production: you realize that the vendor's claims of "intelligent" behavior included a large serving of hype. Their dashboards look nice until they don't, the failure modes are a black box, and no one on the team can confidently explain why the system did what it did at 2 am. Agentic AI is about to force every Ops team to relive that moment at web-scale until they start treating these systems as the dependencies they actually are ...