Building Trust in AIOps
December 02, 2021

Richard Whitehead

Share this

In the old days of monolithic architectures, IT operations teams could manage service-disrupting incidents themselves. But these architectures have evolved, and the systems our digital economy relies on today are too complex and produce too much data for human operators to monitor, let alone fix. Artificial Intelligence for IT Operations (AIOps) solutions automate system monitoring and remediation strategies to help DevOps and SRE teams ensure that services and apps are continuously available.

If legacy tools are insufficient and AIOps streamlines DevOps and SRE teams’ tasks, shouldn’t adopting AIOps tools be a no-brainer?

The missing link is typically trust. Can highly trained IT pros trust AIOps to monitor their dynamic, interconnected systems?

And can this technology offer accurate and effective mitigation solutions?

The reason for worry is understandable — if automated systems falter, human operators bear the burden.

But the reality is: the disparate data sources, vast amounts of information and incidents that arise from such large datasets are beyond what a human mind can reasonably handle. Modern systems require modern automated solutions.

Let’s explore how IT leaders can build trust in AIOps tools and eliminate toil from their teams in the meantime.

Get to Know Your AIOps Tool

Effective, properly integrated AIOps tools can proactively look for problems, determine the root cause of the incident and fix the potentially service-impacting issue. The result is a reduction of manual toil for DevOps and SRE teams. But these teams shouldn’t worry about job security: humanless automation is far from a reality. After all, the remediation strategy can be worse than the incident, and untangling that issue requires human rationalization. The overall goal should be rapid root cause analysis and accurate remediation strategies with human authorization (and automation when and if it makes sense). As the “paradox of automation” says, "the more efficient the automated system, the more crucial the human contribution of the operators."

As evidenced by GigaOm’s Radar for AIOps Solutionsreport, AIOps tools vary in their approaches to observability, integrations and self-healing functions. Even vendors’ use of the term “AI” differs. While some AI-driven solutions provide automated neural capabilities, other allegedly AI-based systems merely operate on rules-based heuristics and rely heavily on human IT teams.

If teams don’t know what they’re getting with an AIOps tool, they likely question if they can trust the technology at all. The short answer is: not necessarily.

AIOps tools based on rules and models can only handle a pre-established set of rules programmed into the IT infrastructure. This rigidity leads to an obvious problem. Our modern systems constantly change, and when those changes occur, teams need to alter the programmed rules too. Root cause analysis also becomes harder to identify and rectify automatically, putting the onus back on the human operators and garnering little value from the automation.

Unlike rule- and model-driven AIOps solutions, evidence-driven tools are better suited to keep pace with ephemeral modern systems. Instead of relying on fixed rules and models, evidence-based solutions respond to what the system is actually experiencing. This approach is far more beneficial to DevOps and SRE teams in finding the root causes and deploying self-healing. For example, empirical tests have shown that advanced natural language processing can provide more accurate and scalable results than rules, with substantially less maintenance overhead.

Build Trust in Your AIOps Tool

Just as humans need to build trust with each other, IT teams need to build trust with their AIOps tool. Trust-building in AIOps should be the same as it is in humans — with an incremental “truth and proof” approach that allows people to evaluate data and experience results before moving on.

IT teams should start by deploying an AIOps tool and connecting it to application and service data sources. With native or third-party tool integration capabilities, the AIOps tool should connect to the DevOps toolchain or CI/CD pipeline to automate workflows and the bidirectional transfer of data and notifications. Once the tool is implemented, teams should observe the initial root cause analysis and outputs to determine the solution’s success or failure.

Did the tool surface useful information and provide context to the data?

Will this solution move teams closer to improved service assurance?

While AIOps tools can streamline the tasks facing DevOps and SRE teams, it doesn’t completely replace human operators. Human reasoning is still at the core of sound operations. But AIOps tools can eliminate human toil, giving IT teams time to do what they do best: innovate new technologies.

As the AIOps tool racks up more wins, teams will realize the tool’s value and trust will naturally follow. Then, DevOps teams can take the solution beyond incident remediation and into Value Stream Management (VSM) that governs businesses’ value streams from the inception of an idea to the ultimate outcome — the customer experience. AIOps enables proactive solutions that reduce mundane, time-consuming work for internal teams and provide next-level customer experiences.

DevOps and SRE teams can start their AIOps journey with trust-building, getting hands-on experience with the tool and judging how much value it generates for internal and external audiences. With an incremental approach to deployment and testing, a trusted AIOps tool can eliminate significant human toil and unlock time to keep up with unceasing digital transformation.

Richard Whitehead is Chief Evangelist at Moogsoft
Share this

The Latest

January 18, 2022

As part of APMdigest's list of 2022 predictions, industry experts offer thoughtful, insightful, and often controversial predictions on how Network Performance Management (NPM) and related technologies will evolve and impact business in 2022 ...

January 13, 2022

Gartner highlighted 6 trends that infrastructure and operations (I&O) leaders must start preparing for in the next 12-18 months ...

January 11, 2022

Technology is now foundational to financial companies' operations with many institutions relying on tech to deliver critical services. As a result, uptime is essential to customer satisfaction and company success, and systems must be subject to continuous monitoring. But modern IT architectures are disparate, complex and interconnected, and the data is too voluminous for the human mind to handle. Enter AIOps ...

January 11, 2022

Having a variety of tools to choose from creates challenges in telemetry data collection. Organizations find themselves managing multiple libraries for logging, metrics, and traces, with each vendor having its own APIs, SDKs, agents, and collectors. An open source, community-driven approach to observability will gain steam in 2022 to remove unnecessary complications by tapping into the latest advancements in observability practice ...

January 10, 2022

These are the trends that will set up your engineers and developers to deliver amazing software that powers amazing digital experiences that fuel your organization's growth in 2022 — and beyond ...

January 06, 2022

In a world where digital services have become a critical part of how we go about our daily lives, the risk of undergoing an outage has become even more significant. Outages can range in severity and impact companies of every size — while outages from larger companies in the social media space or a cloud provider tend to receive a lot of coverage, application downtime from even the most targeted companies can disrupt users' personal and business operations ...

January 05, 2022

Move fast and break things: A phrase that has been a rallying cry for many SREs and DevOps practitioners. After all, these teams are charged with delivering rapid and unceasing innovation to wow customers and keep pace with competitors. But today's society doesn't tolerate broken things (aka downtime). So, what if you can move fast and not break things? Or at least, move fast and rapidly identify or even predict broken things? It's high time to rethink the old rallying cry, and with AI and observability working in tandem, it's possible ...

January 04, 2022

AIOps is still relatively new compared to existing technologies such as enterprise data warehouses, and early on many AIOps projects suffered hiccups, the aftereffects of which are still felt today. That's why, for some IT Ops teams and leaders, the prospect of transforming their IT operations using AIOps is a cause for concern ...

December 16, 2021

This year is the first time APMdigest is posting a separate list of Remote Work Predictions. Due to the drastic changes in the way we work and do business since the COVID pandemic started, and how significantly these changes have impacted IT operations, APMdigest asked industry experts — from analysts and consultants to users and the top vendors — how they think the work from home (WFH) revolution will evolve into 2022, with a special focus on IT operations and performance. Here are some very interesting and insightful predictions that may change what you think about the future of work and IT ...

December 15, 2021

Industry experts offer thoughtful, insightful, and often controversial predictions on how APM, AIOps, Observability, OpenTelemetry, and related technologies will evolve and impact business in 2022. Part 6 covers the user experience ...