Skip to main content

Discovering AIOps - Part 10: Expert Tips

Pete Goldin
Editor and Publisher
APMdigest

In Part 10, the final installment of this blog series, the experts offer tips on how to get started and how to succeed using AIOps:

Start with: Discovering AIOps - Part 1

Start with: Discovering AIOps - Part 2: Must-Have Capabilities

Start with: Discovering AIOps - Part 3: The Users

Start with: Discovering AIOps - Part 4: Advantages

Start with: Discovering AIOps - Part 5: More Advantages

Start with: Discovering AIOps - Part 6: Challenges

Start with: Discovering AIOps - Part 7: The Current State of AIOps

Start with: Discovering AIOps - Part 8: The Future of AIOps

Start with: Discovering AIOps - Part 9: Auto-Remediation

Define Your Needs and Goals

"Before investing, you should define your needs and priorities both within and across silos. This ideally requires a team with executive support, as your AIOps investment will have process as well as technology implications. EMA recommends dialog to document requirements and priorities across different stakeholders, including cost and deployment concerns. Once you've assimilated these inputs and reconciled them, you are ready to begin shopping," advises Dennis Drogseth, VP at Enterprise Management Associates (EMA).

Charles Burnham, Director, AIOps Engineering at LogicMonitor says, "My biggest piece of advice for getting started with AIOps is for each company to focus on the individual problems they're trying to solve with these tools — i.e what they are trying to automate. Are they dealing with consistent outages and don't know why? Are they funneling through a lot of noise and it's taking them far too long to track down the root cause? They need to be purposeful about the issues at hand and the tech they're looking at in order to remediate these problems because AIOps capabilities are designed to automate and improve very specific aspects of the IT Operations process."

"Hunt down the platforms that offer the level and type of AI that is best suited to your organization's needs; it's that simple. Don't get caught up in some advanced bells and whistles that won't move the needle for your team today. Map the capabilities that you need directly to the pain points of your teams and existing environments," Asaf Yigal, CTO of Logz.io, recommends.

"Like anything else, it's about ensuring that you have the right platform to address your specific environment, use cases, skills, and budget. Buying something fancy that no one can truly wrap their heads around or benefit from is not going to bring you much value," Yigal adds.

Prepare for a Cultural Shift

"Prepare your teams for the cultural shift that AIOps might bring. Encourage openness to new processes and technologies and address any concerns proactively," Monika Bhave, Product Manager at Digitate.

Investigate the Vendors

"IT leaders should be interrogating their incumbent vendors about their AIOps roadmaps. At least 50% of them will have a good answer. They should read and study this subject. Learn terminology and concepts enough to understand what's real and what's marketing hype," says Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at Enterprise Management Associates (EMA).

"Also, when vendors start talking about their AIOPs goodness, ask for a proof-of-concept deployment. Make them prove themselves in your environment," he adds.

"The user must ask their AIOps provider questions about how their platform operates and differentiates from other providers," advises Thomas LaRock, Principal Developer Evangelist at Selector. "If they can't offer more details than using buzzwords, chances are they aren't as robust a platform as you want or need. If they say, 'We use AI and ML,' then you want to press them and ask about specific models and techniques. You will be surprised as to how many vendors promising AIOps are offering nothing more than rules-based recommendations, the equivalence of an IF THEN ELSE statement."

"Beware of any vendor who promises you nirvana through the use of their platform," LaRock continues "Every company is different and has different needs. An AIOps platform that worked well for a colleague at a different company may not be the right choice for your company at this point in time."

Bhave from Digitate recommends that you should evaluate different solutions based on their features, scalability, extensibility, maintainability, ease of integration, and end-to-end play.

Start with the Data

"We think that taking the approach of using AI to inform the type and volume of data that you are sending to the platform, and subsequently paying for, is a great example of a sensible starting point. This way you are already making life easier by reducing complexity and cost through AI-backed data optimization. This allows you to start from a place that is already better informed and simpler, based on the ability to reduce the data the system is now being asked to analyze," says Yigal from Logz.io.

Bhave from Digitate says to make sure that your data is accurate, consistent, and comprehensive. Cross stack data availability is needed for useful insights.

Encompass the Entire Data Processing Chain

"AIOps should encompass all four stages of data processing — Collect, Aggregate, Analyze and Execute — in a single platform approach. Only an approach that encompasses the entire data processing chain using causal AI and continuous automation can keep pace with the volume, velocity, and complexity of distributed microservices architectures," says Bob Wambach, VP of Product Marketing at Dynatrace.

Establish KPIs

"Define Key Performance Indicators (KPIs): Establish clear KPIs to measure the success of your AI Ops implementation. This could include metrics like MTTR reduction, alert noise reduction, and increased availability," says Monika Bhave from Digitate.

Baseline Key Metrics

"Baseline key business metrics early in the process. Correlation is not causation, but in a year of focused work, if your team has reduced downtime, increased availability, improved break/fix work for faster delivery of features and reduction of tech debt and CSAT/NPS has improved, that's a great place to point to how you are delivering value above and beyond MTTR," says Heath Newburn, Distinguished Field Engineer at PagerDuty.

Use Out of the box models

"The reality is that it has never been easier for an organization to get started with AIOps. The key is to have a focused approach to implementing an AIOps solution that leverages out-of-the-box machine learning models and begin where the impact is the greatest. With pre-trained machine learning models, there is no downtime while you wait for your solution to absorb data and learn. AIOps can begin making recommendations and resolving issues right off the jump, accelerating time to value for organizations. And finally, taking that intelligence and automating resolutions without having to build yet more customization and integrations," Brian Emerson, VP & GM, IT Operations Management at ServiceNow

Focus on Productivity

"Let machines do what machines are good at and people do what people are good at. Design your system not for the smartest/most experienced people on your team, but for your newest members. How can AIOps become the context engine to make them more effective quickly? Focus on removing noise, creating context and removing toil," says Newburn from PagerDuty.

Start Small

"As for getting started, it's just a matter of making the decision to move forward and taking the first step. Focus on a small subset of the environment that might be easily isolated in terms of discovery and management. This lets everyone get a good grasp of what's possible before going across the enterprise and exposing all the information to everyone in operations," Carlos Casanova, Principal Analyst at Forrester Research, advises.

Begin with a pilot project or a specific use case to test and validate AI Ops capabilities, Bhave from Digitate advises. This allows you to gain insights, gather feedback, and demonstrate value before scaling up.

"Pick something in your environment, perhaps network monitoring, and run a POC with some AIOps tools to see how they compare and contrast. As you expand your AIOps footprint, you'll have the experience necessary to ask more informed questions of an AIOps provider, essentially building towards an AIOps platform that is right for your enterprise," says Thomas LaRock, Principal Developer Evangelist at Selector.

Bhave from Digitate also recommends gradual implementation. Roll out AIOps gradually, considering the impact on existing processes and workflows. Aim for a smooth transition to minimize disruption.

Integrate with Every Layer of Your Stack

"AIOps is increasingly effective with additional data — plan to integrate your AIOps product with every layer of your stack, make sure it supports future platform investments, and consolidate events from across your enterprise's various tools so that insights are not limited to only part of your organization," Michael Gerstenhaber, VP of Product Management at Datadog.

Link ITSM and ITOM

Another best practice is to ensure your organization is using a solution that natively integrates AIOps within IT Operations, as well as ensuring that both IT Service Management and IT Operations Management are unified on a single platform, according to Emerson from ServiceNow.

The convergence of ITSM and ITOM is quickly becoming a necessity for modern organizations to ensure they are meeting the delivery and agility demands of our new world of work. By linking ITSM and ITOM on a single platform, both solutions can leverage shared data, allowing teams to resolve incidents faster, predict them before they occur, and ensure great IT experiences for all their users.

Emerson says this also sets up a key foundation for AIOps, which is only successful if it has access to historical incidents and change data. Both ITSM and ITOM help gather and process this data, so by linking the two and having everything on one unified platform, it ensures that AIOps will have consistent and easy access to the data it needs to succeed.

Foster Cross-Functional Collaboration

"Foster collaboration between IT and business stakeholders. AIOps implementation should be a cross-functional effort to ensure alignment with business goals," says Bhave from Digitate.

Invest in Training

Bhave from Digitate also recommends training and skill development. Invest in training your IT teams on the AIOps platform. Developing in-house expertise is crucial for successful implementation and ongoing management.

Get Feedback

"AIOps is an ongoing journey. Regularly assess its performance, gather feedback, and iterate on your implementation to optimize results. The AIOps platform gets better with SME feedback," says Bhave from Digitate.

Keep Stakeholders Informed

"Keep stakeholders informed about progress, milestones, and results. Transparency builds trust and support for your AI Ops initiative," Bhave concludes.

Pete Goldin is Editor and Publisher of APMdigest

Hot Topics

The Latest

Significant improvements in operational resilience, more effective use of automation and faster time to market are driving optimism about IT spending in 2025, with a majority of leaders expecting their budgets to increase year-over-year, according to the 2025 State of Digital Operations Report from PagerDuty ...

Image
PagerDuty

Are they simply number crunchers confined to back-office support, or are they the strategic influencers shaping the future of your enterprise? The reality is that data analysts are far more the latter. In fact, 94% of analysts agree their role is pivotal to making high-level business decisions, proving that they are becoming indispensable partners in shaping strategy ...

Today's enterprises exist in rapidly growing, complex IT landscapes that can inadvertently create silos and lead to the accumulation of disparate tools. To successfully manage such growth, these organizations must realize the requisite shift in corporate culture and workflow management needed to build trust in new technologies. This is particularly true in cases where enterprises are turning to automation and autonomic IT to offload the burden from IT professionals. This interplay between technology and culture is crucial in guiding teams using AIOps and observability solutions to proactively manage operations and transition toward a machine-driven IT ecosystem ...

Gartner identified the top data and analytics (D&A) trends for 2025 that are driving the emergence of a wide range of challenges, including organizational and human issues ...

Traditional network monitoring, while valuable, often falls short in providing the context needed to truly understand network behavior. This is where observability shines. In this blog, we'll compare and contrast traditional network monitoring and observability — highlighting the benefits of this evolving approach ...

A recent Rocket Software and Foundry study found that just 28% of organizations fully leverage their mainframe data, a concerning statistic given its critical role in powering AI models, predictive analytics, and informed decision-making ...

What kind of ROI is your organization seeing on its technology investments? If your answer is "it's complicated," you're not alone. According to a recent study conducted by Apptio ... there is a disconnect between enterprise technology spending and organizations' ability to measure the results ...

In today’s data and AI driven world, enterprises across industries are utilizing AI to invent new business models, reimagine business and achieve efficiency in operations. However, enterprises may face challenges like flawed or biased AI decisions, sensitive data breaches and rising regulatory risks ...

In MEAN TIME TO INSIGHT Episode 12, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses purchasing new network observability solutions.... 

There's an image problem with mobile app security. While it's critical for highly regulated industries like financial services, it is often overlooked in others. This usually comes down to development priorities, which typically fall into three categories: user experience, app performance, and app security. When dealing with finite resources such as time, shifting priorities, and team skill sets, engineering teams often have to prioritize one over the others. Usually, security is the odd man out ...

Image
Guardsquare

Discovering AIOps - Part 10: Expert Tips

Pete Goldin
Editor and Publisher
APMdigest

In Part 10, the final installment of this blog series, the experts offer tips on how to get started and how to succeed using AIOps:

Start with: Discovering AIOps - Part 1

Start with: Discovering AIOps - Part 2: Must-Have Capabilities

Start with: Discovering AIOps - Part 3: The Users

Start with: Discovering AIOps - Part 4: Advantages

Start with: Discovering AIOps - Part 5: More Advantages

Start with: Discovering AIOps - Part 6: Challenges

Start with: Discovering AIOps - Part 7: The Current State of AIOps

Start with: Discovering AIOps - Part 8: The Future of AIOps

Start with: Discovering AIOps - Part 9: Auto-Remediation

Define Your Needs and Goals

"Before investing, you should define your needs and priorities both within and across silos. This ideally requires a team with executive support, as your AIOps investment will have process as well as technology implications. EMA recommends dialog to document requirements and priorities across different stakeholders, including cost and deployment concerns. Once you've assimilated these inputs and reconciled them, you are ready to begin shopping," advises Dennis Drogseth, VP at Enterprise Management Associates (EMA).

Charles Burnham, Director, AIOps Engineering at LogicMonitor says, "My biggest piece of advice for getting started with AIOps is for each company to focus on the individual problems they're trying to solve with these tools — i.e what they are trying to automate. Are they dealing with consistent outages and don't know why? Are they funneling through a lot of noise and it's taking them far too long to track down the root cause? They need to be purposeful about the issues at hand and the tech they're looking at in order to remediate these problems because AIOps capabilities are designed to automate and improve very specific aspects of the IT Operations process."

"Hunt down the platforms that offer the level and type of AI that is best suited to your organization's needs; it's that simple. Don't get caught up in some advanced bells and whistles that won't move the needle for your team today. Map the capabilities that you need directly to the pain points of your teams and existing environments," Asaf Yigal, CTO of Logz.io, recommends.

"Like anything else, it's about ensuring that you have the right platform to address your specific environment, use cases, skills, and budget. Buying something fancy that no one can truly wrap their heads around or benefit from is not going to bring you much value," Yigal adds.

Prepare for a Cultural Shift

"Prepare your teams for the cultural shift that AIOps might bring. Encourage openness to new processes and technologies and address any concerns proactively," Monika Bhave, Product Manager at Digitate.

Investigate the Vendors

"IT leaders should be interrogating their incumbent vendors about their AIOps roadmaps. At least 50% of them will have a good answer. They should read and study this subject. Learn terminology and concepts enough to understand what's real and what's marketing hype," says Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at Enterprise Management Associates (EMA).

"Also, when vendors start talking about their AIOPs goodness, ask for a proof-of-concept deployment. Make them prove themselves in your environment," he adds.

"The user must ask their AIOps provider questions about how their platform operates and differentiates from other providers," advises Thomas LaRock, Principal Developer Evangelist at Selector. "If they can't offer more details than using buzzwords, chances are they aren't as robust a platform as you want or need. If they say, 'We use AI and ML,' then you want to press them and ask about specific models and techniques. You will be surprised as to how many vendors promising AIOps are offering nothing more than rules-based recommendations, the equivalence of an IF THEN ELSE statement."

"Beware of any vendor who promises you nirvana through the use of their platform," LaRock continues "Every company is different and has different needs. An AIOps platform that worked well for a colleague at a different company may not be the right choice for your company at this point in time."

Bhave from Digitate recommends that you should evaluate different solutions based on their features, scalability, extensibility, maintainability, ease of integration, and end-to-end play.

Start with the Data

"We think that taking the approach of using AI to inform the type and volume of data that you are sending to the platform, and subsequently paying for, is a great example of a sensible starting point. This way you are already making life easier by reducing complexity and cost through AI-backed data optimization. This allows you to start from a place that is already better informed and simpler, based on the ability to reduce the data the system is now being asked to analyze," says Yigal from Logz.io.

Bhave from Digitate says to make sure that your data is accurate, consistent, and comprehensive. Cross stack data availability is needed for useful insights.

Encompass the Entire Data Processing Chain

"AIOps should encompass all four stages of data processing — Collect, Aggregate, Analyze and Execute — in a single platform approach. Only an approach that encompasses the entire data processing chain using causal AI and continuous automation can keep pace with the volume, velocity, and complexity of distributed microservices architectures," says Bob Wambach, VP of Product Marketing at Dynatrace.

Establish KPIs

"Define Key Performance Indicators (KPIs): Establish clear KPIs to measure the success of your AI Ops implementation. This could include metrics like MTTR reduction, alert noise reduction, and increased availability," says Monika Bhave from Digitate.

Baseline Key Metrics

"Baseline key business metrics early in the process. Correlation is not causation, but in a year of focused work, if your team has reduced downtime, increased availability, improved break/fix work for faster delivery of features and reduction of tech debt and CSAT/NPS has improved, that's a great place to point to how you are delivering value above and beyond MTTR," says Heath Newburn, Distinguished Field Engineer at PagerDuty.

Use Out of the box models

"The reality is that it has never been easier for an organization to get started with AIOps. The key is to have a focused approach to implementing an AIOps solution that leverages out-of-the-box machine learning models and begin where the impact is the greatest. With pre-trained machine learning models, there is no downtime while you wait for your solution to absorb data and learn. AIOps can begin making recommendations and resolving issues right off the jump, accelerating time to value for organizations. And finally, taking that intelligence and automating resolutions without having to build yet more customization and integrations," Brian Emerson, VP & GM, IT Operations Management at ServiceNow

Focus on Productivity

"Let machines do what machines are good at and people do what people are good at. Design your system not for the smartest/most experienced people on your team, but for your newest members. How can AIOps become the context engine to make them more effective quickly? Focus on removing noise, creating context and removing toil," says Newburn from PagerDuty.

Start Small

"As for getting started, it's just a matter of making the decision to move forward and taking the first step. Focus on a small subset of the environment that might be easily isolated in terms of discovery and management. This lets everyone get a good grasp of what's possible before going across the enterprise and exposing all the information to everyone in operations," Carlos Casanova, Principal Analyst at Forrester Research, advises.

Begin with a pilot project or a specific use case to test and validate AI Ops capabilities, Bhave from Digitate advises. This allows you to gain insights, gather feedback, and demonstrate value before scaling up.

"Pick something in your environment, perhaps network monitoring, and run a POC with some AIOps tools to see how they compare and contrast. As you expand your AIOps footprint, you'll have the experience necessary to ask more informed questions of an AIOps provider, essentially building towards an AIOps platform that is right for your enterprise," says Thomas LaRock, Principal Developer Evangelist at Selector.

Bhave from Digitate also recommends gradual implementation. Roll out AIOps gradually, considering the impact on existing processes and workflows. Aim for a smooth transition to minimize disruption.

Integrate with Every Layer of Your Stack

"AIOps is increasingly effective with additional data — plan to integrate your AIOps product with every layer of your stack, make sure it supports future platform investments, and consolidate events from across your enterprise's various tools so that insights are not limited to only part of your organization," Michael Gerstenhaber, VP of Product Management at Datadog.

Link ITSM and ITOM

Another best practice is to ensure your organization is using a solution that natively integrates AIOps within IT Operations, as well as ensuring that both IT Service Management and IT Operations Management are unified on a single platform, according to Emerson from ServiceNow.

The convergence of ITSM and ITOM is quickly becoming a necessity for modern organizations to ensure they are meeting the delivery and agility demands of our new world of work. By linking ITSM and ITOM on a single platform, both solutions can leverage shared data, allowing teams to resolve incidents faster, predict them before they occur, and ensure great IT experiences for all their users.

Emerson says this also sets up a key foundation for AIOps, which is only successful if it has access to historical incidents and change data. Both ITSM and ITOM help gather and process this data, so by linking the two and having everything on one unified platform, it ensures that AIOps will have consistent and easy access to the data it needs to succeed.

Foster Cross-Functional Collaboration

"Foster collaboration between IT and business stakeholders. AIOps implementation should be a cross-functional effort to ensure alignment with business goals," says Bhave from Digitate.

Invest in Training

Bhave from Digitate also recommends training and skill development. Invest in training your IT teams on the AIOps platform. Developing in-house expertise is crucial for successful implementation and ongoing management.

Get Feedback

"AIOps is an ongoing journey. Regularly assess its performance, gather feedback, and iterate on your implementation to optimize results. The AIOps platform gets better with SME feedback," says Bhave from Digitate.

Keep Stakeholders Informed

"Keep stakeholders informed about progress, milestones, and results. Transparency builds trust and support for your AI Ops initiative," Bhave concludes.

Pete Goldin is Editor and Publisher of APMdigest

Hot Topics

The Latest

Significant improvements in operational resilience, more effective use of automation and faster time to market are driving optimism about IT spending in 2025, with a majority of leaders expecting their budgets to increase year-over-year, according to the 2025 State of Digital Operations Report from PagerDuty ...

Image
PagerDuty

Are they simply number crunchers confined to back-office support, or are they the strategic influencers shaping the future of your enterprise? The reality is that data analysts are far more the latter. In fact, 94% of analysts agree their role is pivotal to making high-level business decisions, proving that they are becoming indispensable partners in shaping strategy ...

Today's enterprises exist in rapidly growing, complex IT landscapes that can inadvertently create silos and lead to the accumulation of disparate tools. To successfully manage such growth, these organizations must realize the requisite shift in corporate culture and workflow management needed to build trust in new technologies. This is particularly true in cases where enterprises are turning to automation and autonomic IT to offload the burden from IT professionals. This interplay between technology and culture is crucial in guiding teams using AIOps and observability solutions to proactively manage operations and transition toward a machine-driven IT ecosystem ...

Gartner identified the top data and analytics (D&A) trends for 2025 that are driving the emergence of a wide range of challenges, including organizational and human issues ...

Traditional network monitoring, while valuable, often falls short in providing the context needed to truly understand network behavior. This is where observability shines. In this blog, we'll compare and contrast traditional network monitoring and observability — highlighting the benefits of this evolving approach ...

A recent Rocket Software and Foundry study found that just 28% of organizations fully leverage their mainframe data, a concerning statistic given its critical role in powering AI models, predictive analytics, and informed decision-making ...

What kind of ROI is your organization seeing on its technology investments? If your answer is "it's complicated," you're not alone. According to a recent study conducted by Apptio ... there is a disconnect between enterprise technology spending and organizations' ability to measure the results ...

In today’s data and AI driven world, enterprises across industries are utilizing AI to invent new business models, reimagine business and achieve efficiency in operations. However, enterprises may face challenges like flawed or biased AI decisions, sensitive data breaches and rising regulatory risks ...

In MEAN TIME TO INSIGHT Episode 12, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses purchasing new network observability solutions.... 

There's an image problem with mobile app security. While it's critical for highly regulated industries like financial services, it is often overlooked in others. This usually comes down to development priorities, which typically fall into three categories: user experience, app performance, and app security. When dealing with finite resources such as time, shifting priorities, and team skill sets, engineering teams often have to prioritize one over the others. Usually, security is the odd man out ...

Image
Guardsquare