Skip to main content

Advanced IT Analytics, AIOps, Big Data - What's Really Going On?

Dennis Drogseth

This question is really two questions.

The first would be: What's really going on in terms of a confusion of terms? — as we wrestle with AIOps, IT Operational Analytics, big data, AI bots, machine learning, and more generically stated "AI platforms" (… and the list is far from complete).

The second might be phrased as: What's really going on in terms of real-world advanced IT analytics deployments — where are they succeeding, and where are they not?

This blog will look at both questions as a way of introducing EMA's newest research with data just coming in from North America and Europe (UK, Germany and France). Like this blog, our research will also examine both questions, with the weight on examining real-world deployments. We hope to have at least a few real answers for you by September, with fresh data and timely analysis.

A Term by Any Other Name …

I'm borrowing, admittedly, from Shakespeare, to suggest that buzzwords in tech often get in the way of understanding real value, even as they seek to clarify it. In the case of what EMA prefers to call "advanced IT analytics" the fugal use of AI, machine learning, and big data, among other terms, often confuses what's really afoot. The real value is almost always in the mixture of science and artistry with which the analytics are applied to various use cases, not a purely academic discussion about what heuristics lie underneath the hood.

But EMA believes there is nevertheless a commonality across all true AIA solutions.

Last summer, EMA embarked on research that strongly indicates that there are common benefits, requirements and challenge surrounding an investment in AIA. Some of the more dramatic benefits typically included values in unifying IT across silos, toolset consolidation, dramatic reductions in mean-time-to-repair and mean time between failures, as well as other use cases that typically ranged from performance and availability management, to change management and capacity optimization, to support for DevOps and SecOps, to optimizing migrations to public cloud. As such we view AIA as a potentially transformative arena for both IT and the business it serves.

In our current research, we will be asking some simple questions regarding terminology and attributes to test the waters, especially in the now prevalent area of AIOps. But we'll also be able to track deployments centering on big data, security-related analytics, capacity-specific analytics and end-user or customer experience analytics, to see what patterns emerge and how they actually differ.

How Do You Make it All Real?

What's currently afoot in operationalizing advanced analytics for IT?

This is the main focus for our research, and it will also help to inform on the first question — what people are actually doing when they champion AIOps, or big data, etc.

Some areas of focus include:

Use cases: Here we are expanding on capacity, security and end-user experience to include cross-domain application/infrastructure availability and performance, DevOps/agile, cost management (including hybrid and multi-cloud), change management, and IoT.

Leadership: Who's leading in investments in advanced IT analytics, and who's leading in overseeing and actually delivering on deployments? What are their objectives, and how are they going about it?

Best practices: Are there any consistent best practices that emerge from the usual laundry list when advanced analytics are being deployed and used? If so, what are they? And how effective are they?

Integrations: How much are investments in advanced analytics being used to assimilate and optimize other toolsets?

Automation: What are the current priorities for integrated automation, where AI and machine learning can help to intelligently and adaptively drive more automated outcomes?

AI bots: Along with general automation priorities, we are looking at AI bot strategies to see how they converge (or don't) with AIOps and other analytics investments.

Technology and data sources: What data sets are IT organizations most hungry for when it comes to advanced analytics? What heuristics do they feel are most critical now, and in the future? How is service modeling and dependency mapping playing in the advanced IT analytics arena?

Roadblocks and benefits: What are the major obstacles remaining in 2018 to effective advanced IT analytics deployments? And what are the more prevalent benefits achieved?

Summing Up

These are admittedly a lot of areas for examination, and once again, the list is not complete. Moreover, we plan to investigate the answers we receive for all these questions from various perspectives, including company size, vertical, geography, roles (what do IT executives think versus more hands-on stakeholders?), success rates and other factors.

Finally, we'll be looking for trends based on the research done in two prior reports: Advanced IT Analytics: A Look at Real-World Adoptions in the Real World March 2016, and The Many Faces of Advanced Operations Analytics September 2014.

What I'm hoping we'll see in September is continued growth toward a more mature, more business-aligned, and more IT-unifying approach to advanced analytics deployments, with a growing number of stakeholders and benefits. I'm also hoping for a more definitive set of AIA profiles, as operations analytics continues to redefine itself away from just "big data," and as the need for more evolved, holistic and dynamic multi-use-case AIA platforms becomes more pronounced.

But it's too soon to tell. The data is still coming in. Nevertheless, I should know soon. In a follow-up blog in the first-half of September I'll be able to present some real news.

Hot Topics

The Latest

Every digital customer interaction, every cloud deployment, and every AI model depends on the same foundation: the ability to see, understand, and act on data in real time ... Recent data from Splunk confirms that 74% of the business leaders believe observability is essential to monitoring critical business processes, and 66% feel it's key to understanding user journeys. Because while the unknown is inevitable, observability makes it manageable. Let's explore why ...

Organizations that perform regular audits and assessments of AI system performance and compliance are over three times more likely to achieve high GenAI value than organizations that do not, according to a survey by Gartner ...

Kubernetes has become the backbone of cloud infrastructure, but it's also one of its biggest cost drivers. Recent research shows that 98% of senior IT leaders say Kubernetes now drives cloud spend, yet 91% still can't optimize it effectively. After years of adoption, most organizations have moved past discovery. They know container sprawl, idle resources and reactive scaling inflate costs. What they don't know is how to fix it ...

Artificial intelligence is no longer a future investment. It's already embedded in how we work — whether through copilots in productivity apps, real-time transcription tools in meetings, or machine learning models fueling analytics and personalization. But while enterprise adoption accelerates, there's one critical area many leaders have yet to examine: Can your network actually support AI at the speed your users expect? ...

The more technology businesses invest in, the more potential attack surfaces they have that can be exploited. Without the right continuity plans in place, the disruptions caused by these attacks can bring operations to a standstill and cause irreparable damage to an organization. It's essential to take the time now to ensure your business has the right tools, processes, and recovery initiatives in place to weather any type of IT disaster that comes up. Here are some effective strategies you can follow to achieve this ...

In today's fast-paced AI landscape, CIOs, IT leaders, and engineers are constantly challenged to manage increasingly complex and interconnected systems. The sheer scale and velocity of data generated by modern infrastructure can be overwhelming, making it difficult to maintain uptime, prevent outages, and create a seamless customer experience. This complexity is magnified by the industry's shift towards agentic AI ...

In MEAN TIME TO INSIGHT Episode 19, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA explains the cause of the AWS outage in October ... 

The explosion of generative AI and machine learning capabilities has fundamentally changed the conversation around cloud migration. It's no longer just about modernization or cost savings — it's about being able to compete in a market where AI is rapidly becoming table stakes. Companies that can't quickly spin up AI workloads, feed models with data at scale, or experiment with new capabilities are falling behind faster than ever before. But here's what I'm seeing: many organizations want to capitalize on AI, but they're stuck ...

On September 16, the world celebrated the 10th annual IT Pro Day, giving companies a chance to laud the professionals who serve as the backbone to almost every successful business across the globe. Despite the growing importance of their roles, many IT pros still work in the background and often go underappreciated ...

Artificial Intelligence (AI) is reshaping observability, and observability is becoming essential for AI. This is a two-way relationship that is increasingly relevant as enterprises scale generative AI ... This dual role makes AI and observability inseparable. In this blog, I cover more details of each side ...

Advanced IT Analytics, AIOps, Big Data - What's Really Going On?

Dennis Drogseth

This question is really two questions.

The first would be: What's really going on in terms of a confusion of terms? — as we wrestle with AIOps, IT Operational Analytics, big data, AI bots, machine learning, and more generically stated "AI platforms" (… and the list is far from complete).

The second might be phrased as: What's really going on in terms of real-world advanced IT analytics deployments — where are they succeeding, and where are they not?

This blog will look at both questions as a way of introducing EMA's newest research with data just coming in from North America and Europe (UK, Germany and France). Like this blog, our research will also examine both questions, with the weight on examining real-world deployments. We hope to have at least a few real answers for you by September, with fresh data and timely analysis.

A Term by Any Other Name …

I'm borrowing, admittedly, from Shakespeare, to suggest that buzzwords in tech often get in the way of understanding real value, even as they seek to clarify it. In the case of what EMA prefers to call "advanced IT analytics" the fugal use of AI, machine learning, and big data, among other terms, often confuses what's really afoot. The real value is almost always in the mixture of science and artistry with which the analytics are applied to various use cases, not a purely academic discussion about what heuristics lie underneath the hood.

But EMA believes there is nevertheless a commonality across all true AIA solutions.

Last summer, EMA embarked on research that strongly indicates that there are common benefits, requirements and challenge surrounding an investment in AIA. Some of the more dramatic benefits typically included values in unifying IT across silos, toolset consolidation, dramatic reductions in mean-time-to-repair and mean time between failures, as well as other use cases that typically ranged from performance and availability management, to change management and capacity optimization, to support for DevOps and SecOps, to optimizing migrations to public cloud. As such we view AIA as a potentially transformative arena for both IT and the business it serves.

In our current research, we will be asking some simple questions regarding terminology and attributes to test the waters, especially in the now prevalent area of AIOps. But we'll also be able to track deployments centering on big data, security-related analytics, capacity-specific analytics and end-user or customer experience analytics, to see what patterns emerge and how they actually differ.

How Do You Make it All Real?

What's currently afoot in operationalizing advanced analytics for IT?

This is the main focus for our research, and it will also help to inform on the first question — what people are actually doing when they champion AIOps, or big data, etc.

Some areas of focus include:

Use cases: Here we are expanding on capacity, security and end-user experience to include cross-domain application/infrastructure availability and performance, DevOps/agile, cost management (including hybrid and multi-cloud), change management, and IoT.

Leadership: Who's leading in investments in advanced IT analytics, and who's leading in overseeing and actually delivering on deployments? What are their objectives, and how are they going about it?

Best practices: Are there any consistent best practices that emerge from the usual laundry list when advanced analytics are being deployed and used? If so, what are they? And how effective are they?

Integrations: How much are investments in advanced analytics being used to assimilate and optimize other toolsets?

Automation: What are the current priorities for integrated automation, where AI and machine learning can help to intelligently and adaptively drive more automated outcomes?

AI bots: Along with general automation priorities, we are looking at AI bot strategies to see how they converge (or don't) with AIOps and other analytics investments.

Technology and data sources: What data sets are IT organizations most hungry for when it comes to advanced analytics? What heuristics do they feel are most critical now, and in the future? How is service modeling and dependency mapping playing in the advanced IT analytics arena?

Roadblocks and benefits: What are the major obstacles remaining in 2018 to effective advanced IT analytics deployments? And what are the more prevalent benefits achieved?

Summing Up

These are admittedly a lot of areas for examination, and once again, the list is not complete. Moreover, we plan to investigate the answers we receive for all these questions from various perspectives, including company size, vertical, geography, roles (what do IT executives think versus more hands-on stakeholders?), success rates and other factors.

Finally, we'll be looking for trends based on the research done in two prior reports: Advanced IT Analytics: A Look at Real-World Adoptions in the Real World March 2016, and The Many Faces of Advanced Operations Analytics September 2014.

What I'm hoping we'll see in September is continued growth toward a more mature, more business-aligned, and more IT-unifying approach to advanced analytics deployments, with a growing number of stakeholders and benefits. I'm also hoping for a more definitive set of AIA profiles, as operations analytics continues to redefine itself away from just "big data," and as the need for more evolved, holistic and dynamic multi-use-case AIA platforms becomes more pronounced.

But it's too soon to tell. The data is still coming in. Nevertheless, I should know soon. In a follow-up blog in the first-half of September I'll be able to present some real news.

Hot Topics

The Latest

Every digital customer interaction, every cloud deployment, and every AI model depends on the same foundation: the ability to see, understand, and act on data in real time ... Recent data from Splunk confirms that 74% of the business leaders believe observability is essential to monitoring critical business processes, and 66% feel it's key to understanding user journeys. Because while the unknown is inevitable, observability makes it manageable. Let's explore why ...

Organizations that perform regular audits and assessments of AI system performance and compliance are over three times more likely to achieve high GenAI value than organizations that do not, according to a survey by Gartner ...

Kubernetes has become the backbone of cloud infrastructure, but it's also one of its biggest cost drivers. Recent research shows that 98% of senior IT leaders say Kubernetes now drives cloud spend, yet 91% still can't optimize it effectively. After years of adoption, most organizations have moved past discovery. They know container sprawl, idle resources and reactive scaling inflate costs. What they don't know is how to fix it ...

Artificial intelligence is no longer a future investment. It's already embedded in how we work — whether through copilots in productivity apps, real-time transcription tools in meetings, or machine learning models fueling analytics and personalization. But while enterprise adoption accelerates, there's one critical area many leaders have yet to examine: Can your network actually support AI at the speed your users expect? ...

The more technology businesses invest in, the more potential attack surfaces they have that can be exploited. Without the right continuity plans in place, the disruptions caused by these attacks can bring operations to a standstill and cause irreparable damage to an organization. It's essential to take the time now to ensure your business has the right tools, processes, and recovery initiatives in place to weather any type of IT disaster that comes up. Here are some effective strategies you can follow to achieve this ...

In today's fast-paced AI landscape, CIOs, IT leaders, and engineers are constantly challenged to manage increasingly complex and interconnected systems. The sheer scale and velocity of data generated by modern infrastructure can be overwhelming, making it difficult to maintain uptime, prevent outages, and create a seamless customer experience. This complexity is magnified by the industry's shift towards agentic AI ...

In MEAN TIME TO INSIGHT Episode 19, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA explains the cause of the AWS outage in October ... 

The explosion of generative AI and machine learning capabilities has fundamentally changed the conversation around cloud migration. It's no longer just about modernization or cost savings — it's about being able to compete in a market where AI is rapidly becoming table stakes. Companies that can't quickly spin up AI workloads, feed models with data at scale, or experiment with new capabilities are falling behind faster than ever before. But here's what I'm seeing: many organizations want to capitalize on AI, but they're stuck ...

On September 16, the world celebrated the 10th annual IT Pro Day, giving companies a chance to laud the professionals who serve as the backbone to almost every successful business across the globe. Despite the growing importance of their roles, many IT pros still work in the background and often go underappreciated ...

Artificial Intelligence (AI) is reshaping observability, and observability is becoming essential for AI. This is a two-way relationship that is increasingly relevant as enterprises scale generative AI ... This dual role makes AI and observability inseparable. In this blog, I cover more details of each side ...