Skip to main content

Advanced IT Analytics, AIOps, Big Data - What's Really Going On?

Dennis Drogseth

This question is really two questions.

The first would be: What's really going on in terms of a confusion of terms? — as we wrestle with AIOps, IT Operational Analytics, big data, AI bots, machine learning, and more generically stated "AI platforms" (… and the list is far from complete).

The second might be phrased as: What's really going on in terms of real-world advanced IT analytics deployments — where are they succeeding, and where are they not?

This blog will look at both questions as a way of introducing EMA's newest research with data just coming in from North America and Europe (UK, Germany and France). Like this blog, our research will also examine both questions, with the weight on examining real-world deployments. We hope to have at least a few real answers for you by September, with fresh data and timely analysis.

A Term by Any Other Name …

I'm borrowing, admittedly, from Shakespeare, to suggest that buzzwords in tech often get in the way of understanding real value, even as they seek to clarify it. In the case of what EMA prefers to call "advanced IT analytics" the fugal use of AI, machine learning, and big data, among other terms, often confuses what's really afoot. The real value is almost always in the mixture of science and artistry with which the analytics are applied to various use cases, not a purely academic discussion about what heuristics lie underneath the hood.

But EMA believes there is nevertheless a commonality across all true AIA solutions.

Last summer, EMA embarked on research that strongly indicates that there are common benefits, requirements and challenge surrounding an investment in AIA. Some of the more dramatic benefits typically included values in unifying IT across silos, toolset consolidation, dramatic reductions in mean-time-to-repair and mean time between failures, as well as other use cases that typically ranged from performance and availability management, to change management and capacity optimization, to support for DevOps and SecOps, to optimizing migrations to public cloud. As such we view AIA as a potentially transformative arena for both IT and the business it serves.

In our current research, we will be asking some simple questions regarding terminology and attributes to test the waters, especially in the now prevalent area of AIOps. But we'll also be able to track deployments centering on big data, security-related analytics, capacity-specific analytics and end-user or customer experience analytics, to see what patterns emerge and how they actually differ.

How Do You Make it All Real?

What's currently afoot in operationalizing advanced analytics for IT?

This is the main focus for our research, and it will also help to inform on the first question — what people are actually doing when they champion AIOps, or big data, etc.

Some areas of focus include:

Use cases: Here we are expanding on capacity, security and end-user experience to include cross-domain application/infrastructure availability and performance, DevOps/agile, cost management (including hybrid and multi-cloud), change management, and IoT.

Leadership: Who's leading in investments in advanced IT analytics, and who's leading in overseeing and actually delivering on deployments? What are their objectives, and how are they going about it?

Best practices: Are there any consistent best practices that emerge from the usual laundry list when advanced analytics are being deployed and used? If so, what are they? And how effective are they?

Integrations: How much are investments in advanced analytics being used to assimilate and optimize other toolsets?

Automation: What are the current priorities for integrated automation, where AI and machine learning can help to intelligently and adaptively drive more automated outcomes?

AI bots: Along with general automation priorities, we are looking at AI bot strategies to see how they converge (or don't) with AIOps and other analytics investments.

Technology and data sources: What data sets are IT organizations most hungry for when it comes to advanced analytics? What heuristics do they feel are most critical now, and in the future? How is service modeling and dependency mapping playing in the advanced IT analytics arena?

Roadblocks and benefits: What are the major obstacles remaining in 2018 to effective advanced IT analytics deployments? And what are the more prevalent benefits achieved?

Summing Up

These are admittedly a lot of areas for examination, and once again, the list is not complete. Moreover, we plan to investigate the answers we receive for all these questions from various perspectives, including company size, vertical, geography, roles (what do IT executives think versus more hands-on stakeholders?), success rates and other factors.

Finally, we'll be looking for trends based on the research done in two prior reports: Advanced IT Analytics: A Look at Real-World Adoptions in the Real World March 2016, and The Many Faces of Advanced Operations Analytics September 2014.

What I'm hoping we'll see in September is continued growth toward a more mature, more business-aligned, and more IT-unifying approach to advanced analytics deployments, with a growing number of stakeholders and benefits. I'm also hoping for a more definitive set of AIA profiles, as operations analytics continues to redefine itself away from just "big data," and as the need for more evolved, holistic and dynamic multi-use-case AIA platforms becomes more pronounced.

But it's too soon to tell. The data is still coming in. Nevertheless, I should know soon. In a follow-up blog in the first-half of September I'll be able to present some real news.

Hot Topics

The Latest

Today's modern systems are not what they once were. Organizations now rely on distributed systems, event-driven workflows, hybrid and multi-cloud environments and continuous delivery pipelines. While each adds flexibility, it also introduces new, often invisible failures. Development speed is no longer the primary bottleneck of innovation. Reliability is ...

Seeing is believing, or in this case, seeing is understanding, according to New Relic's 2025 Observability Forecast for Retail and eCommerce report. Retailers who want to provide exceptional customer experiences while improving IT operations efficiency are leaning on observability ... Here are five key takeaways from the report ...

Technology leaders across the federal landscape are facing, and will continue to face, an uphill battle when it comes to fortifying their digital environments against hostile and persistent threat actors. On one hand, they are being asked to push digital transformation ... On the other hand, they are facing the fiscal uncertainty of continuing resolutions (CR) and government shutdowns looming near and far. In the face of these challenges, CIOs, CTOs, and CISOs must figure out how to modernize legacy systems and infrastructure while doing more with less and still defending against external and internal threats ...

Reliability is no longer proven by uptime alone, according to the The SRE Report 2026 from LogicMonitor. In the AI era, it is experienced through speed, consistency, and user trust, and increasingly judged by business impact. As digital services grow more complex and AI systems move into production, traditional monitoring approaches are struggling to keep pace, increasing the need for AI-first observability that spans applications, infrastructure, and the Internet ...

If AI is the engine of a modern organization, then data engineering is the road system beneath it. You can build the most powerful engine in the world, but without paved roads, traffic signals, and bridges that can support its weight, it will stall. In many enterprises, the engine is ready. The roads are not ...

In the world of digital-first business, there is no tolerance for service outages. Businesses know that outages are the quickest way to lose money and customers. For smaller organizations, unplanned downtime could even force the business to close ... A new study from PagerDuty, The State of AI-First Operations, reveals that companies actively incorporating AI into operations now view operational resilience as a growth driver rather than a cost center. But how are they achieving it? ...

In live financial environments, capital markets software cannot pause for rebuilds. New capabilities are introduced as stacked technology layers to meet evolving demands while systems remain active, data keeps moving, and controls stay intact. AI is no exception, and its opportunities are significant: accelerated decision cycles, compressed manual workflows, and more effective operations across complex environments. The constraint isn't the models themselves, but the architectural environments they enter ...

Like most digital transformation shifts, organizations often prioritize productivity and leave security and observability to keep pace. This usually translates to both the mass implementation of new technology and fragmented monitoring and observability (M&O) tooling. In the era of AI and varied cloud architecture, a disparate observability function can be dangerous. IT teams will lack a complete picture of their IT environment, making it harder to diagnose issues while slowing down mean time to resolve (MTTR). In fact, according to recent data from the SolarWinds State of Monitoring & Observability Report, 77% of IT personnel said the lack of visibility across their on-prem and cloud architecture was an issue ...

In MEAN TIME TO INSIGHT Episode 23, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses the NetOps labor shortage ... 

Technology management is evolving, and in turn, so is the scope of FinOps. The FinOps Foundation recently updated their mission statement from "advancing the people who manage the value of cloud" to "advancing the people who manage the value of technology." This seemingly small change solidifies a larger evolution: FinOps practitioners have organically expanded to be focused on more than just cloud cost optimization. Today, FinOps teams are largely — and quickly — expanding their job descriptions, evolving into a critical function for managing the full value of technology ...

Advanced IT Analytics, AIOps, Big Data - What's Really Going On?

Dennis Drogseth

This question is really two questions.

The first would be: What's really going on in terms of a confusion of terms? — as we wrestle with AIOps, IT Operational Analytics, big data, AI bots, machine learning, and more generically stated "AI platforms" (… and the list is far from complete).

The second might be phrased as: What's really going on in terms of real-world advanced IT analytics deployments — where are they succeeding, and where are they not?

This blog will look at both questions as a way of introducing EMA's newest research with data just coming in from North America and Europe (UK, Germany and France). Like this blog, our research will also examine both questions, with the weight on examining real-world deployments. We hope to have at least a few real answers for you by September, with fresh data and timely analysis.

A Term by Any Other Name …

I'm borrowing, admittedly, from Shakespeare, to suggest that buzzwords in tech often get in the way of understanding real value, even as they seek to clarify it. In the case of what EMA prefers to call "advanced IT analytics" the fugal use of AI, machine learning, and big data, among other terms, often confuses what's really afoot. The real value is almost always in the mixture of science and artistry with which the analytics are applied to various use cases, not a purely academic discussion about what heuristics lie underneath the hood.

But EMA believes there is nevertheless a commonality across all true AIA solutions.

Last summer, EMA embarked on research that strongly indicates that there are common benefits, requirements and challenge surrounding an investment in AIA. Some of the more dramatic benefits typically included values in unifying IT across silos, toolset consolidation, dramatic reductions in mean-time-to-repair and mean time between failures, as well as other use cases that typically ranged from performance and availability management, to change management and capacity optimization, to support for DevOps and SecOps, to optimizing migrations to public cloud. As such we view AIA as a potentially transformative arena for both IT and the business it serves.

In our current research, we will be asking some simple questions regarding terminology and attributes to test the waters, especially in the now prevalent area of AIOps. But we'll also be able to track deployments centering on big data, security-related analytics, capacity-specific analytics and end-user or customer experience analytics, to see what patterns emerge and how they actually differ.

How Do You Make it All Real?

What's currently afoot in operationalizing advanced analytics for IT?

This is the main focus for our research, and it will also help to inform on the first question — what people are actually doing when they champion AIOps, or big data, etc.

Some areas of focus include:

Use cases: Here we are expanding on capacity, security and end-user experience to include cross-domain application/infrastructure availability and performance, DevOps/agile, cost management (including hybrid and multi-cloud), change management, and IoT.

Leadership: Who's leading in investments in advanced IT analytics, and who's leading in overseeing and actually delivering on deployments? What are their objectives, and how are they going about it?

Best practices: Are there any consistent best practices that emerge from the usual laundry list when advanced analytics are being deployed and used? If so, what are they? And how effective are they?

Integrations: How much are investments in advanced analytics being used to assimilate and optimize other toolsets?

Automation: What are the current priorities for integrated automation, where AI and machine learning can help to intelligently and adaptively drive more automated outcomes?

AI bots: Along with general automation priorities, we are looking at AI bot strategies to see how they converge (or don't) with AIOps and other analytics investments.

Technology and data sources: What data sets are IT organizations most hungry for when it comes to advanced analytics? What heuristics do they feel are most critical now, and in the future? How is service modeling and dependency mapping playing in the advanced IT analytics arena?

Roadblocks and benefits: What are the major obstacles remaining in 2018 to effective advanced IT analytics deployments? And what are the more prevalent benefits achieved?

Summing Up

These are admittedly a lot of areas for examination, and once again, the list is not complete. Moreover, we plan to investigate the answers we receive for all these questions from various perspectives, including company size, vertical, geography, roles (what do IT executives think versus more hands-on stakeholders?), success rates and other factors.

Finally, we'll be looking for trends based on the research done in two prior reports: Advanced IT Analytics: A Look at Real-World Adoptions in the Real World March 2016, and The Many Faces of Advanced Operations Analytics September 2014.

What I'm hoping we'll see in September is continued growth toward a more mature, more business-aligned, and more IT-unifying approach to advanced analytics deployments, with a growing number of stakeholders and benefits. I'm also hoping for a more definitive set of AIA profiles, as operations analytics continues to redefine itself away from just "big data," and as the need for more evolved, holistic and dynamic multi-use-case AIA platforms becomes more pronounced.

But it's too soon to tell. The data is still coming in. Nevertheless, I should know soon. In a follow-up blog in the first-half of September I'll be able to present some real news.

Hot Topics

The Latest

Today's modern systems are not what they once were. Organizations now rely on distributed systems, event-driven workflows, hybrid and multi-cloud environments and continuous delivery pipelines. While each adds flexibility, it also introduces new, often invisible failures. Development speed is no longer the primary bottleneck of innovation. Reliability is ...

Seeing is believing, or in this case, seeing is understanding, according to New Relic's 2025 Observability Forecast for Retail and eCommerce report. Retailers who want to provide exceptional customer experiences while improving IT operations efficiency are leaning on observability ... Here are five key takeaways from the report ...

Technology leaders across the federal landscape are facing, and will continue to face, an uphill battle when it comes to fortifying their digital environments against hostile and persistent threat actors. On one hand, they are being asked to push digital transformation ... On the other hand, they are facing the fiscal uncertainty of continuing resolutions (CR) and government shutdowns looming near and far. In the face of these challenges, CIOs, CTOs, and CISOs must figure out how to modernize legacy systems and infrastructure while doing more with less and still defending against external and internal threats ...

Reliability is no longer proven by uptime alone, according to the The SRE Report 2026 from LogicMonitor. In the AI era, it is experienced through speed, consistency, and user trust, and increasingly judged by business impact. As digital services grow more complex and AI systems move into production, traditional monitoring approaches are struggling to keep pace, increasing the need for AI-first observability that spans applications, infrastructure, and the Internet ...

If AI is the engine of a modern organization, then data engineering is the road system beneath it. You can build the most powerful engine in the world, but without paved roads, traffic signals, and bridges that can support its weight, it will stall. In many enterprises, the engine is ready. The roads are not ...

In the world of digital-first business, there is no tolerance for service outages. Businesses know that outages are the quickest way to lose money and customers. For smaller organizations, unplanned downtime could even force the business to close ... A new study from PagerDuty, The State of AI-First Operations, reveals that companies actively incorporating AI into operations now view operational resilience as a growth driver rather than a cost center. But how are they achieving it? ...

In live financial environments, capital markets software cannot pause for rebuilds. New capabilities are introduced as stacked technology layers to meet evolving demands while systems remain active, data keeps moving, and controls stay intact. AI is no exception, and its opportunities are significant: accelerated decision cycles, compressed manual workflows, and more effective operations across complex environments. The constraint isn't the models themselves, but the architectural environments they enter ...

Like most digital transformation shifts, organizations often prioritize productivity and leave security and observability to keep pace. This usually translates to both the mass implementation of new technology and fragmented monitoring and observability (M&O) tooling. In the era of AI and varied cloud architecture, a disparate observability function can be dangerous. IT teams will lack a complete picture of their IT environment, making it harder to diagnose issues while slowing down mean time to resolve (MTTR). In fact, according to recent data from the SolarWinds State of Monitoring & Observability Report, 77% of IT personnel said the lack of visibility across their on-prem and cloud architecture was an issue ...

In MEAN TIME TO INSIGHT Episode 23, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses the NetOps labor shortage ... 

Technology management is evolving, and in turn, so is the scope of FinOps. The FinOps Foundation recently updated their mission statement from "advancing the people who manage the value of cloud" to "advancing the people who manage the value of technology." This seemingly small change solidifies a larger evolution: FinOps practitioners have organically expanded to be focused on more than just cloud cost optimization. Today, FinOps teams are largely — and quickly — expanding their job descriptions, evolving into a critical function for managing the full value of technology ...