Skip to main content

Enterprises Have Opportunities to Expand Use of Emergent Data Sources for AI and More

As organizations strive to capitalize on their ever-growing data trove to scale their operations and improve business outcomes, only 17% of data ingested or landed consists of emergent data types, and only 9% of that data is processed or analyzed, according to a new report from BMC, Putting the "Ops" in DataOps: Success factors for operationalizing data. This signals a significant opportunity to benefit from emergent data types critical for initiatives like generative AI, LLMs, FinOps, and sustainability. The study defined four maturity levels, including: 

■ Developing – discovery phase with strategies in their infancy, and practices and architecture not closely aligned to business outcomes. 

■ Functional – growth phase with strategies primarily developed and some high-priority practices and architecture linked to business outcomes. 

■ Proficient – adolescent phase representing a fully established strategy with nearly all practices and architecture linked to critical business outcomes.

 ■ Exceptional – innovation phase with a perpetually optimized strategy, practices, and architecture that generates competitive differentiation and business value. 

DataOps strategy is closely aligned with data management maturity. Of those respondents with exceptional data management maturity, 27% stated they use DataOps methodologies across their organization to support all data-driven activities. In comparison, those with proficient maturity levels reported 19%, and functional and developing levels stated 15% and 10%, respectively. Even among organizations with exceptional data maturity, only 41% report having "high maturity" for data pipeline and application workflow orchestration functions. Higher data management and DataOps maturity are linked to higher reported adoption and success with data-driven activities. 75% of those with mature practices have a Chief Data Officer, while only 54% with less mature practices do.

Challenges Obstruct Flow of Data

Multiple challenges continue to impact the flow of data in businesses, including those related to people, processes, and technology. These include a lack of skills (48%), human error and mistakes (43%), limitations on scalability (40%), and a lack of technology automation (43%). A lack of automation can exacerbate a lack of skills, while an appropriate use of automation can amplify skills already available. 

"AI and data are in a cosmic dance, and data challenges are increasing dramatically in the AI era," said Ram Chakravarti, chief technology officer at BMC. "This study highlights how organizations with mature data practices can achieve better business outcomes. Implementing DataOps methodologies to enhance collaboration and operational efficiency, maintaining high data quality through pragmatic investments, and developing robust data pipeline orchestration systems can help unlock value at scale." 

Methodology: BMC commissioned 451 Research, part of S&P Global Market Intelligence, to conduct the survey in late 2023, sourcing insights from 1,100 IT, data, and business professionals from large enterprises in diverse global regions across multiple industries in eleven countries.

Hot Topics

The Latest

I've spent a lot of time in the channel, and one thing I keep coming back to is this: a partner program is only as good as what it looks like in the field. Many programs look great on paper, but when a partner is in front of a customer navigating a complex hybrid environment or trying to make the case for AI-powered observability, the gap between what a vendor promises and what it actually delivers becomes very clear, very fast ...

Enterprises today operate in a real-time environment where uninterrupted access to trusted data has become a baseline expectation for users, applications and automated systems. Traditional DataOps models, built on manual effort and human triage, cannot keep pace with this always active demand. AI agents are emerging as the operational backbone, ensuring consistent data availability, reinforcing trustworthiness and enabling a level of scale that manual processes cannot achieve ...

For decades, trust in the digital workplace rested on familiar signals. We trusted faces on video calls, voices on the phone, and emails that appeared to come from people we knew. These cues felt human and intuitive. They anchored how decisions were made, approvals were granted, and access was authorized. AI-powered deepfakes have quietly broken that model ...

Cloud migration was supposed to be a one-way door. For most enterprises, it turns out it isn't. Cloud data repatriation is a real and growing trend. A new survey ... finds that 89% of organizations plan to expand their on-premises infrastructure footprint over the next two years — and 75% have already moved at least some workloads back from public cloud in the past 24 months. The findings point to a broad rethinking of where data belongs ...

Over the past few years, large language models (LLMs) have revolutionized the software industry. Given their ability to excel at multi-step reasoning, LLMs have helped enterprises streamline workflows and adapt to the unknown. However, employing such models comes with sky-high costs, latency issues, and limited flexibility. In the realm of IT operations, it is generally wiser to employ smaller, domain-specific models instead ...

For years, DevOps teams operated under a simple assumption: collect enough telemetry, and you can find and fix any problem. That assumption is breaking down. Modern enterprises now operate across microservices, hybrid cloud environments, APIs, Kubernetes, and highly automated delivery pipelines. Releases happen continuously, dependencies shift constantly, and failures spread faster than teams can diagnose them ...

New Relic surveyed IT and engineering leaders from the media and entertainment (M&E) sector to understand what's working — and where challenges persist with their observability practices. The findings reveal how M&E organizations are navigating rising platform complexity, audience expectations, and AI-driven change. Below are five takeaways that stand out ...

Let me start with something I've seen play out more times than I can count. A team hits a wall with the cloud. Costs creep up, then spike. Performance starts to feel inconsistent. Someone in finance asks a simple question like "why did this double?" and nobody has a clean answer ... Maybe this isn't the right place for everything. That realization feels like a breakthrough, like you've identified the problem. In reality, you've just identified the starting line ...

In MEAN TIME TO INSIGHT Episode 24, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses network observability tool sprawl ... 

In cloud-native systems, scaling is often as simple as moving a slider. For on-premise databases, the stakes are different. Over-provisioning hardware is expensive. Under-provisioning leads to performance bottlenecks that are difficult to fix once the equipment is in the rack ...

Enterprises Have Opportunities to Expand Use of Emergent Data Sources for AI and More

As organizations strive to capitalize on their ever-growing data trove to scale their operations and improve business outcomes, only 17% of data ingested or landed consists of emergent data types, and only 9% of that data is processed or analyzed, according to a new report from BMC, Putting the "Ops" in DataOps: Success factors for operationalizing data. This signals a significant opportunity to benefit from emergent data types critical for initiatives like generative AI, LLMs, FinOps, and sustainability. The study defined four maturity levels, including: 

■ Developing – discovery phase with strategies in their infancy, and practices and architecture not closely aligned to business outcomes. 

■ Functional – growth phase with strategies primarily developed and some high-priority practices and architecture linked to business outcomes. 

■ Proficient – adolescent phase representing a fully established strategy with nearly all practices and architecture linked to critical business outcomes.

 ■ Exceptional – innovation phase with a perpetually optimized strategy, practices, and architecture that generates competitive differentiation and business value. 

DataOps strategy is closely aligned with data management maturity. Of those respondents with exceptional data management maturity, 27% stated they use DataOps methodologies across their organization to support all data-driven activities. In comparison, those with proficient maturity levels reported 19%, and functional and developing levels stated 15% and 10%, respectively. Even among organizations with exceptional data maturity, only 41% report having "high maturity" for data pipeline and application workflow orchestration functions. Higher data management and DataOps maturity are linked to higher reported adoption and success with data-driven activities. 75% of those with mature practices have a Chief Data Officer, while only 54% with less mature practices do.

Challenges Obstruct Flow of Data

Multiple challenges continue to impact the flow of data in businesses, including those related to people, processes, and technology. These include a lack of skills (48%), human error and mistakes (43%), limitations on scalability (40%), and a lack of technology automation (43%). A lack of automation can exacerbate a lack of skills, while an appropriate use of automation can amplify skills already available. 

"AI and data are in a cosmic dance, and data challenges are increasing dramatically in the AI era," said Ram Chakravarti, chief technology officer at BMC. "This study highlights how organizations with mature data practices can achieve better business outcomes. Implementing DataOps methodologies to enhance collaboration and operational efficiency, maintaining high data quality through pragmatic investments, and developing robust data pipeline orchestration systems can help unlock value at scale." 

Methodology: BMC commissioned 451 Research, part of S&P Global Market Intelligence, to conduct the survey in late 2023, sourcing insights from 1,100 IT, data, and business professionals from large enterprises in diverse global regions across multiple industries in eleven countries.

Hot Topics

The Latest

I've spent a lot of time in the channel, and one thing I keep coming back to is this: a partner program is only as good as what it looks like in the field. Many programs look great on paper, but when a partner is in front of a customer navigating a complex hybrid environment or trying to make the case for AI-powered observability, the gap between what a vendor promises and what it actually delivers becomes very clear, very fast ...

Enterprises today operate in a real-time environment where uninterrupted access to trusted data has become a baseline expectation for users, applications and automated systems. Traditional DataOps models, built on manual effort and human triage, cannot keep pace with this always active demand. AI agents are emerging as the operational backbone, ensuring consistent data availability, reinforcing trustworthiness and enabling a level of scale that manual processes cannot achieve ...

For decades, trust in the digital workplace rested on familiar signals. We trusted faces on video calls, voices on the phone, and emails that appeared to come from people we knew. These cues felt human and intuitive. They anchored how decisions were made, approvals were granted, and access was authorized. AI-powered deepfakes have quietly broken that model ...

Cloud migration was supposed to be a one-way door. For most enterprises, it turns out it isn't. Cloud data repatriation is a real and growing trend. A new survey ... finds that 89% of organizations plan to expand their on-premises infrastructure footprint over the next two years — and 75% have already moved at least some workloads back from public cloud in the past 24 months. The findings point to a broad rethinking of where data belongs ...

Over the past few years, large language models (LLMs) have revolutionized the software industry. Given their ability to excel at multi-step reasoning, LLMs have helped enterprises streamline workflows and adapt to the unknown. However, employing such models comes with sky-high costs, latency issues, and limited flexibility. In the realm of IT operations, it is generally wiser to employ smaller, domain-specific models instead ...

For years, DevOps teams operated under a simple assumption: collect enough telemetry, and you can find and fix any problem. That assumption is breaking down. Modern enterprises now operate across microservices, hybrid cloud environments, APIs, Kubernetes, and highly automated delivery pipelines. Releases happen continuously, dependencies shift constantly, and failures spread faster than teams can diagnose them ...

New Relic surveyed IT and engineering leaders from the media and entertainment (M&E) sector to understand what's working — and where challenges persist with their observability practices. The findings reveal how M&E organizations are navigating rising platform complexity, audience expectations, and AI-driven change. Below are five takeaways that stand out ...

Let me start with something I've seen play out more times than I can count. A team hits a wall with the cloud. Costs creep up, then spike. Performance starts to feel inconsistent. Someone in finance asks a simple question like "why did this double?" and nobody has a clean answer ... Maybe this isn't the right place for everything. That realization feels like a breakthrough, like you've identified the problem. In reality, you've just identified the starting line ...

In MEAN TIME TO INSIGHT Episode 24, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses network observability tool sprawl ... 

In cloud-native systems, scaling is often as simple as moving a slider. For on-premise databases, the stakes are different. Over-provisioning hardware is expensive. Under-provisioning leads to performance bottlenecks that are difficult to fix once the equipment is in the rack ...