Organizations Overlook Huge Blind Spots in AI Overconfidence

Nearly half (44%) of IT leaders surveyed believe their organizations are fully set up to realize the benefits of AI, according to Architect an AI Advantage, a report commissioned by Hewlett Packard Enterprise (HPE).

The report reveals critical gaps in their strategies, such as lack of alignment between processes and metrics, resulting in consequential fragmentation in approach, which will further exacerbate delivery issues.

The report found that while global commitment to AI shows growing investments, businesses are overlooking key areas that will have a bearing on their ability to deliver successful AI outcomes — including low data maturity levels, possible deficiencies in their networking and compute provisioning, and vital ethics and compliance considerations. The report also uncovered significant disconnects in both strategy and understanding that could adversely affect future return on investment (ROI).

"There's no doubt AI adoption is picking up pace, with nearly all IT leaders planning to increase their AI spend over the next 12 months," said Sylvia Hooks, VP, HPE Aruba Networking. "These findings clearly demonstrate the appetite for AI, but they also highlight very real blind spots that could see progress stagnate if a more holistic approach is not followed. Misalignment on strategy and department involvement — for example — can impede organizations from leveraging critical areas of expertise, making effective and efficient decisions, and ensuring a holistic AI roadmap benefits all areas of the business congruently."

Acknowledging Low Data Maturity

Strong AI performance that impacts business outcomes depends on quality data input, but the research shows that while organizations clearly understand this — labeling data management as one of the most critical elements for AI success — their data maturity levels remain low.

Only a small percentage (7%) of organizations can run real-time data pushes/pulls to enable innovation and external data monetization, while just 26% have set up data governance models and can run advanced analytics.

Of greater concern, fewer than 6 in 10 respondents said their organization is completely capable of handling any of the key stages of data preparation for use in AI models — from accessing (59%) and storing (57%), to processing (55%) and recovering (51%). This discrepancy not only risks slowing down the AI model creation process, but also increases the probability the model will deliver inaccurate insights and a negative ROI.

Provisioning for the End-to-End Lifecycle

A similar gap appeared when respondents were asked about the compute and networking requirements across the end-to-end AI lifecycle. On the surface, confidence levels look high in this regard: 93% of IT leaders believe their network infrastructure is set up to support AI traffic, while 84% agree their systems have enough flexibility in compute capacity to support the unique demands across different stages of the AI lifecycle.

Gartner® expects "GenAI will play a role in 70% of text- and data-heavy tasks by 2025, up from less than 10% in 2023," yet less than half of IT leaders admitted to having a full understanding of what the demands of the various AI workloads across training, tuning and inferencing might be — calling into serious question how accurately they can provision for them.

Ignoring Cross-Business Connections, Compliance, and Ethics

Organizations are failing to connect the dots between key areas of business, with over a quarter (28%) of IT leaders describing their organization's overall AI approach as "fragmented." As evidence of this, over a third (35%) of organizations have chosen to create separate AI strategies for individual functions, while 32% are creating different sets of goals altogether.

More dangerous still, it appears that ethics and compliance are being completely overlooked, despite growing scrutiny around ethics and compliance from both consumers and regulatory bodies. The research shows that legal/compliance (13%) and ethics (11%) were deemed by IT leaders to be the least critical for AI success. In addition, the results showed that almost 1 in 4 organizations (22%) aren't involving legal teams in their business's AI strategy conversations at all.

The Fear of Missing Out on AI and the Business Risk of Over Confidence

As businesses move quickly to understand the hype around AI, without proper AI ethics and compliance, businesses run the risk of exposing their proprietary data — a cornerstone for retaining their competitive edge and maintaining their brand reputation. Among the issues, businesses lacking an AI ethics policy risk developing models that lack proper compliance and diversity standards, resulting in negative impacts to the company's brand, loss in sales or costly fines and legal battles.

There are additional risks as well, as the quality of the outcomes from AI models is limited to the quality of the data they ingest. This is reflected in the report, which shows data maturity levels remain low. When combined with the metric that half of IT leaders admitted to having a lack of full understanding on the IT infrastructure demands across the AI lifecycle, there is an increase in the overall risk of developing ineffective models, including the impact from AI hallucinations. Also, as the power demand to run AI models is extremely high, this can contribute to an unnecessary increase in data center carbon emissions. These challenges lower the ROI from a company's capital investment in AI and can further negatively impact the overall company brand.

"AI is the most data and power intensive workload of our time, and to effectively deliver on the promise of GenAI, solutions must be hybrid by design and built with a modern AI architecture," said Dr. Eng Lim Goh, SVP for Data & AI, HPE. "From training and tuning models on-premises, in a colocation or in the public cloud, to inferencing at the edge, GenAI has the potential to turn data into insights from every device on the network. However, businesses must carefully weigh the balance of being a first mover, and the risk of not fully understanding the gaps across the AI lifecycle, otherwise the large capital investments can end up delivering a negative ROI."

Methodology: In January 2024, HPE commissioned Sapio Research to conduct a survey to examine where businesses are in their AI journeys, and whether they are taking a holistic enough approach to position themselves for success. The survey included over 2,400 IT decision makers (IT leaders) across 14 markets (Australia/New Zealand, Brazil, France, Germany, India, Italy, Japan, Mexico, Netherlands, Singapore, South Korea, Spain, UK/Ireland, and USA). These IT leaders work at companies of 500+ employees, and span industries from financial services to manufacturing, retail, and healthcare.

Related Links

Hot Topics

The Latest

Keys to Building a Partner Ecosystem That Scales

I've spent a lot of time in the channel, and one thing I keep coming back to is this: a partner program is only as good as what it looks like in the field. Many programs look great on paper, but when a partner is in front of a customer navigating a complex hybrid environment or trying to make the case for AI-powered observability, the gap between what a vendor promises and what it actually delivers becomes very clear, very fast ...

How AI Agents Are Reshaping DataOps for the Always-On Enterprise

Enterprises today operate in a real-time environment where uninterrupted access to trusted data has become a baseline expectation for users, applications and automated systems. Traditional DataOps models, built on manual effort and human triage, cannot keep pace with this always active demand. AI agents are emerging as the operational backbone, ensuring consistent data availability, reinforcing trustworthiness and enabling a level of scale that manual processes cannot achieve ...

AI Deepfakes: Rethinking Trust in the Workplace

For decades, trust in the digital workplace rested on familiar signals. We trusted faces on video calls, voices on the phone, and emails that appeared to come from people we knew. These cues felt human and intuitive. They anchored how decisions were made, approvals were granted, and access was authorized. AI-powered deepfakes have quietly broken that model ...

Nine in Ten Enterprises Plan Cloud Data Repatriation amid Rising Cloud Costs and Data Sovereignty Mandates

Cloud migration was supposed to be a one-way door. For most enterprises, it turns out it isn't. Cloud data repatriation is a real and growing trend. A new survey ... finds that 89% of organizations plan to expand their on-premises infrastructure footprint over the next two years — and 75% have already moved at least some workloads back from public cloud in the past 24 months. The findings point to a broad rethinking of where data belongs ...

Why ITOps Need Right-Sized AI, Not Bigger Models

Over the past few years, large language models (LLMs) have revolutionized the software industry. Given their ability to excel at multi-step reasoning, LLMs have helped enterprises streamline workflows and adapt to the unknown. However, employing such models comes with sky-high costs, latency issues, and limited flexibility. In the realm of IT operations, it is generally wiser to employ smaller, domain-specific models instead ...

The End of Reactive DevOps: AI-Driven Observability for Zero-Defect Digital Systems

For years, DevOps teams operated under a simple assumption: collect enough telemetry, and you can find and fix any problem. That assumption is breaking down. Modern enterprises now operate across microservices, hybrid cloud environments, APIs, Kubernetes, and highly automated delivery pipelines. Releases happen continuously, dependencies shift constantly, and failures spread faster than teams can diagnose them ...

5 Takeaways from the Observability Forecast for Media and Entertainment

New Relic surveyed IT and engineering leaders from the media and entertainment (M&E) sector to understand what's working — and where challenges persist with their observability practices. The findings reveal how M&E organizations are navigating rising platform complexity, audience expectations, and AI-driven change. Below are five takeaways that stand out ...

Why Moving Off the Cloud Is the Easy Part and What Comes Next Is Where Things Get Hard

Let me start with something I've seen play out more times than I can count. A team hits a wall with the cloud. Costs creep up, then spike. Performance starts to feel inconsistent. Someone in finance asks a simple question like "why did this double?" and nobody has a clean answer ... Maybe this isn't the right place for everything. That realization feels like a breakthrough, like you've identified the problem. In reality, you've just identified the starting line ...

MEAN TIME TO INSIGHT Podcast - Episode 24: Network Observability Tool Sprawl

In MEAN TIME TO INSIGHT Episode 24, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses network observability tool sprawl ... 

Capacity Isn't a Guess: Observability-Driven Sizing for On-Prem Databases

In cloud-native systems, scaling is often as simple as moving a slider. For on-premise databases, the stakes are different. Over-provisioning hardware is expensive. Under-provisioning leads to performance bottlenecks that are difficult to fix once the equipment is in the rack ...

Organizations Overlook Huge Blind Spots in AI Overconfidence

Nearly half (44%) of IT leaders surveyed believe their organizations are fully set up to realize the benefits of AI, according to Architect an AI Advantage, a report commissioned by Hewlett Packard Enterprise (HPE).

The report reveals critical gaps in their strategies, such as lack of alignment between processes and metrics, resulting in consequential fragmentation in approach, which will further exacerbate delivery issues.

The report found that while global commitment to AI shows growing investments, businesses are overlooking key areas that will have a bearing on their ability to deliver successful AI outcomes — including low data maturity levels, possible deficiencies in their networking and compute provisioning, and vital ethics and compliance considerations. The report also uncovered significant disconnects in both strategy and understanding that could adversely affect future return on investment (ROI).

"There's no doubt AI adoption is picking up pace, with nearly all IT leaders planning to increase their AI spend over the next 12 months," said Sylvia Hooks, VP, HPE Aruba Networking. "These findings clearly demonstrate the appetite for AI, but they also highlight very real blind spots that could see progress stagnate if a more holistic approach is not followed. Misalignment on strategy and department involvement — for example — can impede organizations from leveraging critical areas of expertise, making effective and efficient decisions, and ensuring a holistic AI roadmap benefits all areas of the business congruently."

Acknowledging Low Data Maturity

Strong AI performance that impacts business outcomes depends on quality data input, but the research shows that while organizations clearly understand this — labeling data management as one of the most critical elements for AI success — their data maturity levels remain low.

Only a small percentage (7%) of organizations can run real-time data pushes/pulls to enable innovation and external data monetization, while just 26% have set up data governance models and can run advanced analytics.

Of greater concern, fewer than 6 in 10 respondents said their organization is completely capable of handling any of the key stages of data preparation for use in AI models — from accessing (59%) and storing (57%), to processing (55%) and recovering (51%). This discrepancy not only risks slowing down the AI model creation process, but also increases the probability the model will deliver inaccurate insights and a negative ROI.

Provisioning for the End-to-End Lifecycle

A similar gap appeared when respondents were asked about the compute and networking requirements across the end-to-end AI lifecycle. On the surface, confidence levels look high in this regard: 93% of IT leaders believe their network infrastructure is set up to support AI traffic, while 84% agree their systems have enough flexibility in compute capacity to support the unique demands across different stages of the AI lifecycle.

Gartner® expects "GenAI will play a role in 70% of text- and data-heavy tasks by 2025, up from less than 10% in 2023," yet less than half of IT leaders admitted to having a full understanding of what the demands of the various AI workloads across training, tuning and inferencing might be — calling into serious question how accurately they can provision for them.

Ignoring Cross-Business Connections, Compliance, and Ethics

Organizations are failing to connect the dots between key areas of business, with over a quarter (28%) of IT leaders describing their organization's overall AI approach as "fragmented." As evidence of this, over a third (35%) of organizations have chosen to create separate AI strategies for individual functions, while 32% are creating different sets of goals altogether.

More dangerous still, it appears that ethics and compliance are being completely overlooked, despite growing scrutiny around ethics and compliance from both consumers and regulatory bodies. The research shows that legal/compliance (13%) and ethics (11%) were deemed by IT leaders to be the least critical for AI success. In addition, the results showed that almost 1 in 4 organizations (22%) aren't involving legal teams in their business's AI strategy conversations at all.

The Fear of Missing Out on AI and the Business Risk of Over Confidence

As businesses move quickly to understand the hype around AI, without proper AI ethics and compliance, businesses run the risk of exposing their proprietary data — a cornerstone for retaining their competitive edge and maintaining their brand reputation. Among the issues, businesses lacking an AI ethics policy risk developing models that lack proper compliance and diversity standards, resulting in negative impacts to the company's brand, loss in sales or costly fines and legal battles.

There are additional risks as well, as the quality of the outcomes from AI models is limited to the quality of the data they ingest. This is reflected in the report, which shows data maturity levels remain low. When combined with the metric that half of IT leaders admitted to having a lack of full understanding on the IT infrastructure demands across the AI lifecycle, there is an increase in the overall risk of developing ineffective models, including the impact from AI hallucinations. Also, as the power demand to run AI models is extremely high, this can contribute to an unnecessary increase in data center carbon emissions. These challenges lower the ROI from a company's capital investment in AI and can further negatively impact the overall company brand.

"AI is the most data and power intensive workload of our time, and to effectively deliver on the promise of GenAI, solutions must be hybrid by design and built with a modern AI architecture," said Dr. Eng Lim Goh, SVP for Data & AI, HPE. "From training and tuning models on-premises, in a colocation or in the public cloud, to inferencing at the edge, GenAI has the potential to turn data into insights from every device on the network. However, businesses must carefully weigh the balance of being a first mover, and the risk of not fully understanding the gaps across the AI lifecycle, otherwise the large capital investments can end up delivering a negative ROI."

Methodology: In January 2024, HPE commissioned Sapio Research to conduct a survey to examine where businesses are in their AI journeys, and whether they are taking a holistic enough approach to position themselves for success. The survey included over 2,400 IT decision makers (IT leaders) across 14 markets (Australia/New Zealand, Brazil, France, Germany, India, Italy, Japan, Mexico, Netherlands, Singapore, South Korea, Spain, UK/Ireland, and USA). These IT leaders work at companies of 500+ employees, and span industries from financial services to manufacturing, retail, and healthcare.

Related Links

Hot Topics

The Latest

Keys to Building a Partner Ecosystem That Scales

I've spent a lot of time in the channel, and one thing I keep coming back to is this: a partner program is only as good as what it looks like in the field. Many programs look great on paper, but when a partner is in front of a customer navigating a complex hybrid environment or trying to make the case for AI-powered observability, the gap between what a vendor promises and what it actually delivers becomes very clear, very fast ...

How AI Agents Are Reshaping DataOps for the Always-On Enterprise

Enterprises today operate in a real-time environment where uninterrupted access to trusted data has become a baseline expectation for users, applications and automated systems. Traditional DataOps models, built on manual effort and human triage, cannot keep pace with this always active demand. AI agents are emerging as the operational backbone, ensuring consistent data availability, reinforcing trustworthiness and enabling a level of scale that manual processes cannot achieve ...

AI Deepfakes: Rethinking Trust in the Workplace

For decades, trust in the digital workplace rested on familiar signals. We trusted faces on video calls, voices on the phone, and emails that appeared to come from people we knew. These cues felt human and intuitive. They anchored how decisions were made, approvals were granted, and access was authorized. AI-powered deepfakes have quietly broken that model ...

Nine in Ten Enterprises Plan Cloud Data Repatriation amid Rising Cloud Costs and Data Sovereignty Mandates

Cloud migration was supposed to be a one-way door. For most enterprises, it turns out it isn't. Cloud data repatriation is a real and growing trend. A new survey ... finds that 89% of organizations plan to expand their on-premises infrastructure footprint over the next two years — and 75% have already moved at least some workloads back from public cloud in the past 24 months. The findings point to a broad rethinking of where data belongs ...

Why ITOps Need Right-Sized AI, Not Bigger Models

Over the past few years, large language models (LLMs) have revolutionized the software industry. Given their ability to excel at multi-step reasoning, LLMs have helped enterprises streamline workflows and adapt to the unknown. However, employing such models comes with sky-high costs, latency issues, and limited flexibility. In the realm of IT operations, it is generally wiser to employ smaller, domain-specific models instead ...

The End of Reactive DevOps: AI-Driven Observability for Zero-Defect Digital Systems

For years, DevOps teams operated under a simple assumption: collect enough telemetry, and you can find and fix any problem. That assumption is breaking down. Modern enterprises now operate across microservices, hybrid cloud environments, APIs, Kubernetes, and highly automated delivery pipelines. Releases happen continuously, dependencies shift constantly, and failures spread faster than teams can diagnose them ...

5 Takeaways from the Observability Forecast for Media and Entertainment

New Relic surveyed IT and engineering leaders from the media and entertainment (M&E) sector to understand what's working — and where challenges persist with their observability practices. The findings reveal how M&E organizations are navigating rising platform complexity, audience expectations, and AI-driven change. Below are five takeaways that stand out ...

Why Moving Off the Cloud Is the Easy Part and What Comes Next Is Where Things Get Hard

Let me start with something I've seen play out more times than I can count. A team hits a wall with the cloud. Costs creep up, then spike. Performance starts to feel inconsistent. Someone in finance asks a simple question like "why did this double?" and nobody has a clean answer ... Maybe this isn't the right place for everything. That realization feels like a breakthrough, like you've identified the problem. In reality, you've just identified the starting line ...

MEAN TIME TO INSIGHT Podcast - Episode 24: Network Observability Tool Sprawl

In MEAN TIME TO INSIGHT Episode 24, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses network observability tool sprawl ... 

Capacity Isn't a Guess: Observability-Driven Sizing for On-Prem Databases

In cloud-native systems, scaling is often as simple as moving a slider. For on-premise databases, the stakes are different. Over-provisioning hardware is expensive. Under-provisioning leads to performance bottlenecks that are difficult to fix once the equipment is in the rack ...