Skip to main content

NetOps Teams: Hybrid Cloud Architecture Is the True Source of Our Pain, Not the Cloud Itself

Shamus McGillicuddy

Hybrid cloud architecture is breaking the backs of network engineering and operations teams. These teams are more successful when their companies go all-in with the cloud or stay out of it entirely. When companies maintain hybrid infrastructure, with applications and data residing across data centers and public cloud services, the network team struggles.

This insight emerged in the newly published 2024 edition of Enterprise Management Associates' (EMA) Network Management Megatrends research, our biennial network operations benchmarking study based on a survey of 406 enterprise IT professionals. The survey found that nearly 51% of respondents were supporting a hybrid cloud environment. More than 26% were 100% in the public cloud, while more than 23% were relying entirely on private data center infrastructure.

EMA has long observed that network operations teams are challenged by the public cloud. Network engineers tell us that they lose control over architecture and struggle to gain visibility into cloud networks. They also struggle with skills gaps and collaboration challenges. However, this most recent finding suggests that it isn't just the cloud itself that necessarily causes these problems. Instead, it's the hybridization of infrastructure, with resources spanning public and private resources, that is causing significant pain. Network teams are finding it difficult to manage across the two worlds. They lack tools and processes for architecting and operationalizing an effective hybrid cloud network. To illustrate this point, the Megatrends research asked respondents to identify the typical root cause of complex service issues that pull together war room response teams with stakeholders from multiple IT groups. In hybrid cloud enterprises, network infrastructure was more likely to be the root cause of these challenging problems.

When one thinks about it, the challenge of a hybrid environment makes perfect sense. In a company that uses only private infrastructure, network teams have long had the tools, processes, and skills required to manage such networks. Those that adopt a 100% cloud environment can adapt by embracing cloud-native technologies for building, managing and observing networks. There are countless vendors that have developed solutions that excel at supporting purely cloud networks, and cloud providers themselves have built out an ecosystem of tools to enable networks within their environments.

It's much harder to build and manage networks that span these two worlds because they are fundamentally different. In private infrastructure, the network team has administrative access and control over the underlying infrastructure, making it easier to manage networks granularly and to extract monitoring data. In the public cloud, network teams must work with APIs and abstracted services because they have no administrative access to the underlying infrastructure. Deploying tools and developing processes that span these very different architectures is fundamentally complex.

Addressing Hybrid Cloud Complexity

The Megatrends research revealed that network teams that support a hybrid cloud architecture are more likely to be investing in new network performance management tools, suggesting that they've identified gaps in how their existing tools provide end-to-end visibility into hybrid cloud networks. They are looking for tools that can provide end to end visibility. In fact, 53% of network teams who support a hybrid cloud or multi-cloud environment reported that they are trying to build out end-to-end monitoring and troubleshooting capabilities. Network teams have a variety of options here, from their legacy on-premises tools and cloud-native observability tools, to tools that focus more on digital experience monitoring than infrastructure monitoring. It remains unclear which approach is best.

"I see a lack of holistic visibility into the cloud. It's hard to have a single pane of glass when you are looking at various systems," as a network security architect at a Fortune 500 cybersecurity company recently told EMA. "We've been relying on logs. But there are not tools that are designed to give us visibility across different [public and private] clouds."

Network teams with hybrid cloud environments are also more likely to be investing in new network security solutions, suggesting that they are trying to impose consistent and effective security controls across public and private infrastructure. These network teams were also more likely to share their network management and monitoring tools with their counterparts in cybersecurity teams, suggesting that the complexity of hybrid cloud security forces more collaboration between network and security teams.

Hybrid cloud network teams are also more likely to make new investments in multi-cloud networking solutions, software-defined WAN, and data center network infrastructure, indicating that hybrid environments are demanding modernization of local and wide-area network connectivity.

In other words, hybrid cloud infrastructure simply demands more of network teams than pure private and pure cloud environments. The complexity doesn't end there. EMA also observed that companies with hybrid environments are more likely to have a mix of on-premises data centers and colocation providers comprising their private infrastructure. Research participants told us that they typically incorporate colocation data centers into their networks to support efforts to reduce their on-premises data center footprints, to enable disaster recovery and resiliency, and to deploy applications and data closer to end users and customers.

Finally, all this complexity creates a need for operational efficiency. One key enabler of that efficiency is network automation. Unfortunately, enterprises with hybrid environments were more likely than others to struggle to hire IT personnel with network automation skills. Network teams will need vendors to support them as they try to mitigate these skills gaps.

Overall, just 39% of network pros who support a hybrid cloud and/or multi-cloud architecture believe that their efforts to impose end-to-end operations have been completely successful. EMA observed two potential paths toward success:

First, network teams that have improved their ability to hire and retain skilled personnel do better with these efforts. This will require IT leadership that is willing to go the extra mile, with improved recruiting efforts, competitive compensation, and opportunities for advancement and growth.

Second, network teams do better when they minimize their reliance on tools provided by individual cloud providers to operationalize hybrid networks. Instead, they need to push their traditional tool vendors to innovate.

Listen to Episode 1 of the MEAN TIME TO INSIGHT PODCAST (MTTI): 2024 Network Management Trends

Click here for a direct MP3 download of Episode 1

Hot Topics

The Latest

E-commerce is set to skyrocket with a 9% rise over the next few years ... To thrive in this competitive environment, retailers must identify digital resilience as their top priority. In a world where savvy shoppers expect 24/7 access to online deals and experiences, any unexpected downtime to digital services can lead to significant financial losses, damage to brand reputation, abandoned carts with designer shoes, and additional issues ...

Efficiency is a highly-desirable objective in business ... We're seeing this scenario play out in enterprises around the world as they continue to struggle with infrastructures and remote work models with an eye toward operational efficiencies. In contrast to that goal, a recent Broadcom survey of global IT and network professionals found widespread adoption of these strategies is making the network more complex and hampering observability, leading to uptime, performance and security issues. Let's look more closely at these challenges ...

Image
Broadcom

The 2025 Catchpoint SRE Report dives into the forces transforming the SRE landscape, exploring both the challenges and opportunities ahead. Let's break down the key findings and what they mean for SRE professionals and the businesses relying on them ...

Image
Catchpoint

The pressure on IT teams has never been greater. As data environments grow increasingly complex, resource shortages are emerging as a major obstacle for IT leaders striving to meet the demands of modern infrastructure management ... According to DataStrike's newly released 2025 Data Infrastructure Survey Report, more than half (54%) of IT leaders cite resource limitations as a top challenge, highlighting a growing trend toward outsourcing as a solution ...

Image
Datastrike

Gartner revealed its top strategic predictions for 2025 and beyond. Gartner's top predictions explore how generative AI (GenAI) is affecting areas where most would assume only humans can have lasting impact ...

The adoption of artificial intelligence (AI) is accelerating across the telecoms industry, with 88% of fixed broadband service providers now investigating or trialing AI automation to enhance their fixed broadband services, according to new research from Incognito Software Systems and Omdia ...

 

AWS is a cloud-based computing platform known for its reliability, scalability, and flexibility. However, as helpful as its comprehensive infrastructure is, disparate elements and numerous siloed components make it difficult for admins to visualize the cloud performance in detail. It requires meticulous monitoring techniques and deep visibility to understand cloud performance and analyze operational efficiency in detail to ensure seamless cloud operations ...

Imagine a future where software, once a complex obstacle, becomes a natural extension of daily workflow — an intuitive, seamless experience that maximizes productivity and efficiency. This future is no longer a distant vision but a reality being crafted by the transformative power of Artificial Intelligence ...

Enterprise data sprawl already challenges companies' ability to protect and back up their data. Much of this information is never fully secured, leaving organizations vulnerable. Now, as GenAI platforms emerge as yet another environment where enterprise data is consumed, transformed, and created, this fragmentation is set to intensify ...

Image
Crashplan

OpenTelemetry (OTel) has revolutionized the way we approach observability by standardizing the collection of telemetry data ... Here are five myths — and truths — to help elevate your OTel integration by harnessing the untapped power of logs ...

NetOps Teams: Hybrid Cloud Architecture Is the True Source of Our Pain, Not the Cloud Itself

Shamus McGillicuddy

Hybrid cloud architecture is breaking the backs of network engineering and operations teams. These teams are more successful when their companies go all-in with the cloud or stay out of it entirely. When companies maintain hybrid infrastructure, with applications and data residing across data centers and public cloud services, the network team struggles.

This insight emerged in the newly published 2024 edition of Enterprise Management Associates' (EMA) Network Management Megatrends research, our biennial network operations benchmarking study based on a survey of 406 enterprise IT professionals. The survey found that nearly 51% of respondents were supporting a hybrid cloud environment. More than 26% were 100% in the public cloud, while more than 23% were relying entirely on private data center infrastructure.

EMA has long observed that network operations teams are challenged by the public cloud. Network engineers tell us that they lose control over architecture and struggle to gain visibility into cloud networks. They also struggle with skills gaps and collaboration challenges. However, this most recent finding suggests that it isn't just the cloud itself that necessarily causes these problems. Instead, it's the hybridization of infrastructure, with resources spanning public and private resources, that is causing significant pain. Network teams are finding it difficult to manage across the two worlds. They lack tools and processes for architecting and operationalizing an effective hybrid cloud network. To illustrate this point, the Megatrends research asked respondents to identify the typical root cause of complex service issues that pull together war room response teams with stakeholders from multiple IT groups. In hybrid cloud enterprises, network infrastructure was more likely to be the root cause of these challenging problems.

When one thinks about it, the challenge of a hybrid environment makes perfect sense. In a company that uses only private infrastructure, network teams have long had the tools, processes, and skills required to manage such networks. Those that adopt a 100% cloud environment can adapt by embracing cloud-native technologies for building, managing and observing networks. There are countless vendors that have developed solutions that excel at supporting purely cloud networks, and cloud providers themselves have built out an ecosystem of tools to enable networks within their environments.

It's much harder to build and manage networks that span these two worlds because they are fundamentally different. In private infrastructure, the network team has administrative access and control over the underlying infrastructure, making it easier to manage networks granularly and to extract monitoring data. In the public cloud, network teams must work with APIs and abstracted services because they have no administrative access to the underlying infrastructure. Deploying tools and developing processes that span these very different architectures is fundamentally complex.

Addressing Hybrid Cloud Complexity

The Megatrends research revealed that network teams that support a hybrid cloud architecture are more likely to be investing in new network performance management tools, suggesting that they've identified gaps in how their existing tools provide end-to-end visibility into hybrid cloud networks. They are looking for tools that can provide end to end visibility. In fact, 53% of network teams who support a hybrid cloud or multi-cloud environment reported that they are trying to build out end-to-end monitoring and troubleshooting capabilities. Network teams have a variety of options here, from their legacy on-premises tools and cloud-native observability tools, to tools that focus more on digital experience monitoring than infrastructure monitoring. It remains unclear which approach is best.

"I see a lack of holistic visibility into the cloud. It's hard to have a single pane of glass when you are looking at various systems," as a network security architect at a Fortune 500 cybersecurity company recently told EMA. "We've been relying on logs. But there are not tools that are designed to give us visibility across different [public and private] clouds."

Network teams with hybrid cloud environments are also more likely to be investing in new network security solutions, suggesting that they are trying to impose consistent and effective security controls across public and private infrastructure. These network teams were also more likely to share their network management and monitoring tools with their counterparts in cybersecurity teams, suggesting that the complexity of hybrid cloud security forces more collaboration between network and security teams.

Hybrid cloud network teams are also more likely to make new investments in multi-cloud networking solutions, software-defined WAN, and data center network infrastructure, indicating that hybrid environments are demanding modernization of local and wide-area network connectivity.

In other words, hybrid cloud infrastructure simply demands more of network teams than pure private and pure cloud environments. The complexity doesn't end there. EMA also observed that companies with hybrid environments are more likely to have a mix of on-premises data centers and colocation providers comprising their private infrastructure. Research participants told us that they typically incorporate colocation data centers into their networks to support efforts to reduce their on-premises data center footprints, to enable disaster recovery and resiliency, and to deploy applications and data closer to end users and customers.

Finally, all this complexity creates a need for operational efficiency. One key enabler of that efficiency is network automation. Unfortunately, enterprises with hybrid environments were more likely than others to struggle to hire IT personnel with network automation skills. Network teams will need vendors to support them as they try to mitigate these skills gaps.

Overall, just 39% of network pros who support a hybrid cloud and/or multi-cloud architecture believe that their efforts to impose end-to-end operations have been completely successful. EMA observed two potential paths toward success:

First, network teams that have improved their ability to hire and retain skilled personnel do better with these efforts. This will require IT leadership that is willing to go the extra mile, with improved recruiting efforts, competitive compensation, and opportunities for advancement and growth.

Second, network teams do better when they minimize their reliance on tools provided by individual cloud providers to operationalize hybrid networks. Instead, they need to push their traditional tool vendors to innovate.

Listen to Episode 1 of the MEAN TIME TO INSIGHT PODCAST (MTTI): 2024 Network Management Trends

Click here for a direct MP3 download of Episode 1

Hot Topics

The Latest

E-commerce is set to skyrocket with a 9% rise over the next few years ... To thrive in this competitive environment, retailers must identify digital resilience as their top priority. In a world where savvy shoppers expect 24/7 access to online deals and experiences, any unexpected downtime to digital services can lead to significant financial losses, damage to brand reputation, abandoned carts with designer shoes, and additional issues ...

Efficiency is a highly-desirable objective in business ... We're seeing this scenario play out in enterprises around the world as they continue to struggle with infrastructures and remote work models with an eye toward operational efficiencies. In contrast to that goal, a recent Broadcom survey of global IT and network professionals found widespread adoption of these strategies is making the network more complex and hampering observability, leading to uptime, performance and security issues. Let's look more closely at these challenges ...

Image
Broadcom

The 2025 Catchpoint SRE Report dives into the forces transforming the SRE landscape, exploring both the challenges and opportunities ahead. Let's break down the key findings and what they mean for SRE professionals and the businesses relying on them ...

Image
Catchpoint

The pressure on IT teams has never been greater. As data environments grow increasingly complex, resource shortages are emerging as a major obstacle for IT leaders striving to meet the demands of modern infrastructure management ... According to DataStrike's newly released 2025 Data Infrastructure Survey Report, more than half (54%) of IT leaders cite resource limitations as a top challenge, highlighting a growing trend toward outsourcing as a solution ...

Image
Datastrike

Gartner revealed its top strategic predictions for 2025 and beyond. Gartner's top predictions explore how generative AI (GenAI) is affecting areas where most would assume only humans can have lasting impact ...

The adoption of artificial intelligence (AI) is accelerating across the telecoms industry, with 88% of fixed broadband service providers now investigating or trialing AI automation to enhance their fixed broadband services, according to new research from Incognito Software Systems and Omdia ...

 

AWS is a cloud-based computing platform known for its reliability, scalability, and flexibility. However, as helpful as its comprehensive infrastructure is, disparate elements and numerous siloed components make it difficult for admins to visualize the cloud performance in detail. It requires meticulous monitoring techniques and deep visibility to understand cloud performance and analyze operational efficiency in detail to ensure seamless cloud operations ...

Imagine a future where software, once a complex obstacle, becomes a natural extension of daily workflow — an intuitive, seamless experience that maximizes productivity and efficiency. This future is no longer a distant vision but a reality being crafted by the transformative power of Artificial Intelligence ...

Enterprise data sprawl already challenges companies' ability to protect and back up their data. Much of this information is never fully secured, leaving organizations vulnerable. Now, as GenAI platforms emerge as yet another environment where enterprise data is consumed, transformed, and created, this fragmentation is set to intensify ...

Image
Crashplan

OpenTelemetry (OTel) has revolutionized the way we approach observability by standardizing the collection of telemetry data ... Here are five myths — and truths — to help elevate your OTel integration by harnessing the untapped power of logs ...