NetOps Teams: Hybrid Cloud Architecture Is the True Source of Our Pain, Not the Cloud Itself
May 23, 2024

Shamus McGillicuddy
EMA

Share this

Hybrid cloud architecture is breaking the backs of network engineering and operations teams. These teams are more successful when their companies go all-in with the cloud or stay out of it entirely. When companies maintain hybrid infrastructure, with applications and data residing across data centers and public cloud services, the network team struggles.

This insight emerged in the newly published 2024 edition of Enterprise Management Associates' (EMA) Network Management Megatrends research, our biennial network operations benchmarking study based on a survey of 406 enterprise IT professionals. The survey found that nearly 51% of respondents were supporting a hybrid cloud environment. More than 26% were 100% in the public cloud, while more than 23% were relying entirely on private data center infrastructure.

EMA has long observed that network operations teams are challenged by the public cloud. Network engineers tell us that they lose control over architecture and struggle to gain visibility into cloud networks. They also struggle with skills gaps and collaboration challenges. However, this most recent finding suggests that it isn't just the cloud itself that necessarily causes these problems. Instead, it's the hybridization of infrastructure, with resources spanning public and private resources, that is causing significant pain. Network teams are finding it difficult to manage across the two worlds. They lack tools and processes for architecting and operationalizing an effective hybrid cloud network. To illustrate this point, the Megatrends research asked respondents to identify the typical root cause of complex service issues that pull together war room response teams with stakeholders from multiple IT groups. In hybrid cloud enterprises, network infrastructure was more likely to be the root cause of these challenging problems.

When one thinks about it, the challenge of a hybrid environment makes perfect sense. In a company that uses only private infrastructure, network teams have long had the tools, processes, and skills required to manage such networks. Those that adopt a 100% cloud environment can adapt by embracing cloud-native technologies for building, managing and observing networks. There are countless vendors that have developed solutions that excel at supporting purely cloud networks, and cloud providers themselves have built out an ecosystem of tools to enable networks within their environments.

It's much harder to build and manage networks that span these two worlds because they are fundamentally different. In private infrastructure, the network team has administrative access and control over the underlying infrastructure, making it easier to manage networks granularly and to extract monitoring data. In the public cloud, network teams must work with APIs and abstracted services because they have no administrative access to the underlying infrastructure. Deploying tools and developing processes that span these very different architectures is fundamentally complex.

Addressing Hybrid Cloud Complexity

The Megatrends research revealed that network teams that support a hybrid cloud architecture are more likely to be investing in new network performance management tools, suggesting that they've identified gaps in how their existing tools provide end-to-end visibility into hybrid cloud networks. They are looking for tools that can provide end to end visibility. In fact, 53% of network teams who support a hybrid cloud or multi-cloud environment reported that they are trying to build out end-to-end monitoring and troubleshooting capabilities. Network teams have a variety of options here, from their legacy on-premises tools and cloud-native observability tools, to tools that focus more on digital experience monitoring than infrastructure monitoring. It remains unclear which approach is best.

"I see a lack of holistic visibility into the cloud. It's hard to have a single pane of glass when you are looking at various systems," as a network security architect at a Fortune 500 cybersecurity company recently told EMA. "We've been relying on logs. But there are not tools that are designed to give us visibility across different [public and private] clouds."

Network teams with hybrid cloud environments are also more likely to be investing in new network security solutions, suggesting that they are trying to impose consistent and effective security controls across public and private infrastructure. These network teams were also more likely to share their network management and monitoring tools with their counterparts in cybersecurity teams, suggesting that the complexity of hybrid cloud security forces more collaboration between network and security teams.

Hybrid cloud network teams are also more likely to make new investments in multi-cloud networking solutions, software-defined WAN, and data center network infrastructure, indicating that hybrid environments are demanding modernization of local and wide-area network connectivity.

In other words, hybrid cloud infrastructure simply demands more of network teams than pure private and pure cloud environments. The complexity doesn't end there. EMA also observed that companies with hybrid environments are more likely to have a mix of on-premises data centers and colocation providers comprising their private infrastructure. Research participants told us that they typically incorporate colocation data centers into their networks to support efforts to reduce their on-premises data center footprints, to enable disaster recovery and resiliency, and to deploy applications and data closer to end users and customers.

Finally, all this complexity creates a need for operational efficiency. One key enabler of that efficiency is network automation. Unfortunately, enterprises with hybrid environments were more likely than others to struggle to hire IT personnel with network automation skills. Network teams will need vendors to support them as they try to mitigate these skills gaps.

Overall, just 39% of network pros who support a hybrid cloud and/or multi-cloud architecture believe that their efforts to impose end-to-end operations have been completely successful. EMA observed two potential paths toward success:

First, network teams that have improved their ability to hire and retain skilled personnel do better with these efforts. This will require IT leadership that is willing to go the extra mile, with improved recruiting efforts, competitive compensation, and opportunities for advancement and growth.

Second, network teams do better when they minimize their reliance on tools provided by individual cloud providers to operationalize hybrid networks. Instead, they need to push their traditional tool vendors to innovate.

Listen to Episode 1 of the MEAN TIME TO INSIGHT PODCAST (MTTI): 2024 Network Management Trends

Click here for a direct MP3 download of Episode 1

Shamus McGillicuddy is VP of Research, Network Infrastructure and Operations, at Enterprise Management Associates (EMA)
Share this

The Latest

June 18, 2024

With the rise of digital transformation and the increasing reliance on applications for business operations, the need for application performance management (APM) has become more critical ... This blog explains what APM is all about, its significance and key features ...

June 17, 2024

Generative AI (GenAI) has captured significant attention by redefining content creation and automation processes. Despite this surge in GenAI's popularity, it's crucial to highlight the continuous, vital role of machine learning (ML) in underpinning crucial business functions. This era is not about GenAI replacing ML; rather, it's about these technologies collaborating to supercharge intelligent automation across industries ...

June 13, 2024

As organizations continue to navigate their digital transformation journeys, the need for efficient, secure, and scalable data movement strategies has never been more critical ... In an era when enterprise IT landscapes are continually evolving, the strategic movement of data has become a cornerstone of maintaining agility, competitive edge, and operational efficiency ...

June 12, 2024

In May, New Relic published the State of Observability for IT and Telecommunications Report to share insights, statistics, and analysis on the adoption and business value of observability for the IT and telecommunications industries. Here are five key takeaways from the report ...

June 11, 2024
Over the past decade, the pace of technological progress has reached unprecedented levels, where fads both quickly rise and shrink in popularity. From AI and composability to augmented reality and quantum computing, the toolkit of emerging technologies is continuing to expand, creating a complex set of opportunities and challenges for businesses to address. In order to keep pace with competitors, avoiding new models and ideas is not an option. It's critical for organizations to determine whether an idea has transformative properties or is just a flash in the pan — a challenge tackled in Endava's new 2024 Emerging Tech Unpacked Report ...
June 10, 2024

The rapidly evolving nature of the industry, particularly with the recent surge in generative AI, can catch firms off-guard, leaving them scrambling to adapt to new trends without the necessary funds ... This blog will discuss effective strategies for optimizing cloud expenses to free up funds for emerging AI technologies, ensuring companies can adapt and thrive without financial strain ...

June 06, 2024

Software developers are spending more than 57% of their time being dragged into "war rooms" to solve application performance issues, rather than investing their time developing new, cutting-edge software applications as part of their organization's innovation strategy, according to a new report from Cisco ...

June 05, 2024

Generative Artificial Intelligence (GenAI) is continuing to see massive adoption and expanding use cases, despite some ongoing concerns related to bias and performance. This is clear from the results of Applause's 2024 GenAI Survey, which examined how digital quality professionals use and experience GenAI technology ... Here's what we found ...

June 04, 2024

Many times customers want to know why their measured performance doesn't match the speed advertised (by the platform vendor, software vendor, network vendor, etc). Assuming the advertised speeds are (a) within the realm of physical possibility and obeys the laws of physics, and (b) are real achievable speeds and not "click-bait," there are at least ten reasons for being unable to achieve advertised speeds. In situations where customer expectations and measured performance don't align, use the following checklist to help determine the reason(s) why ...

June 03, 2024

With so many systems potentially impacting applications performance, it is critical to find ways to separate insights from data that is often white noise. When cross-functional teams have clear alignment on what KPIs matter to them and their users' experiences, they can implement tools and processes that best support them. In the end, there must be collective ownership ...