Why is Latency Still a Network Headache?
February 26, 2018

Chris Bloom
Savvius

Share this

It wasn't so long ago that enterprises housed their critical business applications within their own network of servers and client computers. Monitoring and troubleshooting performance issues like latency was far easier. So, even though our network monitoring and diagnostics tools have improved greatly, the introduction of a myriad interconnected SaaS applications and cloud hosted services have greatly complicated our typical network landscape, causing knock-on effects like latency to appear.

As enterprises outsource more and more of their applications and data hosting to external vendors, they introduce more weak links into the network

As enterprises outsource more and more of their applications and data hosting to external vendors, they introduce more weak links into the network. SaaS services are generally reliable, but without a dedicated connection they can only be as good as the internet connection they're using.

From a network management perspective, the secondary issue with externally hosted apps and services is that the IT team has far less control and visibility, making it more difficult to keep vendors honest about meeting their service level agreements (SLAs).

Monitoring and troubleshooting the network traffic within the relatively controlled environment of an enterprise headquarters is manageable for most IT teams. But for organizations built on a distributed business model with multiple branch offices or remote workers, using dedicated MPLS lines quickly becomes cost prohibitive. When you consider that the traffic from applications like Salesforce, Slack, Office 365, Citrix and others typically bypasses HQ, it's not surprising that latency is becoming more common and increasingly difficult to troubleshoot.

One of the first casualties of latency is VoIP call quality, which manifests as unnatural delays in phone conversations. With the explosive growth of VoIP and other UCaaS applications, this problem will continue to grow. Another area where latency takes its toll is in data transfer speeds. This can lead to a series of cascading problems, particularly when large data files or medical records are being transferred or copied from one location to another. Latency can be an issue for large data transactions like database replication, too, requiring more time to carry out routine activities.

The Impact of Distributed Networks and SaaS

Enterprise network performance monitoring needs to shift out of the data center

With so many connections to the internet from so many locations, it makes sense that enterprise network performance monitoring needs to shift out of the data center. One of the best approaches is to find tools that monitor the connection at all of their remote locations. Most of us use applications like Outlook, Word and Excel on an almost daily basis. If we're using Office 365, these applications are probably configured to connect to Azure rather than the enterprise data center. If the IT team doesn't actively monitor network performance directly at the branch office, then they completely lose sight of the user experience at that location. They may think that the network is performing well, when in fact the users are being frustrated by an undiagnosed problem.

When traffic from SaaS vendors and other cloud-based storage providers travels to and from an organization, it can be impacted by jitter, trace route and sometimes compute speed, meaning that latency becomes a very serious possibility for end users and customers. Working with vendors who have a physical footprint close to where the data is needed is one way to minimize potential issues caused by distance. But even in a parallel process, you may have thousands or millions of connections trying to get through at once, causing a tiny delay. Those delays build up and become much worse over long distances.

Is Machine Learning the Answer?

We've all heard about the power of AI and machine learning to help automate aspects of network management, but it's even difficult for these cutting-edge tools to minimize latency. The problem stems from the fact that we cannot accurately predict when a switch or router will become overloaded with traffic. The delay may be just a millisecond or a hundred milliseconds at most, but once a piece of equipment is overloaded, the data gets stuck in a queue until it can be processed. Is machine learning the answer? Maybe, but we're not there yet.

Take the Broad, Narrow Approaches

Despite all the benefits of SaaS solutions, latency will continue to be a challenge unless corporate IT teams rethink their approach to network management. In a nutshell, they need to take a broad, decentralized approach to network monitoring that encompasses the entire network and all its branch locations. And they need to find better ways of monitoring and improving true end-user experience. Once they understand what users are experiencing, in real time, they will see – and hopefully fix – severe latency issues before end users even realize there was a problem.

Chris Bloom is Senior Manager of Technical Alliances at Savvius
Share this

The Latest

September 21, 2018

The performance gap between customer experience leaders and runners-up is widening, with those on top being disproportionately rewarded. Gartner said organizations must ignore three myths in order to achieve a superior customer experience ...

September 19, 2018

This summer marked three years since Microsoft announced Windows 10, its first "Windows as a service" Operating System (OS). Windows 10 brought with it a new Software-as-a-Service-like approach to updates, moving Microsoft and the millions of environments that depend on it, more frequent, bundled updates. Whether you believe the shift was for better or worse, one thing is certain, this "as a service" model is a natural progression for today's operating systems. That is why Windows 10 is changing not only how frequently updates are pushed out, but inherently how technology is purchased, how people consume it, and perhaps most importantly, how IT is run. Let's take a look at how Windows 10 has impacted these three key areas over the past three years ...

September 18, 2018

To celebrate IT Professionals Day 2018 (this year on September 18), the SolarWinds IT Pro Day 2018: A World Powered by Tech Pros survey explores a "Tech PROactive" world where technology professionals have the time, resources, and ability to use their technology prowess to do absolutely anything ...

September 17, 2018

Are digital war rooms obsolete because they're just a place for managers of siloed business units to find someone else to blame for a critical IT event such as a security breach? Far from it. Enterprises find these emergency response teams just as important, if not more important, than ever ...

September 14, 2018

The goal of EMA's latest research was to look at how advanced IT analytics (AIA) — EMA's term for primarily what today is best known as "AIOps" — is being deployed. Here are the remaining four of my seven personal takeaways ...

September 13, 2018

OK, the data is in! The goal of EMA's latest research was to look at how advanced IT analytics (AIA) — or EMA's term for primarily what today is best known as "AIOps" — is being deployed. Here are seven of my own personal takeaways ...

September 12, 2018

By maximizing the knowledge of end-to-end quality of service (QoS) using virtualized network functions (VNFs), the SD-WAN (edge) gateway establishes a suitable connection with minimal latency and maximum performance so that entire organizations can make the most of the Office 365 application suite ...

September 11, 2018

Market exuberance for Office 365 has inspired business mandates to adopt the cloud-hosted collaboration and productivity suite without regards to the underlying chaos. While multi-location organizations are virtualizing, operating models haven’t necessarily changed. This partial transformation that excludes automation and simplification of the network puts Office 365 deployments (and other software-as-a-service offerings) in danger of failing ...

September 10, 2018

Most organizations are undergoing a digital transformation that directly impacts how they do business, yet 70 percent of employees have not mastered the skills they need for their jobs today, and 80 percent of employees do not have the skills needed for their current and future roles, according to Gartner ...

September 06, 2018

In a survey within the VMware User Group community, Blue Medora took a closer look at how various metric collection strategies and access to Dimensional Data impacts IT success. We started with one question: How important is your monitoring integration strategy? ...