Why is Latency Still a Network Headache?
February 26, 2018

Chris Bloom
Savvius

Share this

It wasn't so long ago that enterprises housed their critical business applications within their own network of servers and client computers. Monitoring and troubleshooting performance issues like latency was far easier. So, even though our network monitoring and diagnostics tools have improved greatly, the introduction of a myriad interconnected SaaS applications and cloud hosted services have greatly complicated our typical network landscape, causing knock-on effects like latency to appear.

As enterprises outsource more and more of their applications and data hosting to external vendors, they introduce more weak links into the network

As enterprises outsource more and more of their applications and data hosting to external vendors, they introduce more weak links into the network. SaaS services are generally reliable, but without a dedicated connection they can only be as good as the internet connection they're using.

From a network management perspective, the secondary issue with externally hosted apps and services is that the IT team has far less control and visibility, making it more difficult to keep vendors honest about meeting their service level agreements (SLAs).

Monitoring and troubleshooting the network traffic within the relatively controlled environment of an enterprise headquarters is manageable for most IT teams. But for organizations built on a distributed business model with multiple branch offices or remote workers, using dedicated MPLS lines quickly becomes cost prohibitive. When you consider that the traffic from applications like Salesforce, Slack, Office 365, Citrix and others typically bypasses HQ, it's not surprising that latency is becoming more common and increasingly difficult to troubleshoot.

One of the first casualties of latency is VoIP call quality, which manifests as unnatural delays in phone conversations. With the explosive growth of VoIP and other UCaaS applications, this problem will continue to grow. Another area where latency takes its toll is in data transfer speeds. This can lead to a series of cascading problems, particularly when large data files or medical records are being transferred or copied from one location to another. Latency can be an issue for large data transactions like database replication, too, requiring more time to carry out routine activities.

The Impact of Distributed Networks and SaaS

Enterprise network performance monitoring needs to shift out of the data center

With so many connections to the internet from so many locations, it makes sense that enterprise network performance monitoring needs to shift out of the data center. One of the best approaches is to find tools that monitor the connection at all of their remote locations. Most of us use applications like Outlook, Word and Excel on an almost daily basis. If we're using Office 365, these applications are probably configured to connect to Azure rather than the enterprise data center. If the IT team doesn't actively monitor network performance directly at the branch office, then they completely lose sight of the user experience at that location. They may think that the network is performing well, when in fact the users are being frustrated by an undiagnosed problem.

When traffic from SaaS vendors and other cloud-based storage providers travels to and from an organization, it can be impacted by jitter, trace route and sometimes compute speed, meaning that latency becomes a very serious possibility for end users and customers. Working with vendors who have a physical footprint close to where the data is needed is one way to minimize potential issues caused by distance. But even in a parallel process, you may have thousands or millions of connections trying to get through at once, causing a tiny delay. Those delays build up and become much worse over long distances.

Is Machine Learning the Answer?

We've all heard about the power of AI and machine learning to help automate aspects of network management, but it's even difficult for these cutting-edge tools to minimize latency. The problem stems from the fact that we cannot accurately predict when a switch or router will become overloaded with traffic. The delay may be just a millisecond or a hundred milliseconds at most, but once a piece of equipment is overloaded, the data gets stuck in a queue until it can be processed. Is machine learning the answer? Maybe, but we're not there yet.

Take the Broad, Narrow Approaches

Despite all the benefits of SaaS solutions, latency will continue to be a challenge unless corporate IT teams rethink their approach to network management. In a nutshell, they need to take a broad, decentralized approach to network monitoring that encompasses the entire network and all its branch locations. And they need to find better ways of monitoring and improving true end-user experience. Once they understand what users are experiencing, in real time, they will see – and hopefully fix – severe latency issues before end users even realize there was a problem.

Chris Bloom is Senior Manager of Technical Alliances at Savvius
Share this

The Latest

July 08, 2020

Every business has the responsibility to do their part against climate change by reducing their carbon footprint while increasing sustainability and efficiency. Harnessing optimization of IT infrastructure is one method companies can use to reduce carbon footprint, improve sustainability and increase business efficiency, while also keeping costs down ...

July 07, 2020

While the adoption of continuous integration (CI) is on the rise, software engineering teams are unable to take a zero-tolerance approach to software failures, costing enterprise organizations billions annually, according to a quantitative study conducted by Undo and a Cambridge Judge Business School MBA project ...

June 25, 2020

I've had the opportunity to work with a number of organizations embarking on their AIOps journey. I always advise them to start by evaluating their needs and the possibilities AIOps can bring to them through five different levels of AIOps maturity. This is a strategic approach that allows enterprises to achieve complete automation for long-term success ...

June 24, 2020

Sumo Logic recently commissioned an independent market research study to understand the industry momentum behind continuous intelligence — and the necessity for digital organizations to embrace a cloud-native, real-time continuous intelligence platform to support the speed and agility of business for faster decision-making, optimizing security, driving new innovation and delivering world-class customer experiences. Some of the key findings include ...

June 23, 2020

When it comes to viruses, it's typically those of the computer/digital variety that IT is concerned about. But with the ongoing pandemic, IT operations teams are on the hook to maintain business functions in the midst of rapid and massive change. One of the biggest challenges for businesses is the shift to remote work at scale. Ensuring that they can continue to provide products and services — and satisfy their customers — against this backdrop is challenging for many ...

June 22, 2020

Teams tasked with developing and delivering software are under pressure to balance the business imperative for speed with high customer expectations for quality. In the course of trying to achieve this balance, engineering organizations rely on a variety of tools, techniques and processes. The 2020 State of Software Quality report provides a snapshot of the key challenges organizations encounter when it comes to delivering quality software at speed, as well as how they are approaching these hurdles. This blog introduces its key findings ...

June 18, 2020

For IT teams, run-the-business, commodity areas such as employee help desks, device support and communication platforms are regularly placed in the crosshairs for cost takeout, but these areas are also highly visible to employees. Organizations can improve employee satisfaction and business performance by building unified functions that are measured by employee experience rather than price. This approach will ultimately fund transformation, as well as increase productivity and innovation ...

June 17, 2020

In the agile DevOps framework, there is a vital piece missing; something that previous approaches to application development did well, but has since fallen by the wayside. That is, the post-delivery portion of the toolchain. Without continuous cloud optimization, the CI/CD toolchain still produces massive inefficiencies and overspend ...

June 16, 2020

The COVID-19 pandemic has exponentially accelerated digital transformation projects. To better understand where IT professionals are turning for help, we analyzed the online behaviors of IT decision-makers. Our research found an increase in demand for resources related to APM, microservices and dependence on cloud services ...

June 15, 2020

The rush to the public cloud has now slowed as organizations realized that it is not a "one size fits all" solution. The main issue is the lack of deep visibility into the performance of applications provided by the host. Our own research has recently revealed that 32% of public cloud resources are currently under-utilized, and without proper direction and guidance, this will remain the case ...