The Two Big I/O Taxes in Virtualized Environments
September 09, 2015

Brian Morin
Condusiv Technologies

Share this

When organizations virtualize, they typically overrun the I/O capabilities of the underlying storage infrastructure and aren't able to scale the virtual infrastructure as far as they would like. Instead of asking "why" and getting to the root of the problem of performance bottlenecks, they typically run blindly into an expensive rip-and-replace of the SAN architecture to create more I/O overhead and try to "flash" their way out of performance issues. More recently, administrators have begun to discover you can't "flash" your way out of virtual machine (VM) performance issues without overspending on hardware if you ignore the two big I/O taxes in a virtual environment that inflates IOPS (Input/Output Operations per Second) requirements and steals bandwidth from server to storage.

The two big performance penalties in virtualized environments to be aware of are the "Windows I/O tax" and the "I/O blender" tax. No matter how many spindles or how much flash is added to the infrastructure, much of that performance is ultimately robbed due to I/O characteristics that are much smaller, more fractured, and more random than it needs to be and that steals up to 50% available throughput from server to storage.

Small, Fractured I/O Tax

As the most virtualized operating system, Windows suffers from free space allocation inefficiencies at the logical disk layer that inflates the IOPS requirements for any given workload as the relationship between I/O and data begins to break down over time. This occurs because when Windows NTFS writes data in a SAN storage environment, file allocations become unnecessarily fractured across different addresses at the logical disk layer, resulting in every piece of the file requiring its own I/O operation to process. Instead of carrying an optimal amount of data with every I/O request, a single file may take multiple I/O to process instead of single I/O had Windows first employed intelligence about choosing the best allocation instead of the next available allocation. Consequently, this results in the first I/O tax: I/O that is smaller and more fractured than necessary.

It's not just every write that is subsequently penalized, but every subsequent read as well. It is common for a 32K file to be efficiently processed with a single I/O on day one when a file system is fresh and new, but as time goes on as files are re-written, erased and extended, I/O density suffers and ultimately systems require four 8K I/O operations or eight 4K I/O operations to process the whole 32K file. More fractured environments will experience hundreds of I/O operations to process a single file which is akin to pouring molasses on systems.

"I/O Blender" Tax

The second tax is that of the "I/O blender." This tax occurs when mixing multiple VMs on one server, and then connecting those various servers to shared storage. The result is a highly random I/O stream that diminishes the entire virtualized environment.

To understand this, think about the consequence of disparate VMs sharing a single host, routing otherwise sequential I/O traffic to the hypervisor where those I/O streams become "blended." The resulting random I/O pattern then gets sent to storage, which further dampens storage performance.

Clearly, while it hurts systems to be taxed with small, fractured I/O from Windows due to free space allocation inefficiences, it's even more damaging to take all that small, fractured I/O and randomize those I/O streams when they become mixed at the hypervisor. When virtualized organizations hit an I/O ceiling that requires higher performance than the company's storage infrastructure can deliver, administrators commonly think they need to buy more IOPS, when in fact the Windows I/O tax and the "I/O blender" effect has robbed throughput, making systems more IOPS intensive than they need to be. By focusing on trying to solve the root of I/O inefficiencies first, organizations can get to the bottom of the real issue that's wasting their current and future hardware resources.

A Better Solution

As an alternative solution, these I/O inefficiencies can be easily remedied by using I/O reduction software that targets the root cause problem so administrators get the most performance possible from their hardware infrastructure after virtualizing. Today's software has been shown to result in up to 300 percent faster application performance on existing systems. By optimizing the I/O profile, software intelligence can increase I/O density and sequential writes and subsequent reads while also leveraging available DRAM to target the I/O the steals the most bandwidth from VM to storage – small, random I/O. This reduces latency and frees the infrastructure from performance-diminishing I/O.

This approach not only protects a company's investment in its existing hardware infrastructure, but it also solves performance bottlenecks without disruption and ensures organizations can maximize future storage system investment. In short, I/O optimization software can more effectively solve the application performance issues for virtualized environments — without requiring any new hardware.

Brian Morin is SVP Global Marketing at Condusiv Technologies
Share this

The Latest

April 19, 2024

In MEAN TIME TO INSIGHT Episode 5, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses the network source of truth ...

April 18, 2024

A vast majority (89%) of organizations have rapidly expanded their technology in the past few years and three quarters (76%) say it's brought with it increased "chaos" that they have to manage, according to Situation Report 2024: Managing Technology Chaos from Software AG ...

April 17, 2024

In 2024 the number one challenge facing IT teams is a lack of skilled workers, and many are turning to automation as an answer, according to IT Trends: 2024 Industry Report ...

April 16, 2024

Organizations are continuing to embrace multicloud environments and cloud-native architectures to enable rapid transformation and deliver secure innovation. However, despite the speed, scale, and agility enabled by these modern cloud ecosystems, organizations are struggling to manage the explosion of data they create, according to The state of observability 2024: Overcoming complexity through AI-driven analytics and automation strategies, a report from Dynatrace ...

April 15, 2024

Organizations recognize the value of observability, but only 10% of them are actually practicing full observability of their applications and infrastructure. This is among the key findings from the recently completed Logz.io 2024 Observability Pulse Survey and Report ...

April 11, 2024

Businesses must adopt a comprehensive Internet Performance Monitoring (IPM) strategy, says Enterprise Management Associates (EMA), a leading IT analyst research firm. This strategy is crucial to bridge the significant observability gap within today's complex IT infrastructures. The recommendation is particularly timely, given that 99% of enterprises are expanding their use of the Internet as a primary connectivity conduit while facing challenges due to the inefficiency of multiple, disjointed monitoring tools, according to Modern Enterprises Must Boost Observability with Internet Performance Monitoring, a new report from EMA and Catchpoint ...

April 10, 2024

Choosing the right approach is critical with cloud monitoring in hybrid environments. Otherwise, you may drive up costs with features you don’t need and risk diminishing the visibility of your on-premises IT ...

April 09, 2024

Consumers ranked the marketing strategies and missteps that most significantly impact brand trust, which 73% say is their biggest motivator to share first-party data, according to The Rules of the Marketing Game, a 2023 report from Pantheon ...

April 08, 2024

Digital experience monitoring is the practice of monitoring and analyzing the complete digital user journey of your applications, websites, APIs, and other digital services. It involves tracking the performance of your web application from the perspective of the end user, providing detailed insights on user experience, app performance, and customer satisfaction ...

April 04, 2024
Modern organizations race to launch their high-quality cloud applications as soon as possible. On the other hand, time to market also plays an essential role in determining the application's success. However, without effective testing, it's hard to be confident in the final product ...