The Two Big I/O Taxes in Virtualized Environments
September 09, 2015

Brian Morin
Condusiv Technologies

Share this

When organizations virtualize, they typically overrun the I/O capabilities of the underlying storage infrastructure and aren't able to scale the virtual infrastructure as far as they would like. Instead of asking "why" and getting to the root of the problem of performance bottlenecks, they typically run blindly into an expensive rip-and-replace of the SAN architecture to create more I/O overhead and try to "flash" their way out of performance issues. More recently, administrators have begun to discover you can't "flash" your way out of virtual machine (VM) performance issues without overspending on hardware if you ignore the two big I/O taxes in a virtual environment that inflates IOPS (Input/Output Operations per Second) requirements and steals bandwidth from server to storage.

The two big performance penalties in virtualized environments to be aware of are the "Windows I/O tax" and the "I/O blender" tax. No matter how many spindles or how much flash is added to the infrastructure, much of that performance is ultimately robbed due to I/O characteristics that are much smaller, more fractured, and more random than it needs to be and that steals up to 50% available throughput from server to storage.

Small, Fractured I/O Tax

As the most virtualized operating system, Windows suffers from free space allocation inefficiencies at the logical disk layer that inflates the IOPS requirements for any given workload as the relationship between I/O and data begins to break down over time. This occurs because when Windows NTFS writes data in a SAN storage environment, file allocations become unnecessarily fractured across different addresses at the logical disk layer, resulting in every piece of the file requiring its own I/O operation to process. Instead of carrying an optimal amount of data with every I/O request, a single file may take multiple I/O to process instead of single I/O had Windows first employed intelligence about choosing the best allocation instead of the next available allocation. Consequently, this results in the first I/O tax: I/O that is smaller and more fractured than necessary.

It's not just every write that is subsequently penalized, but every subsequent read as well. It is common for a 32K file to be efficiently processed with a single I/O on day one when a file system is fresh and new, but as time goes on as files are re-written, erased and extended, I/O density suffers and ultimately systems require four 8K I/O operations or eight 4K I/O operations to process the whole 32K file. More fractured environments will experience hundreds of I/O operations to process a single file which is akin to pouring molasses on systems.

"I/O Blender" Tax

The second tax is that of the "I/O blender." This tax occurs when mixing multiple VMs on one server, and then connecting those various servers to shared storage. The result is a highly random I/O stream that diminishes the entire virtualized environment.

To understand this, think about the consequence of disparate VMs sharing a single host, routing otherwise sequential I/O traffic to the hypervisor where those I/O streams become "blended." The resulting random I/O pattern then gets sent to storage, which further dampens storage performance.

Clearly, while it hurts systems to be taxed with small, fractured I/O from Windows due to free space allocation inefficiences, it's even more damaging to take all that small, fractured I/O and randomize those I/O streams when they become mixed at the hypervisor. When virtualized organizations hit an I/O ceiling that requires higher performance than the company's storage infrastructure can deliver, administrators commonly think they need to buy more IOPS, when in fact the Windows I/O tax and the "I/O blender" effect has robbed throughput, making systems more IOPS intensive than they need to be. By focusing on trying to solve the root of I/O inefficiencies first, organizations can get to the bottom of the real issue that's wasting their current and future hardware resources.

A Better Solution

As an alternative solution, these I/O inefficiencies can be easily remedied by using I/O reduction software that targets the root cause problem so administrators get the most performance possible from their hardware infrastructure after virtualizing. Today's software has been shown to result in up to 300 percent faster application performance on existing systems. By optimizing the I/O profile, software intelligence can increase I/O density and sequential writes and subsequent reads while also leveraging available DRAM to target the I/O the steals the most bandwidth from VM to storage – small, random I/O. This reduces latency and frees the infrastructure from performance-diminishing I/O.

This approach not only protects a company's investment in its existing hardware infrastructure, but it also solves performance bottlenecks without disruption and ensures organizations can maximize future storage system investment. In short, I/O optimization software can more effectively solve the application performance issues for virtualized environments — without requiring any new hardware.

Brian Morin is SVP Global Marketing at Condusiv Technologies
Share this

The Latest

June 25, 2020

I've had the opportunity to work with a number of organizations embarking on their AIOps journey. I always advise them to start by evaluating their needs and the possibilities AIOps can bring to them through five different levels of AIOps maturity. This is a strategic approach that allows enterprises to achieve complete automation for long-term success ...

June 24, 2020

Sumo Logic recently commissioned an independent market research study to understand the industry momentum behind continuous intelligence — and the necessity for digital organizations to embrace a cloud-native, real-time continuous intelligence platform to support the speed and agility of business for faster decision-making, optimizing security, driving new innovation and delivering world-class customer experiences. Some of the key findings include ...

June 23, 2020

When it comes to viruses, it's typically those of the computer/digital variety that IT is concerned about. But with the ongoing pandemic, IT operations teams are on the hook to maintain business functions in the midst of rapid and massive change. One of the biggest challenges for businesses is the shift to remote work at scale. Ensuring that they can continue to provide products and services — and satisfy their customers — against this backdrop is challenging for many ...

June 22, 2020

Teams tasked with developing and delivering software are under pressure to balance the business imperative for speed with high customer expectations for quality. In the course of trying to achieve this balance, engineering organizations rely on a variety of tools, techniques and processes. The 2020 State of Software Quality report provides a snapshot of the key challenges organizations encounter when it comes to delivering quality software at speed, as well as how they are approaching these hurdles. This blog introduces its key findings ...

June 18, 2020

For IT teams, run-the-business, commodity areas such as employee help desks, device support and communication platforms are regularly placed in the crosshairs for cost takeout, but these areas are also highly visible to employees. Organizations can improve employee satisfaction and business performance by building unified functions that are measured by employee experience rather than price. This approach will ultimately fund transformation, as well as increase productivity and innovation ...

June 17, 2020

In the agile DevOps framework, there is a vital piece missing; something that previous approaches to application development did well, but has since fallen by the wayside. That is, the post-delivery portion of the toolchain. Without continuous cloud optimization, the CI/CD toolchain still produces massive inefficiencies and overspend ...

June 16, 2020

The COVID-19 pandemic has exponentially accelerated digital transformation projects. To better understand where IT professionals are turning for help, we analyzed the online behaviors of IT decision-makers. Our research found an increase in demand for resources related to APM, microservices and dependence on cloud services ...

June 15, 2020

The rush to the public cloud has now slowed as organizations realized that it is not a "one size fits all" solution. The main issue is the lack of deep visibility into the performance of applications provided by the host. Our own research has recently revealed that 32% of public cloud resources are currently under-utilized, and without proper direction and guidance, this will remain the case ...

June 11, 2020

The global shift to working from home (WFH) enforced by COVID-19 stay-at-home orders has had a massive impact on everyone's working lives, not just in the way they remotely interact with their teams and IT systems, but also in how they spend their working days. With both governments and businesses committed to slowly opening up offices, it's increasingly clear that a high prevalence of remote work will continue throughout 2020 and beyond. This situation begets important questions ...

June 10, 2020
In recent years, with the emergence of newer technologies ranging from the cloud to machine learning, IT modernization has evolved from a replacement of end-of-life infrastructure to an enabler of innovation and business value. It is a complex process that can take months or even years, but a recent survey shows that the effort begins to deliver measurable results almost as soon as an organization executes the first steps on its roadmap ...