Gartner: Major Organizations Need to Grow Performance Management Skills
May 09, 2014
Share this

Agile infrastructures demand that infrastructure and operations (I&O) managers acquire the performance management skills present only in Web-scale IT, according to Gartner, Inc.

While major organizations will need to maintain and sustain their conventional capacity-planning skills and tools, they will also need to regularly re-evaluate the tools available, and make a special effort to acquire and grow the capacity and performance management skills that are rarely evident outside the Web-scale IT community.

"By 2016, the availability of capacity and performance management skills for horizontally scaled architectures will be a major constraint or risk to growth for 80 percent of major businesses," says Ian Head, research director at Gartner. "To take advantage of Web-scale IT approaches to capacity and performance management, IT architects need to fully embrace stateless application architectures and horizontally scaling infrastructure architectures."

Adding additional central processing units (CPUs), memory and storage to a monolithic server has been the traditional, vertical way of scaling up applications while capacity planning has traditionally been developed with the goal of forecasting the requirements for this vertical scaling approach. However, vertical architectures and approaches have limited scalability, making vertical architectures unsuitable for hyperscaling. For service capacity to expand seamlessly to extremely large scales, different approaches are required.

"Organizations managing such services need the ability to rapidly assign and de-assign resources to each service, as well as the ability to scale linearly and continuously as more resources are added or removed," says Head. "They also need high levels of resiliency that will allow sections of the infrastructure to fail without bringing the services down. Designing the underlying infrastructure for horizontal scalability, high degrees of fault-tolerance and rapid, incremental change is a key prerequisite for effective Web-scale operations."

To achieve the overall goal of an infrastructure in which services can consume capacity on an as-needed basis, the overall Web-scale IT capacity planning function may be divided among two teams. The application or product team develops the applications, monitors the consumption of their services in various locations and user subsets, and requests and allocates infrastructure resources based on policy-driven utilization triggers. The infrastructure team ensures that the overall shared physical limits do not constrain the performance of the individual services being continuously developed by the product teams.

Services constructed in this way are better equipped to scale geographically, and share multiple data centers with limited impact on user performance. Although extending service availability to new locations will carry additional burdens and requirements, horizontally scaling application and infrastructure architectures will generally be better equipped to scale geographically, because additional capacity may be used by the different applications, as required and as load patterns shift.

Demand Shaping

Where there are potentially large-scale, limited forecasts or demand history, IT leaders need to develop demand-shaping techniques to provide acceptable performance. Demand shaping enables finite infrastructure resources to maintain their vital always-on character with acceptable, if not consistent, performance experiences across the entire user base. Gartner predicts that through 2017, 25 percent of enterprises will use demand shaping for capacity planning and management, a significant increase from less than one percent in 2014.

When deploying large-scale services, infrastructure and operations leaders need to become proficient in operational analytics tools and big data capabilities, rather than traditional capacity planning tools.

"Traditional capacity-planning tools enable I&O organizations to gather data from various sources, including monitoring tools and, possibly, business demand forecasts, then produce trending, utilization and investment forecast information, taking into account several different scenarios," says Head. "The different architectures and the huge scale of the Web-scale IT organizations make traditional, highly focused tools of limited utility. Demand shaping requires more and different functionality than current off-the-shelf tools provide."

Although different Web-scale organizations grow and adapt their techniques to their specific requirements, a common theme is the extensive use of large volumes of operational data. Even though the infrastructures are large, the horizontal design enables clear visualization and understanding of constraints and dependencies, such that these may be managed as the environment, loads and demands change.

In general, in-memory computing and deep analytics tools are used to extract the required information from a combination of the infrastructure monitoring tools and the instrumentation built into the applications. The resulting analytical information is used to facilitate proactive, real-time and near-real-time actions to allocate resources and manage potential bottlenecks. Similar functionality is also used to model the impact of moving workloads and to simulate the effects of potential infrastructure and application changes.

The outcome is that Web-scale enterprises have developed a set of tools, practices and capabilities that enable real-time demand shaping. These operational skills and tools are unique to each Web-scale organization and so are not yet available in most end-user enterprises.

"Much of the art of achieving always-on, scalable, rapidly changing, high-performance services is a consequence of the advanced use of homegrown and customized analytics and tools by the application and infrastructure teams," Head concludes. "These are used to shape demand in real time and to produce forward-looking capacity and investment plans to an acceptable degree of accuracy."

Related Links:

Gartner analysts will take a deeper look at the outlook for IT operations trends at the Gartner IT Infrastructure & Operations Management Summit taking place June 2-3 in Berlin and June 9-11 in Orlando FL.

Share this

The Latest

March 27, 2024

Nearly all (99%) globa IT decision makers, regardless of region or industry, recognize generative AI's (GenAI) transformative potential to influence change within their organizations, according to The Elastic Generative AI Report ...

March 27, 2024

Agent-based approaches to real user monitoring (RUM) simply do not work. If you are pitched to install an "agent" in your mobile or web environments, you should run for the hills ...

March 26, 2024

The world is now all about end-users. This paradigm of focusing on the end-user was simply not true a few years ago, as backend metrics generally revolved around uptime, SLAs, latency, and the like. DevOps teams always pitched and presented the metrics they thought were the most correlated to the end-user experience. But let's be blunt: Unless there was an egregious fire, the correlated metrics were super loose or entirely false ...

March 25, 2024

This year, New Relic published the State of Observability for Financial Services and Insurance Report to share insights derived from the 2023 Observability Forecast on the adoption and business value of observability across the financial services industry (FSI) and insurance sectors. Here are seven key takeaways from the report ...

March 22, 2024

In MEAN TIME TO INSIGHT Episode 4 - Part 2, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at Enterprise Management Associates (EMA) discusses artificial intelligence and AIOps ...

March 21, 2024

In the course of EMA research over the last twelve years, the message for IT organizations looking to pursue a forward path in AIOps adoption is overall a strongly positive one. The benefits achieved are growing in diversity and value ...

March 20, 2024

Today, as enterprises transcend into a new era of work, surpassing the revolution, they must shift their focus and strategies to thrive in this environment. Here are five key areas that organizations should prioritize to strengthen their foundation and steer themselves through the ever-changing digital world ...

March 19, 2024

If there's one thing we should tame in today's data-driven marketing landscape, this would be data debt, a silent menace threatening to undermine all the trust you've put in the data-driven decisions that guide your strategies. This blog aims to explore the true costs of data debt in marketing operations, offering four actionable strategies to mitigate them through enhanced marketing observability ...

March 18, 2024

Gartner has highlighted the top trends that will impact technology providers in 2024: Generative AI (GenAI) is dominating the technical and product agenda of nearly every tech provider ...

March 15, 2024

In MEAN TIME TO INSIGHT Episode 4 - Part 1, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at Enterprise Management Associates (EMA) discusses artificial intelligence and network management ...