3 Essentials for Agile Operations
June 23, 2015

Pete Waterhouse
CA Technologies

Share this

For decades IT operations has been viewed as something of a back-office technology function; the IT engine room. That’s not wrong since the applications under control have generally been large monolithic systems of record designed to automate internal business processes. These systems have been inherently complex and tightly-coupled, so changing them has been difficult, time consuming and costly. As such, our operational mindset has remained firmly focused on maintaining reliability and avoiding risk at all costs – even if that means holding back releases and ticking off our colleagues in development.

Not anymore.

Now, business success is not only dependent on assuring the reliability of internal business processes, but also by leveraging mobile computing and the cloud for more ‘experience-centric’ customer engagement. Now, software has the potential to forge new business models and disrupt markets, meaning change intolerance and aversion makes way to experimentation and innovation. The net-net of course is faster more iterative application development, newer highly scalable architectures, and a far more diverse set of applications – some of which will be standalone, while others will be integrated within our existing business process fabric.

So against this backdrop, what are main reasons the IT operations discipline must adapt to support the application-driven imperatives of the business and what characterizes a successful agile operations transformation? It boils down to delivering on three essential requirements – speed, quality and scale.

In Pursuit of Quality

Since the applications now being developed are far more customer-centric, service quality will be assessed at many more points of engagement. Consider a web/mobile airline booking system for example. This might be comprised of ten or more discrete services (e.g. booking flight, checking baggage, choosing seats, ordering meal, scanning boarding pass, car rental etc.). Every one of which constitutes a point of interaction where quality in the form of an optimum experience has a direct correlation to customer retention and business gain.

The traditional approach would be to wait for each of these applications to reach production and then initiate monitoring. Yet this is problematic since any problems now have a significantly greater impact on the business and in all likelihood will require developers to fix them. The result – greater conflict, more technical debt and lost business.

A far more agile approach is to incorporate monitoring earlier in the software development lifecycle. This involves collaborating with development to replicate the deep analytics and traceability insights normally gained in production and applying them in a development and testing context. Through this, the immediate gain is stopping defects leaking into production, but there are more lasting benefits too.

Firstly, development has much earlier visibility into quality requirements before the system goes live and can enact any necessary refactoring strategies.

Secondly, key insights gained through transaction monitoring can be shared with the operations team, so they can immediately establish metrics and performance KPI’s against which the production environment can be measured.

Finally, and in true DevOps fashion, this approach creates tighter feedback loops so that everyone knows who the app is serving, what experience is expected, and where changes impact performance – continuously.

The Need for Speed

With business now being driven by a complex mix of highly experiential software services, it’s essential that any problems are detected and resolved at a pace that matches the speed of delivery. This however is difficult because monitoring systems generally lack the ability to provide uninterrupted transaction level visibility.

Some toolsets for example provide rich mobile analytics (usage, behavior, crashes) which is all great. But what happens when the success of a new national mobile app based sales promotion depends on the successful recording against a backend database and requires no network latency at peak times. Without end-to-end visibility that can follow transactions across all apps and infrastructure and that provides insight into the underlying causes for failure, no realistic service levels can be established with the business.

Scaling the Summit

Embracing newer horizontally scalable architectures is the way leading innovators are future proofing their businesses. Combined with microservice style development these architectures facilitate more rapid deployment of independent business services. Services that truly harness the cloud by dynamically scaling resources.

Taking advantage of this means monitoring must become equally future proof by scaling in tandem. However attractive from an architectural perspective, these applications will introduce greater complexity, more interdependencies, newer tech like NoSQL and document-based data stores (e.g. Cassandra and MongoDB) and initiate complex system behaviors due to their highly distributed nature.

The old approach of teams maintaining their own sets of specialized diagnostic tools over infrastructure that falls within their own silo is no longer sustainable. Now, more unified monitoring approaches must provide cross-functional teams with fast visual comprehension to reveal what matters versus what can and should be ignored. Additionally, change analysis to more rapidly isolate problems increases in importance, since the resources underpinning cloud-native applications will unexpectedly shift based on demand, cost and lifecycle.

New applications and architectures supporting more transformative digital business demand IT operations must become as agile as development.

Pete Waterhouse is Senior Strategist at CA Technologies
Share this

The Latest

May 26, 2022

Site reliability engineers are development-focused IT professionals who work on developing and implementing solutions that solve reliability, availability, and scale problems. On the other hand, DevOps engineers are ops-focused workers who solve development pipeline problems. While there is a divide between the two professions, both sets of engineers cross the gap regularly, delivering their expertise and opinions to the other side and vice versa ...

May 25, 2022

Site reliability engineering (SRE) is fast becoming an essential aspect of modern IT operations, particularly in highly scaled, big data environments. As businesses and industries shift to the digital and embrace new IT infrastructures and technologies to remain operational and competitive, the need for a new approach for IT teams to find and manage the balance between launching new systems and features and ensuring these are intuitive, reliable, and friendly for end users has intensified as well ...

May 24, 2022

The most sophisticated observability practitioners (leaders) are able to cut downtime costs by 90%, from an estimated $23.8 million annually to just $2.5 million, compared to observability beginners, according to the State of Observability 2022 from Splunk in collaboration with the Enterprise Strategy Group. What's more, leaders in observability are more innovative and more successful at achieving digital transformation outcomes and other initiatives ...

May 23, 2022

Programmatically tracked service level indicators (SLIs) are foundational to every site reliability engineering practice. When engineering teams have programmatic SLIs in place, they lessen the need to manually track performance and incident data. They're also able to reduce manual toil because our DevOps teams define the capabilities and metrics that define their SLI data, which they collect automatically — hence "programmatic" ...

May 19, 2022

Recently, a regional healthcare organization wanted to retire its legacy monitoring tools and adopt AIOps. The organization asked Windward Consulting to implement an AIOps strategy that would help streamline its outdated and unwieldy IT system management. Our team's AIOps implementation process helped this client and can help others in the industry too. Here's what my team did ...

May 18, 2022

You've likely heard it before: every business is a digital business. However, some businesses and sectors digitize more quickly than others. Healthcare has traditionally been on the slower side of digital transformation and technology adoption, but that's changing. As healthcare organizations roll out innovations at increasing velocity, they must build a long-term strategy for how they will maintain the uptime of their critical apps and services. And there's only one tool that can ensure this continuous availability in our modern IT ecosystems. AIOps can help IT Operations teams ensure the uptime of critical apps and services ...

May 17, 2022

Between 2012 to 2015 all of the hyperscalers attempted to use the legacy APM solutions to improve their own visibility. To no avail. The problem was that none of the previous generations of APM solutions could match the scaling demand, nor could they provide interoperability due to their proprietary and exclusive agentry ...

May 16, 2022

The DevOps journey begins by understanding a team's DevOps flow and identifying precisely what tasks deliver the best return on engineers' time when automated. The rest of this blog will help DevOps team managers by outlining what jobs can — and should be automated ...

May 12, 2022

A survey from Snow Software polled more than 500 IT leaders to determine the current state of cloud infrastructure. Nearly half of the IT leaders who responded agreed that cloud was critical to operations during the pandemic with the majority deploying a hybrid cloud strategy consisting of both public and private clouds. Unsurprisingly, over the last 12 months, the majority of respondents had increased overall cloud spend — a substantial increase over the 2020 findings ...

May 11, 2022

As we all know, the drastic changes in the world have caused the workforce to take a hybrid approach over the last two years. A lot of that time, being fully remote. With the back and forth between home and office, employees need ways to stay productive and access useful information necessary to complete their daily work. The ability to obtain a holistic view of data relevant to the user and get answers to topics, no matter the worker's location, is crucial for a successful and efficient hybrid working environment ...