Years from now, the development community could look back and view this period as the beginning of a golden era, thanks in part to the embrace by business managers of site reliability engineering (SRE).
SRE has quickly become a mainstay of modern software development at some of the most scalable and reliable services on the planet, including Airbnb, Netflix and Google — the last of which kicked off the global discussion and adoption of SRE. The leading edge development practices and principles core to SRE grew out of the need to produce more reliable and resilient sites that were better performing and more secure — all the while they reduced the costs and the public opprobrium associated with outages and security breaches.
Despite that success, a recent survey of 450 site reliability engineers reveals that adoption of SRE at many companies is often stalled by a range of challenges that include the following:
■ The plodding pace at some stages of SRE evolution.
■ Confusion about which service-level objective (SLO) should be considered to measure success.
■ Automation that still requires large chunks of time from site reliability engineers (SREs) to create and maintain code.
■ Lack of vital resources, such as observability tools.
SRE Has Won Over Numerous Companies
Overall, the climate surrounding SRE is extremely positive. Many companies have embraced SRE practices, the survey indicates. Nearly 90% of respondents said that an SRE's role in achieving business success is more recognized today than three years ago. And only 6% of the SREs polled described their companies as immature in terms of SRE adoption.
Additionally, SREs have become more influential within their companies. Half of those surveyed reported that they now dedicate a significant amount of time to influencing architectural design as part of efforts to improve reliability.
More than two-thirds (68%) of SREs said they expect their role in security to become even more central in the future as organizations continue using third-party libraries for cloud-native application development.
Effort to Usher in SRE Often Stymied by Lack of Resources
But not all companies have made this kind of progress. An overwhelming majority of the SREs surveyed (97%) said efforts to implement a dedicated SRE practice at their organizations continue to face obstacles, such as an inability to gain access to new hires or be allowed to upskill existing teams.
Some of the reasons given for the lack of resources include the following:
■ 59% of respondents said companies perceive it as difficult to train or retain existing ITOps team members or sysadmins to become SREs.
■ 51% said SREs are often believed to be expensive and difficult to hire.
■ 43% said finding SRE skills in the market isn't easy.
Even companies committed to SRE run into trouble, especially when it comes time to measure SRE impact.
Confusion Surrounds SLOs
A majority of respondents (81%) said their companies created objectives and key results (OKRs) and key performance indicators (KPIs) to evaluate service levels for applications and infrastructure, while 75% said they rely on service-level objectives (SLOs). Surprisingly, 99% of those polled said establishing SLOs is challenging.
Some of the reasons given for the difficulty include the following:
■ Too many data sources are involved, which can hobble attempts to synthesize disparate data (64%).
■ An overabundance of metrics makes it difficult to find the most relevant measures to use (54%).
■ A lack of monitoring tools prevent the accurate tracking and defining of SLO performance history (36%).
■ An inability to determine what constitutes quality SLO (22%)
In the same way that many of the challenges confronting SREs were revealed in the survey, some of the solutions were unearthed there as well.
Automation Is Beneficial ... Sometimes
Because SREs oversee a growing number of tasks, their time is increasingly stretched thin, according to the report. Automation is key to freeing up more of their time and allowing them to focus on value-added activities, such as designing experiments and running tests to reduce risk of production failure, or ensuring that security vulnerabilities are detected.
According to 85% of the SREs surveyed, the ability to scale SRE practices further across the organization is extremely dependent on the availability of automation and AI capabilities.
In addition, 71% said their companies have increased the use of automation across every part of the development lifecycle, and 61% said automation has major impact on reducing security vulnerabilities. At a time when threat actors are increasingly more sophisticated and ransomware attacks are a plague on business, SREs have begun to drive increased adoption of DevSecOps practices to ensure security is top of mind at every stage of the development lifecycle.
SREs Need Standardized Observability
SREs and company managers also want to build unity across their tool stacks, according to the survey: 85% of SREs want to standardize on the same observability platform from development to operations and security by 2025. The goal is to create a larger number of streamlined solutions that enable SRE and DevOps teams to work together more effectively and eliminate the need to switch between various dashboards.
Among the major takeaways of The State of SRE report is that SREs need the time and resources required to foster greater reliability. Business managers should note that the success of SREs depends largely on making the most of available resources and that means limiting the amount of time SREs spend on low-priority chores. Automation is vital to achieving this, but it can also add to the distractions if SREs spend too much time writing automation scripts.
To supply the kind of deliverables that benefit their companies the most, such as maximizing reliability, resiliency, security, performance, and eventually business outcomes, SREs require platforms that enable them to drive reliability and automation by default, through self-serve and everything-as-code capabilities.
Site reliability engineers are development-focused IT professionals who work on developing and implementing solutions that solve reliability, availability, and scale problems. On the other hand, DevOps engineers are ops-focused workers who solve development pipeline problems. While there is a divide between the two professions, both sets of engineers cross the gap regularly, delivering their expertise and opinions to the other side and vice versa ...
Site reliability engineering (SRE) is fast becoming an essential aspect of modern IT operations, particularly in highly scaled, big data environments. As businesses and industries shift to the digital and embrace new IT infrastructures and technologies to remain operational and competitive, the need for a new approach for IT teams to find and manage the balance between launching new systems and features and ensuring these are intuitive, reliable, and friendly for end users has intensified as well ...
The most sophisticated observability practitioners (leaders) are able to cut downtime costs by 90%, from an estimated $23.8 million annually to just $2.5 million, compared to observability beginners, according to the State of Observability 2022 from Splunk in collaboration with the Enterprise Strategy Group. What's more, leaders in observability are more innovative and more successful at achieving digital transformation outcomes and other initiatives ...
Programmatically tracked service level indicators (SLIs) are foundational to every site reliability engineering practice. When engineering teams have programmatic SLIs in place, they lessen the need to manually track performance and incident data. They're also able to reduce manual toil because our DevOps teams define the capabilities and metrics that define their SLI data, which they collect automatically — hence "programmatic" ...
Recently, a regional healthcare organization wanted to retire its legacy monitoring tools and adopt AIOps. The organization asked Windward Consulting to implement an AIOps strategy that would help streamline its outdated and unwieldy IT system management. Our team's AIOps implementation process helped this client and can help others in the industry too. Here's what my team did ...
You've likely heard it before: every business is a digital business. However, some businesses and sectors digitize more quickly than others. Healthcare has traditionally been on the slower side of digital transformation and technology adoption, but that's changing. As healthcare organizations roll out innovations at increasing velocity, they must build a long-term strategy for how they will maintain the uptime of their critical apps and services. And there's only one tool that can ensure this continuous availability in our modern IT ecosystems. AIOps can help IT Operations teams ensure the uptime of critical apps and services ...
Between 2012 to 2015 all of the hyperscalers attempted to use the legacy APM solutions to improve their own visibility. To no avail. The problem was that none of the previous generations of APM solutions could match the scaling demand, nor could they provide interoperability due to their proprietary and exclusive agentry ...
The DevOps journey begins by understanding a team's DevOps flow and identifying precisely what tasks deliver the best return on engineers' time when automated. The rest of this blog will help DevOps team managers by outlining what jobs can — and should be automated ...
A survey from Snow Software polled more than 500 IT leaders to determine the current state of cloud infrastructure. Nearly half of the IT leaders who responded agreed that cloud was critical to operations during the pandemic with the majority deploying a hybrid cloud strategy consisting of both public and private clouds. Unsurprisingly, over the last 12 months, the majority of respondents had increased overall cloud spend — a substantial increase over the 2020 findings ...
As we all know, the drastic changes in the world have caused the workforce to take a hybrid approach over the last two years. A lot of that time, being fully remote. With the back and forth between home and office, employees need ways to stay productive and access useful information necessary to complete their daily work. The ability to obtain a holistic view of data relevant to the user and get answers to topics, no matter the worker's location, is crucial for a successful and efficient hybrid working environment ...