To Manage Today's Data Surge, CIOs Need Mix of Automation and AISecOps
October 11, 2022

Andreas Grabner

Share this

IT teams need modern technologies to identify valuable data insights from the oceans of data businesses collect today, according to a new report. The report found that 71% of the 1,303 chief information officers (CIOs) and other IT decision makers surveyed say the colossal amount of data generated by cloud-native technology stacks is now beyond human ability to manage.

To keep pace with all the data from complex cloud-native architectures, organizations need more sophisticated solutions to power operations and security, said those surveyed.

Core to these new technologies is automation supported by AISecOps (a methodology that brings artificial intelligence to operations and security tasks/teams). The findings of the survey, conducted by Coleman Parkes and commissioned by Dynatrace, were published in the 2022 Global CIO Report.

Without a more automated approach to IT operations, 59% of CIOs surveyed say their teams could soon become overloaded by the increasing complexity of their technology stack. Perhaps more concerning is that 93% of CIOs say AIOps (or AI for IT operations) and automation are increasingly vital to helping ease the shortage of skilled IT, development, and security professionals and reducing the risk of teams becoming burned out by the complexity of modern cloud and development environments.

Glut of Data and the Lack of Effective Tools Creates Numerous Problems

The era of big data has created scores of opportunities, but it also has posed nearly as many challenges. The hyperconnected environments created using multicloud strategies, Kubernetes and serverless architectures enable organizations to accelerate the building of customized and innovative new architectures. These new environments, however, have become increasingly distributed and complex.

Meanwhile, IT and application managers must cobble together a host of legacy technologies to monitor and maintain visibility into performance and availability. The survey found that CIOs say their teams use an average of 10 monitoring tools across their technology stacks, though they have observability of just 9% of their environment.

This ad hoc approach makes it more difficult to deliver the best-performing and most secure software applications. The reasons are simple: each separate tool requires a different skill set to interpret the data's meaning and each organizes and visualizes metrics in different ways. Also, each tool provides visibility into just one layer of the stack, which creates data silos.

More Complex Environments Are Costly, Take Toll on Workers

When it comes to cost, 45% of CIOs say it's too expensive to manage the large volume of observability and security data using existing analytics solutions. As a result, respondents say they keep only what is most critical.

The mounting complexity and hassle involved in maintaining operations also takes a toll on employees; 64% of CIOs say it has become harder to attract and retain enough skilled IT operations and DevOps professionals.

Another problem is that log analytics — traditionally the source from which to unlock insights from data and optimize software performance and security — too often can't scale to address the torrent of observability and security data generated by today's technology stacks.

Automation and AISecOps is the Answer

IT teams need a more automated approach to operations and security, combined with AISecOps. Achieving this effectively requires an end-to-end observability and application security platform with the ability to capture data in context and provide AI-powered, advanced analytics with high performance, cost-effectiveness and limitless scale.

Additionally, data warehouses have also become outdated. Models that employ a strategy with a data lakehouse at the core, one that features powerful processing capabilities, will drive greater innovation and efficiency. This kind of strategy harnesses petabytes of data at the speed needed to turn raw information into precise and actionable answers that drive AISecOps automation.

Another benefit of this model is the freeing of skilled DevOps teams from arduous, routine manual tasks, enabling them to work on more strategic, innovation-driving projects.

According to the survey, CIOs estimate that their teams spend 40% of their time just "keeping the lights on," and that these valuable hours could be saved through automation.

Organizations suffering from these issues should seek out an all-in-one platform that provides observability, application security and AIOps. With this strategy, leaders can provide their teams with an easy-to-use, automated, and unified approach that delivers precise answers and exceptional digital experiences at scale.

Andreas Graber is a DevOps Activist at Dynatrace
Share this

The Latest

March 04, 2024

This year's Super Bowl drew in viewership of nearly 124 million viewers and made history as the most-watched live broadcast event since the 1969 moon landing. To support this spike in viewership, streaming companies like YouTube TV, Hulu and Paramount+ began preparing their IT infrastructure months in advance to ensure an exceptional viewer experience without outages or major interruptions. New Relic conducted a survey to understand the importance of a seamless viewing experience and the impact of outages during major streaming events such as the Super Bowl ...

March 01, 2024

As organizations continue to navigate the complexities of the digital era, which has been marked by exponential advancements in AI and technology, the strategic deployment of modern, practical applications has become indispensable for sustaining competitive advantage and realizing business goals. The Info-Tech Research Group report, Applications Priorities 2024, explores the following five initiatives for emerging and leading-edge technologies and practices that can enable IT and applications leaders to optimize their application portfolio and improve on capabilities needed to meet the ambitions of their organizations ...

February 29, 2024

Despite the growth in popularity of artificial intelligence (AI) and ML across a number of industries, there is still a huge amount of unrealized potential, with many businesses playing catch-up and still planning how ML solutions can best facilitate processes. Further progression could be limited without investment in specialized technical teams to drive development and integration ...

February 28, 2024

With over 200 streaming services to choose from, including multiple platforms featuring similar types of entertainment, users have little incentive to remain loyal to any given platform if it exhibits performance issues. Big names in streaming like Hulu, Amazon Prime and HBO Max invest thousands of hours into engineering observability and closed-loop monitoring to combat infrastructure and application issues, but smaller platforms struggle to remain competitive without access to the same resources ...

February 27, 2024

Generative AI has recently experienced unprecedented dramatic growth, making it one of the most exciting transformations the tech industry has seen in some time. However, this growth also poses a challenge for tech leaders who will be expected to deliver on the promise of new technology. In 2024, delivering tangible outcomes that meet the potential of AI, and setting up incubator projects for the future will be key tasks ...

February 26, 2024

SAP is a tool for automating business processes. Managing SAP solutions, especially with the shift to the cloud-based S/4HANA platform, can be intricate. To explore the concerns of SAP users during operational transformations and automation, a survey was conducted in mid-2023 by Digitate and Americas' SAP Users' Group ...

February 22, 2024

Some companies are just starting to dip their toes into developing AI capabilities, while (few) others can claim they have built a truly AI-first product. Regardless of where a company is on the AI journey, leaders must understand what it means to build every aspect of their product with AI in mind ...

February 21, 2024

Generative AI will usher in advantages within various industries. However, the technology is still nascent, and according to the recent Dynatrace survey there are many challenges and risks that organizations need to overcome to use this technology effectively ...

February 20, 2024

In today's digital era, monitoring and observability are indispensable in software and application development. Their efficacy lies in empowering developers to swiftly identify and address issues, enhance performance, and deliver flawless user experiences. Achieving these objectives requires meticulous planning, strategic implementation, and consistent ongoing maintenance. In this blog, we're sharing our five best practices to fortify your approach to application performance monitoring (APM) and observability ...

February 16, 2024

In MEAN TIME TO INSIGHT Episode 3, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at Enterprise Management Associates (EMA) discusses network security with Chris Steffen, VP of Research Covering Information Security, Risk, and Compliance Management at EMA ...