Pepperdata announced that the Pepperdata product portfolio now provides autonomous optimization and observability for Spark applications running on Kubernetes.
Kubernetes is a key part of the modern hybrid, multi-cloud architecture in today’s enterprises. Spark is the #1 big data application running on Kubernetes, according to a recent survey of enterprise users. As big data applications move from Spark on legacy systems to Spark on Kubernetes, the performance of these applications can change dramatically.
Pepperdata offers full-stack observability for Spark on Kubernetes, allowing developers to manually tune their applications, while autonomously optimizing resources at run time. The combination of manual and autonomous tuning is necessary to deliver the best price and performance for these applications. Pepperdata uses machine learning across clusters, containers, pods, nodes, users and workflows to give you a complete understanding of your environment.
Pepperdata will automatically optimize Kubernetes resources while providing a correlated and granular understanding of the applications and infrastructure. Observability provides actionable information to debug and understand complex applications, and autonomous optimization ensures that the compute resources are used efficiently.
Features include:
- Autonomous optimization of resources and workloads on Amazon EKS, HPE Bluedata and Red Hat OpenShift.
- Application and infrastructure observability for Spark on EKS, Bluedata and OpenShift as well as YARN.
- A self-service dashboard so developers can manually tune using recommendations for speed or resource utilization.
- Detailed usage attribution for chargeback.
“Kubernetes is becoming increasingly important for a unified IT infrastructure, both in the cloud and the data center. Spark is the number one big data application moving to the cloud, but Spark applications tend to be quite inefficient. Optimization is key to successful implementations,” said Ash Munshi, CEO, Pepperdata. “We saw this early on with our customers, which is why we invested in the development of Spark on Kubernetes, together with Red Hat, Palantir and Google.”
The Latest
APMdigest and leading IT research firm Enterprise Management Associates (EMA) are partnering to bring you the EMA-APMdigest Podcast, a new podcast focused on the latest technologies impacting IT Operations. In Episode 2 - Part 1 Pete Goldin, Editor and Publisher of APMdigest, discusses Network Observability with Shamus McGillicuddy, Vice President of Research, Network Infrastructure and Operations, at EMA ...
CIOs have stepped into the role of digital leader and strategic advisor, according to the 2023 Global CIO Survey from Logicalis ...
Synthetic monitoring is crucial to deploy code with confidence as catching bugs with E2E tests on staging is becoming increasingly difficult. It isn't trivial to provide realistic staging systems, especially because today's apps are intertwined with many third-party APIs ...
Recent EMA field research found that ServiceOps is either an active effort or a formal initiative in 78% of the organizations represented by a global panel of 400+ IT leaders. It is relatively early but gaining momentum across industries and organizations of all sizes globally ...
Managing availability and performance within SAP environments has long been a challenge for IT teams. But as IT environments grow more complex and dynamic, and the speed of innovation in almost every industry continues to accelerate, this situation is becoming a whole lot worse ...
Harnessing the power of network-derived intelligence and insights is critical in detecting today's increasingly sophisticated security threats across hybrid and multi-cloud infrastructure, according to a new research study from IDC ...
Recent research suggests that many organizations are paying for more software than they need. If organizations are looking to reduce IT spend, leaders should take a closer look at the tools being offered to employees, as not all software is essential ...
Organizations are challenged by tool sprawl and data source overload, according to the Grafana Labs Observability Survey 2023, with 52% of respondents reporting that their companies use 6 or more observability tools, including 11% that use 16 or more.
An array of tools purport to maintain availability — the trick is sorting through the noise to find the right one. Let us discuss why availability is so important and then unpack the ROI of deploying Artificial Intelligence for IT Operations (AIOps) during an economic downturn ...
Development teams so often find themselves rushing to get a release out on time. When it comes time for testing, the software works fine in the lab. But, when it's released, customers report a bunch of bugs. How does this happen? Why weren't the flaws found in QA? ...
