ManageEngine Announces Support for Apache Spark
March 14, 2017
Share this

ManageEngine announced that Applications Manager, its application performance monitoring solution, now supports performance monitoring for Apache Spark.

The move enables development and operations teams in enterprises to gain visibility into the performance of the big data engine as well as the business-critical applications relying on Spark.

Apache Spark is an open source analytics engine built on top of the Hadoop Distributed File System (HDFS). Spark is steadily gaining prominence for its fast data processing capabilities and is being used for data streaming, fog computing, machine learning, and interactive analysis. It is one of the four widely used technologies in the Hadoop ecosystem. However, many components come together to make a Spark application work, so it presents unique complexities in monitoring and troubleshooting.

"Consumer-centric businesses are rapidly deploying data processing engines, such as Spark, to convert tons of data into quick business decisions. As these businesses scale their Spark deployments, it becomes more challenging for operations teams and data scientists to comprehend what is going on,” said Dev Anand, Director of Product Management at ManageEngine. “We want to uncomplicate performance monitoring for big data technologies so businesses can get the most out of their big data projects. That’s why we added performance monitoring and troubleshooting for Apache Spark in Applications Manager. Now, businesses can be more confident about deploying Spark and other big data applications in their production environments."
Proactive Monitoring and Troubleshooting for Apache Spark Clusters

Applications Manager enables comprehensive performance monitoring of the Apache Spark in-memory analytics engine to minimize downtime and performance degradation as well as take corrective actions before any problems arise. Applications Manager monitors key performance indicators of Apache Spark, including indicators related to drivers, executors, RDD blocks, tasks, job stages, CPU and memory usage, and JVM metrics.

The latest monitoring capabilities in Applications Manager help IT personnel:

- View a holistic picture of the health and performance of Apache Spark clusters, big data applications that rely on Spark, and associated infrastructure components using customer, interactive dashboards.

- Diagnose common causes of performance failures in the Spark infrastructure, drill down to their root cause and resolve them quickly before the failure propagates through the Spark infrastructure to the application.

- Gain insights into the overall cluster utilization and resource bottlenecks as well as plan capacity effectively to handle the increasing size and complexity of Spark workloads.

- Ensure Spark applications are consistently delivering a high-quality experience for end users.

Support for Apache Spark complements Applications Manager’s existing monitoring support for the Hadoop platform and key components of the Hadoop ecosystem, such as Apache HBase, Elasticsearch, ZooKeeper, Kafka and Solr search engine. Applications Manager also provides out-of-the-box support for more than 80 applications and infrastructure components, including other NoSQL and in-memory technologies such as Cassandra, MongoDB, Redis, Memcached, Couchbase, Oracle NoSQL, Oracle Coherence and SAP HANA.

Applications Manager 13.2 is available immediately.

Share this

The Latest

March 24, 2017

A growing IT delivery gap is slowing down the majority of the businesses surveyed and directly putting revenue at risk, according to MuleSoft's 2017 Connectivity Benchmark Report on digital transformation initiatives and the business impact of APIs ...

March 23, 2017

Why containers are growing in popularity is no surprise — they’re extremely easy to spin up or down, but come with an unforeseen issue. Without the right foresight, DevOps and IT teams may lose a lot of visibility into these containers resulting in operational blind spots and even more haystacks to find the presumptive performance issue needle ...

March 22, 2017

Much emphasis is placed on servers and storage when discussing Application Performance, mainly because the application lives on a server and uses storage. However, the network has considerable importance, certainly in the case of WANs where there are ways of speeding up the transmission of data of a network ...

March 21, 2017

The majority of IT executives believe investment in IT Service Management (ITSM) is important to gain the agility needed to compete in an era of global, cross-industry disruption and digital transformation, according to Delivering Value to Today’s Digital Enterprise: The State of IT Service Management 2017, a report by BMC, conducted in association with Forbes ...

March 17, 2017

Let’s say your company has examined all the potential pros and cons, and moved your critical business applications to the cloud. The advertised benefits of the cloud seem like they’ll work out great. And in many ways, life is easier for you now. But as often happens when things seem too good to be true, reality has a way of kicking in to reveal just exactly how many things can go wrong with your cloud setup – things that can directly impact your business ...

March 16, 2017

IT leadership is more driven to be innovative than ever, but also more in need of justifying costs and showing value than ever. Combining the two is no mean feat, especially when individual technologies are put forward as the single tantalizing answer ...

March 15, 2017

The move to Citrix 7.X is in full swing. This has improved the centralizing of Management and reduction of costs, but End User Experience is becoming top of the business objectives list. However, delivering that is not something to be considered after the upgrade ...

March 14, 2017

As organizations understand the findings of the Cyber Monday Web Performance Index and look to improve their site performance for the next Cyber Monday shopping day, I wanted to offer a few recommendations to help any organization improve in 2017 ...

March 13, 2017

Online retailers stand to make a lot of money on Cyber Monday as long as their infrastructure can keep up with customers. If your company's site goes offline or substantially slows down, you're going to lose sales. And even top ecommerce sites experience performance or stability issues at peak loads, like Cyber Monday, according to Apica's Cyber Monday Web Performance Index ...

March 10, 2017

Applications and infrastructure are being deployed and commissioned at a faster rate than ever before, the number of tools it takes to effectively manage these services is multiplying, and the expectations placed on IT to ensure customer satisfaction is increasing, according to The State of Monitoring 2017 report from BigPanda ...