Elastic Brings Real-Time Graph Analytics to the Elastic Stack
March 31, 2016
Share this

Elastic unveiled Graph, a new extension for Elasticsearch and Kibana that allows anyone to uncover, understand, and explore the relationships that live in their data.

By combining the speed and relevance-ranking of search with graph exploration, Graph opens up a whole host of new use-cases with the Elastic Stack.

"We built Graph to help you ask new types of questions about the data you store in Elasticsearch," said Steve Kearns, Sr. Director of Product Management at Elastic. "By looking at the relationships in your data through the lens of relevance, it becomes easy to answer questions that previously would involve multiple systems, batch jobs or machine learning."

When you store data in Elasticsearch — products, users, documents, logs — this data often contains references or properties that represent connections between objects, entities, people, or machines. The best way to explore these connections is to see them, which Graph provides via a Kibana plugin. Like everything at Elastic, this UI is built on a simple, but powerful API that leverages Elastic’s experience in relevance ranking to surface the most meaningful connections that live in your data. This approach to graph exploration opens a wide range of new use-cases for the Elastic Stack, without requiring new index formats, by allowing users to query their existing data in new ways.

Graph makes it easy to answer complex questions and address use-cases such as behavioral analysis, fraud, cybersecurity, drug discovery, personalized medicine, and to build personalized recommendations based on continuous real-time data. Graph automatically identifies the most important connections, separating the signal from the noise by employing relevance ranking specific to each query. Because it is built on Elasticsearch, Graph benefits from high scalability and near-real-time data availability, enabling answers that evolve as your data changes.

When data is added to Elasticsearch, the indexing process tracks and counts the values in each field of the document, updates global frequencies, and prepares the data for a wide range of queries. These statistics are used to perform relevance ranking for search and efficiently summarize the data in Elasticsearch aggregations. With Graph, the Elastic Stack uses these statistics in new ways — first to identify relationships within and across sets of documents, and then to prioritize the most relevant relationships for the given query.

In contrast, traditional graph techniques are based on a simple count of the frequency of a given relationship. This approach has the drawback that elements with the most connections — the Shawshank Redemption in movie recommendation data or Starbucks in credit card purchase data — are returned as the most important. With Graph in Elasticsearch, relevance is calculated by correlating the significance of each relationship in comparison to global averages, bringing back the important results, and avoiding frequent connections.

"Graph is an excellent example of the limitless possibilities within our products and how we strive to make it as easy as possible for our users to leverage the power of the Elastic Stack," said Shay Banon, Co-Founder and CTO of Elastic. "I am proud to see our company continue to innovate, and I can’t wait to see the new ways in which our customers will adopt Graph to solve really challenging problems and use cases."

Share this

The Latest

February 26, 2020

For the past 10 years, the majority of CIOs have had a transformational focus (currently 42%), however, this year, there is strong momentum in CIOs taking on more strategic responsibilities (40%), according to the 2020 State of the CIO research from IDG's CIO ...

February 25, 2020
A widening gap between IT resources and the demands of managing the increasing scale and complexity of enterprise cloud ecosystems is evident, according to <span style="font-style: italic;">Top challenges for CIOs on the road to the AI-driven autonomous cloud</span>, a new report based on a global survey of 800 CIOs conducted by Vanson Bourne and commissioned by Dynatrace ...
February 24, 2020

The tech world may be falling in love with artificial intelligence and automation, but when it comes to managing critical assets, old school tools like spreadsheets are still in common use. A new survey by Ivanti illustrates how these legacy tools are forcing IT to waste valuable time analyzing assets due to incomplete data ...

February 20, 2020

Over 70% of C-Suite decision makers believe business innovation and staff retention are driven by improved visibility into network and application performance, according to Rethink Possible: Visibility and Network Performance – The Pillars of Business Success, a survey
conducted by Riverbed ...

February 19, 2020

Modern enterprises rely upon their IT departments to deliver a seamless digital customer experience. Performance and availability are the foundational stepping stones to delivering that customer experience. Along those lines, this month we released a new research study titled the IT Downtime Detection and Mitigation Report that contains recommendations on how to best prevent, detect or mitigate brownouts and outages, given the context of today’s IT transformation trends ...

February 18, 2020

While Application Performance Management (APM) has become mainstream, with a majority of tech pros using APM tools regularly, there's work to be done to move beyond troubleshooting ...

February 13, 2020

Over the last few decades, IT departments have decreased budgets in part because of recession. As a result, they have are being asked to do more with less. The increase in work has amplified the need for automation ...

February 12, 2020

Many variables must align for optimum APM, and security is certainly among them. I offer the following APM predictions for 2020, which revolve around the reality that we will definitely begin to see much deeper integration of WAN technology on the security front. Look for this integration to take shape in the following ways ...

February 11, 2020

When it comes to growing a successful company, research shows it isn't about getting the most out of employees, but delivering an experience that empowers them to be and do their best. And according to Priming a New Era of Digital Wellness, a new study conducted by Quartz Insights in partnership with Citrix Systems, technology is the secret to doing so ...

February 10, 2020

Only 11% of website decision-makers feel that they have complete insight into the scripts that they use on their websites. However, industry estimates state that about 70% of the code on a website comes from a third-party library or service. Research highlights a clear need to raise awareness of the potential threats associated with the vulnerabilities inherent in third-party code ...