Elastic Unveils Elasticsearch Relevance Engine for Artificial Intelligence
May 25, 2023
Share this

Elastic, the company behind Elasticsearch®, announced the launch of the Elasticsearch Relevance Engine™ (ESRE™), powered by built-in vector search and transformer models, which is designed to bring the power of AI innovation to proprietary enterprise data.

ESRE enables companies to achieve breakthrough results by helping organizations create secure deployments to take advantage of all their proprietary structured and unstructured data while optimizing infrastructure and using talent resources more efficiently.

“Generative AI is a revolutionary moment in technology and the companies that get it right, fast, are tomorrow’s leaders,” said Ash Kulkarni, CEO of Elastic. “The Elasticsearch Relevance Engine is available today, and we’ve already done the hard work of making it easier for companies to do generative AI right.”

“The expertise of Elastic in enterprise search is evident in the way the company thinks about how to incorporate generative AI into it,” said Julia Liuson, President of Microsoft’s Developer Division. “We’re working closely together to help companies leverage the power of Azure OpenAI and ChatGPT over all of an organizations' proprietary data in Elasticsearch to help our joint customers deliver a richer and more seamless experience.”

Elastic has made substantial investments in foundational AI capabilities to democratize AI and machine learning for developers. Unified APIs for vector search, BM25f search and hybrid search, plus a new transformer model small enough to fit on a laptop’s memory mean businesses and teams are now able to optimize infrastructure and talent resources more efficiently. Using a relevance engine, like ESRE, allows companies to take advantage of all of their structured and unstructured data to build custom generative AI (GAI) apps, without having to worry about the size and cost of running large language models. The ability to “bring your own” transformer model and integrate with third-party transformer models allows organizations to create secure deployments that leverage all the cutting-edge innovations of GAI on their specific business data. With ESRE, the thousands of companies and vast community of users that have invested in Elastic solutions can advance AI initiatives right now without a lot of additional resources.

“Enterprises are excited about the potential for generative AI in their applications and workflows, but are all also swamped by the pace of innovation in the field,” said James Governor, co-founder of RedMonk. “ESRE is designed to ease adoption of transformers, homemade and third-party LLM models, building on the original core strengths of Elastic in search.”

The product of more than two years of research and development, ESRE is already being utilized by several prominent Elastic customers to augment their own AI-powered applications. In addition, Relativity, a global legal technology company and an Elastic OEM partner, is experimenting with ESRE in conjunction with the Azure OpenAI Service to understand and demonstrate how it might improve the relevance of results within their eDiscovery product, RelativityOne.

"Ensuring our customers and partners have industry-leading search capabilities is vital to our mission to help them organize data, discover the truth and act on it. To that end, I’m thrilled about the benefits we can bring to customers through our investments to harness Elasticsearch within RelativityOne,” said Chris Brown, Chief Product Officer at Relativity. "We're experimenting with ESRE right now and are excited about its potential to deliver powerful, AI-augmented search results to our customers."

Elasticsearch Relevance Engine (ESRE) includes:

- Industry leading advanced relevance ranking features, including BM25f, a critical component of hybrid search

- A vector database for storing and querying embeddings in high-dimensions

- A new proprietary transformer model that delivers out-of-the-box semantic search

- Bring your own transformer models

- Integration with third-party transformer models, such as OpenAI GPT 3/4 via APIs

Share this

The Latest

May 25, 2023

Developers need a tool that can be portable and vendor agnostic, given the advent of microservices. It may be clear an issue is occurring; what may not be clear is if it's part of a distributed system or the app itself. Enter OpenTelemetry, commonly referred to as OTel, an open-source framework that provides a standardized way of collecting and exporting telemetry data (logs, metrics, and traces) from cloud-native software ...

May 24, 2023

As SLOs grow in popularity their usage is becoming more mature. For example, 82% of respondents intend to increase their use of SLOs, and 96% have mapped SLOs directly to their business operations or already have a plan to, according to The State of Service Level Objectives 2023 from Nobl9 ...

May 23, 2023

Observability has matured beyond its early adopter position and is now foundational for modern enterprises to achieve full visibility into today's complex technology environments, according to The State of Observability 2023, a report released by Splunk in collaboration with Enterprise Strategy Group ...

May 22, 2023

Before network engineers even begin the automation process, they tend to start with preconceived notions that oftentimes, if acted upon, can hinder the process. To prevent that from happening, it's important to identify and dispel a few common misconceptions currently out there and how networking teams can overcome them. So, let's address the three most common network automation myths ...

May 18, 2023

Many IT organizations apply AI/ML and AIOps technology across domains, correlating insights from the various layers of IT infrastructure and operations. However, Enterprise Management Associates (EMA) has observed significant interest in applying these AI technologies narrowly to network management, according to a new research report, titled AI-Driven Networks: Leveling Up Network Management with AI/ML and AIOps ...

May 17, 2023

When it comes to system outages, AIOps solutions with the right foundation can help reduce the blame game so the right teams can spend valuable time restoring the impacted services rather than improving their MTTI score (mean time to innocence). In fact, much of today's innovation around ChatGPT-style algorithms can be used to significantly improve the triage process and user experience ...

May 16, 2023

Gartner identified the top 10 data and analytics (D&A) trends for 2023 that can guide D&A leaders to create new sources of value by anticipating change and transforming extreme uncertainty into new business opportunities ...

May 15, 2023

The only way for companies to stay competitive is to modernize applications, yet there's no denying that bringing apps into the modern era can be challenging ... Let's look at a few ways to modernize applications and consider what new obstacles and opportunities 2023 presents ...

May 11, 2023
Applications can be subjected to high traffic on certain days, which, if not taken into account, can lead to unpredictable outcomes and customer dissatisfaction. These may include slow loading speeds, downtime, and unpredictable outcomes, among others ... Hence, applications must be tested for load thresholds to improve performance. Businesses that ignore load performance testing and fail to continually scale these applications leave themselves open to service outages, customer dissatisfaction, and monetary losses ...
May 10, 2023

As online penetration grows, retailers' profits are shrinking — with the cost of serving customers anytime, anywhere, at any speed not bringing in enough topline growth to best monetize even existing investments in technology, systems, infrastructure, and people, let alone new investments, according to Digital-First Retail: Turning Profit Destruction into Customer and Shareholder Value, a new report from AlixPartners and World Retail Congress ...