New Relic announced the general availability of New Relic AI monitoring with a suite of powerful new features to meet the evolving needs of organizations developing AI applications.
New features include in-depth AI response tracing insights with real-time user feedback and model comparison to help drive continuous improvement of AI application performance, quality, and cost—all while ensuring data security and privacy. With 60+ integrations, New Relic AI monitoring is one of the most comprehensive solutions that helps organizations find the root cause of AI application issues faster, furthers their adoption of AI, and supports them at every stage of their AI journey.
“Based on my conversations with CIOs, CTOs, and executives across our customer base, it is clear that every company is thinking about how to scale their business with AI,“ said New Relic Chief Customer Officer Arnie Lopez. “The adoption of AI can be costly and introduce complexity into their stack. IT and technology leaders are turning to New Relic because observability is essential to help them confidently navigate the exciting future of AI, optimize performance and quality, and control costs, ultimately delivering exceptional customer experiences."
New Relic AI monitoring makes it easy for organizations to manage complexities of their AI stack by providing a unified view of their entire AI ecosystem alongside the rest of their performance data.
Key features include:
- Auto instrumentation: New Relic agents offer easy set-up for popular frameworks like OpenAI, AWS Bedrock, and LangChain across Python, Node.js, Ruby, Go and .NET languages.
- Full AI stack visibility: Holistic view across the application, infrastructure, and the AI layer, including AI metrics like number of requests, response time, and token usage.
- AI response view with end-user feedback: Quickly identify trends and outliers in AI responses, analyze sentiment, and see user feedback in a single consolidated view.
- Deep trace insights for every response: Trace the lifecycle of AI responses with tools like LangChain to fix performance and quality issues like bias, toxicity, and hallucinations.
- Enhanced data security: Maintain your organizational security and compliance policies by excluding sensitive data (PII) in your AI requests and responses from monitoring.
- Model comparison: Compare performance and cost of foundational models running in production in a single view to choose the model that best fits your needs.
- Quickstart integrations: One of the most comprehensive solutions for monitoring the AI ecosystem with 60 integrations for critical components like NVIDIA GPUs and vector databases like Pinecone, Weaviate and more.
New Relic AI monitoring is generally available as part of its all-in-one observability platform and offered as part of its usage-based pricing model.
The Latest
AI is the catalyst for significant investment in data teams as enterprises require higher-quality data to power their AI applications, according to the State of Analytics Engineering Report from dbt Labs ...
Misaligned architecture can lead to business consequences, with 93% of respondents reporting negative outcomes such as service disruptions, high operational costs and security challenges ...
A Gartner analyst recently suggested that GenAI tools could create 25% time savings for network operational teams. Where might these time savings come from? How are GenAI tools helping NetOps teams today, and what other tasks might they take on in the future as models continue improving? In general, these savings come from automating or streamlining manual NetOps tasks ...
IT and line-of-business teams are increasingly aligned in their efforts to close the data gap and drive greater collaboration to alleviate IT bottlenecks and offload growing demands on IT teams, according to The 2025 Automation Benchmark Report: Insights from IT Leaders on Enterprise Automation & the Future of AI-Driven Businesses from Jitterbit ...
A large majority (86%) of data management and AI decision makers cite protecting data privacy as a top concern, with 76% of respondents citing ROI on data privacy and AI initiatives across their organization, according to a new Harris Poll from Collibra ...
According to Gartner, Inc. the following six trends will shape the future of cloud over the next four years, ultimately resulting in new ways of working that are digital in nature and transformative in impact ...
2020 was the equivalent of a wedding with a top-shelf open bar. As businesses scrambled to adjust to remote work, digital transformation accelerated at breakneck speed. New software categories emerged overnight. Tech stacks ballooned with all sorts of SaaS apps solving ALL the problems — often with little oversight or long-term integration planning, and yes frequently a lot of duplicated functionality ... But now the music's faded. The lights are on. Everyone from the CIO to the CFO is checking the bill. Welcome to the Great SaaS Hangover ...
Regardless of OpenShift being a scalable and flexible software, it can be a pain to monitor since complete visibility into the underlying operations is not guaranteed ... To effectively monitor an OpenShift environment, IT administrators should focus on these five key elements and their associated metrics ...
An overwhelming majority of IT leaders (95%) believe the upcoming wave of AI-powered digital transformation is set to be the most impactful and intensive seen thus far, according to The Science of Productivity: AI, Adoption, And Employee Experience, a new report from Nexthink ...
Overall outage frequency and the general level of reported severity continue to decline, according to the Outage Analysis 2025 from Uptime Institute. However, cyber security incidents are on the rise and often have severe, lasting impacts ...