New Relic announced the general availability of New Relic AI monitoring with a suite of powerful new features to meet the evolving needs of organizations developing AI applications.
New features include in-depth AI response tracing insights with real-time user feedback and model comparison to help drive continuous improvement of AI application performance, quality, and cost—all while ensuring data security and privacy. With 60+ integrations, New Relic AI monitoring is one of the most comprehensive solutions that helps organizations find the root cause of AI application issues faster, furthers their adoption of AI, and supports them at every stage of their AI journey.
“Based on my conversations with CIOs, CTOs, and executives across our customer base, it is clear that every company is thinking about how to scale their business with AI,“ said New Relic Chief Customer Officer Arnie Lopez. “The adoption of AI can be costly and introduce complexity into their stack. IT and technology leaders are turning to New Relic because observability is essential to help them confidently navigate the exciting future of AI, optimize performance and quality, and control costs, ultimately delivering exceptional customer experiences."
New Relic AI monitoring makes it easy for organizations to manage complexities of their AI stack by providing a unified view of their entire AI ecosystem alongside the rest of their performance data.
Key features include:
- Auto instrumentation: New Relic agents offer easy set-up for popular frameworks like OpenAI, AWS Bedrock, and LangChain across Python, Node.js, Ruby, Go and .NET languages.
- Full AI stack visibility: Holistic view across the application, infrastructure, and the AI layer, including AI metrics like number of requests, response time, and token usage.
- AI response view with end-user feedback: Quickly identify trends and outliers in AI responses, analyze sentiment, and see user feedback in a single consolidated view.
- Deep trace insights for every response: Trace the lifecycle of AI responses with tools like LangChain to fix performance and quality issues like bias, toxicity, and hallucinations.
- Enhanced data security: Maintain your organizational security and compliance policies by excluding sensitive data (PII) in your AI requests and responses from monitoring.
- Model comparison: Compare performance and cost of foundational models running in production in a single view to choose the model that best fits your needs.
- Quickstart integrations: One of the most comprehensive solutions for monitoring the AI ecosystem with 60 integrations for critical components like NVIDIA GPUs and vector databases like Pinecone, Weaviate and more.
New Relic AI monitoring is generally available as part of its all-in-one observability platform and offered as part of its usage-based pricing model.
The Latest
The edge brings computing resources and data storage closer to end users, which explains the rapid boom in edge computing, but it also generates a huge amount of data ... 44% of organizations are investing in edge IT to create new customer experiences and improve engagement. To achieve those goals, edge services observability should be a centerpoint of that investment ...
The growing adoption of efficiency-boosting technologies like artificial intelligence (AI) and machine learning (ML) helps counteract staffing shortages, rising labor costs, and talent gaps, while giving employees more time to focus on strategic projects. This trend is especially evident in the government contracting sector, where, according to Deltek's 2024 Clarity Report, 34% of GovCon leaders rank AI and ML in their top three technology investment priorities for 2024, above perennial focus areas like cybersecurity, data management and integration, business automation and cloud infrastructure ...
While IT leaders are preparing organizations for accelerated generative AI (GenAI) adoption, C-suite executives' confidence in their IT team's ability to deliver basic services is declining, according to a study conducted by the IBM Institute for Business Value ...
The consequences of outages have become a pressing issue as the largest IT outage in history continues to rock the world with severe ramifications ... According to the Catchpoint Internet Resilience Report, these types of disruptions, internet outages in particular, can have severe financial and reputational impacts and enterprises should strongly consider their resilience ...
Everyday AI and digital employee experience (DEX) are projected to reach mainstream adoption in less than two years according to the Gartner, Inc. Hype Cycle for Digital Workplace Applications, 2024 ...
When an IT issue is not handled correctly, not only is innovation stifled, but stakeholder trust can also be impacted (such as when there's an IT outage or slowdowns in performance). When you add new technology investments and innovations into the mix, you have a recipe for disaster ...
To get a better understanding of the top issues facing IT teams in financial services, Auvik recently released its 2024 Financial Services IT Trends Report ... Not surprisingly, the experience of FinServ IT teams is significantly impacted by the onslaught of cyberattacks facing financial services organizations as well as the complex regulatory environment of this industry ...
The CrowdStrike outage serves as a potent illustration of the risks associated with complex security environments. Enterprises are increasingly advised to consider simpler, more robust solutions that do not rely heavily on reactive security measures ...
When IT leaders started telling Enterprise Management Associates (EMA™) more than a year ago that their personnel were using premium ChatGPT subscriptions to create device configs and automation scripts, we knew the industry was on the verge of a revolution ...
The rapid rise of creative "right-brain" generative AI (GenAI) has opened the door to greater adoption of the more analytical "left-brain" AI decisioning solutions by global businesses, according to new research from Pegasystems ...
