New Relic announced a machine learning operations (MLOps) capability that allows engineering teams to monitor applications built with OpenAI’s GPT Series APIs.
With just two lines of code, engineering teams can monitor OpenAI completion queries while simultaneously tracking performance and cost metrics in real-time in a single view with New Relic. This new integration allows New Relic to ingest raw OpenAI data and helps companies leverage the power of emerging AI technologies like OpenAI’s ChatGPT to accelerate innovation and business goals while balancing considerations to cost.
This integration expands New Relic's catalog of supported data and extends New Relic's access to a wider audience of developers. Engineers can quickly deploy the OpenAI quickstart from New Relic Instant Observability and access this capability for free with no credit card required and minimal setup by signing up for a forever free New Relic account.
“This is an exciting time for companies who are embracing GPT and building modern applications with Generative AI,” said New Relic Chief Growth Officer and GM of Observability Manav Khurana. “Observability is a game changer when it comes to helping companies extract value from GPT. We are making it so that any engineer using GPT APIs can easily monitor their cost and performance with easy set-up and at no cost. This aligns with our mission to put the power of observability into the hands of every engineer.”
The new capability allows engineers to:
- Get started for free: Access to New Relic Instant Observability and our out-of-the-box GPT monitoring solution is the first of its kind, and included at no additional cost for New Relic full platform users.
- Easy installation: With just two lines of code, users can import the monitor module from the nr_openai_monitor library and automatically generate a dashboard that displays a variety of key GPT performance metrics.
- Monitor cost: Usage of OpenAI’s Davinci model costs can add up quickly and make it difficult to operate at scale. New Relic provides engineering teams with real-time cost tracking of their GPT usage.
- Optimize performance: New Relic gives engineering teams insight into the average response time and other key performance metrics around GPT requests, allowing engineers to optimize usage and ensure the best possible response times.
- Analyze prompts and responses: New Relic provides valuable information about the usage, speed, and effectiveness of GPT to help engineering teams achieve better results from their ML models.
The OpenAI GPT integration with New Relic is included at no additional cost to New Relic full platform users. New Relic supports all current OpenAI GPT versions including the recently released GPT-4.
The Latest
As enterprises accelerate their cloud adoption strategies, CIOs are routinely exceeding their cloud budgets — a concern that's about to face additional pressure from an unexpected direction: uncertainty over semiconductor tariffs. The CIO Cloud Trends Survey & Report from Azul reveals the extent continued cloud investment despite cost overruns, and how organizations are attempting to bring spending under control ...
According to Auvik's 2025 IT Trends Report, 60% of IT professionals feel at least moderately burned out on the job, with 43% stating that their workload is contributing to work stress. At the same time, many IT professionals are naming AI and machine learning as key areas they'd most like to upskill ...
Businesses that face downtime or outages risk financial and reputational damage, as well as reducing partner, shareholder, and customer trust. One of the major challenges that enterprises face is implementing a robust business continuity plan. What's the solution? The answer may lie in disaster recovery tactics such as truly immutable storage and regular disaster recovery testing ...
IT spending is expected to jump nearly 10% in 2025, and organizations are now facing pressure to manage costs without slowing down critical functions like observability. To meet the challenge, leaders are turning to smarter, more cost effective business strategies. Enter stage right: OpenTelemetry, the missing piece of the puzzle that is no longer just an option but rather a strategic advantage ...
Amidst the threat of cyberhacks and data breaches, companies install several security measures to keep their business safely afloat. These measures aim to protect businesses, employees, and crucial data. Yet, employees perceive them as burdensome. Frustrated with complex logins, slow access, and constant security checks, workers decide to completely bypass all security set-ups ...
In MEAN TIME TO INSIGHT Episode 13, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses hybrid multi-cloud networking strategy ...
In high-traffic environments, the sheer volume and unpredictable nature of network incidents can quickly overwhelm even the most skilled teams, hindering their ability to react swiftly and effectively, potentially impacting service availability and overall business performance. This is where closed-loop remediation comes into the picture: an IT management concept designed to address the escalating complexity of modern networks ...
In 2025, enterprise workflows are undergoing a seismic shift. Propelled by breakthroughs in generative AI (GenAI), large language models (LLMs), and natural language processing (NLP), a new paradigm is emerging — agentic AI. This technology is not just automating tasks; it's reimagining how organizations make decisions, engage customers, and operate at scale ...
In the early days of the cloud revolution, business leaders perceived cloud services as a means of sidelining IT organizations. IT was too slow, too expensive, or incapable of supporting new technologies. With a team of developers, line of business managers could deploy new applications and services in the cloud. IT has been fighting to retake control ever since. Today, IT is back in the driver's seat, according to new research by Enterprise Management Associates (EMA) ...
In today's fast-paced and increasingly complex network environments, Network Operations Centers (NOCs) are the backbone of ensuring continuous uptime, smooth service delivery, and rapid issue resolution. However, the challenges faced by NOC teams are only growing. In a recent study, 78% state network complexity has grown significantly over the last few years while 84% regularly learn about network issues from users. It is imperative we adopt a new approach to managing today's network experiences ...
