New Relic announced monitoring for ChatGPT apps.
The solution gives businesses the ability to monitor the performance, reliability, and user experience of custom ChatGPT apps, extending critical insights to developers so they can proactively resolve costly application issues and confidently capitalize on opportunities with generative AI.
“Bringing business services into the natural flow of a ChatGPT conversation is a powerful, intuitive, and revenue-generating strategy,” said New Relic Chief Product Officer Brian Emerson. “But once your carefully crafted application instantiates inside ChatGPT, it traditionally enters a black box where standard browser monitoring tools can fail. At New Relic, we’ve worked quickly to stay steps ahead of customers who want to maximize this opportunity, ensuring that businesses monetizing gen AI aren't flying blind when it comes to user experience and system health.”
ChatGPT app monitoring offers deep telemetry to ensure AI-generated UIs are functional, high-performing, and conversion-ready. Before developers can begin to fix a hallucination, they have to know about it. Traditional telemetry remains the backbone of this visibility, and New Relic’s browser agent is uniquely equipped to collect and analyze the data. The agent delivers instant insight into the latency and connectivity of an application within the GPT i-frame, alerts developers if a dynamic AI response triggers script or syntax failures in the user's browser, and catches log items triggered to the console — providing real time granular monitoring.
New Relic automatically tracks exactly how a user interacts with the content in the business’s custom app, from successfully clicking "buy now" to not engaging at all. Businesses are in control of specific benchmarks and event-driven analytics. For example, users can send a custom event every time an LLM successfully populates a chart according to specification, allowing developers to build dashboards that track "AI Render Success" versus "User Bounce Rate." With New Relic, developers can stop guessing how their app performs when it’s hosted by someone else, while also maintaining the highest security and privacy standards.
The ChatGPT app monitoring solution delivers:
- User Frustration Detection: Rage clicks, error clicks, and dead clicks can help identify when an application is causing friction for end users.
- Layout Instability Monitoring: Track Cumulative Layout Shift (CLS) within the i-frame as the AI streams content in. Excessive CLS can cause a frustrating user experience.
- Cross-Origin Insights: Gain a deep understanding of how an application performs when it doesn't own the top-level window, helping developers optimize for different host environments.
- End-to-End Traceability: Connect the user's interaction in the ChatGPT i-frame all the way through to backend services, providing a complete picture of every transaction.
ChatGPT app monitoring is now available as part of the New Relic Intelligent Observability Platform.
The Latest
For decades, traditional observability tools have forced IT professionals to sift through endless dashboards, turning a flood of alerts into actionable insight and driving widespread burnout. While enterprises adopted AI to eliminate this friction, most still deploy it reactively rather than proactively ... As systems become more complex and IT moves to the center of business strategy, a reactive posture is unsustainable ...
Ask an operations team what they monitor and you will hear a familiar list: latency, errors, throughput, uptime. Those signals still matter for AI, but they no longer answer the most important question. As Krishna Sai, CTO of SolarWinds, puts it: "Traditional observability tells you a system is running. AI observability tells you whether it's still reasoning soundly. Those are completely different questions" ...
AI observability serves several roles across an organization. AI engineers use it to build, evaluate, and improve AI systems. SREs use it to operate those systems reliably and efficiently in production, including managing their cost. Leaders need it to connect AI behavior and operational performance to business outcomes. The common need is a clear understanding of whether AI systems are delivering the intended result ...
Part 4 outlines the challenges enterprise face when adopting AI observability. The main challenge is that AI complexity compounds at every stage of maturity. LLM-based applications introduce new behavior, dependencies, and quality considerations, while Agentic AI adds further failure modes as systems make decisions and take actions ...
Part 3 reports on the current state of AI observability. Most experts agree: enterprises are moving faster with AI than they are with the operational discipline needed to run it safely ...
When discussing AI Observability, one of the first questions that arises: Is this just an extension of traditional observability or is this a whole new type of tool? Part 2 compares traditional observability with AI observability ...
In this extensive 14-part series that will post over the next three weeks, experts across observability and AI will provide insight and opinions on the need for AI Observability, the challenges, the benefits, the current state, and predictions for the future ...
Amid rising complexity, organizations are moving quickly toward agent-driven operations: AgenticOps, according to The Impact of Agentic AI on Network Operations, a new report from Cisco ...
AI, automation, and enterprise software give organizations an extraordinary amount of leverage. Work that once required hours can happen in minutes. Information buried across systems can be analyzed almost instantly. Complex workflows can be coordinated across teams with far less manual intervention. That leverage creates a temptation to start with the technology ...
Everyone wants to talk about models. Compute clusters. Benchmark scores that climb a fraction of a point and make headlines anyway. It's an easy conversation to have because it's measurable. But it's also increasingly beside the point ...