Skip to main content

Galileo Releases Agentic Evaluations

Galileo unveiled Agentic Evaluations, a solution for evaluating the performance of AI agents powered by large language models (LLMs). 

With Agentic Evaluations, developers gain the tools and insights needed to optimize agent performance and reliability at every step—ensuring readiness for real-world deployment.

"AI agents are unlocking a new era of innovation, but their complexity has made it difficult for developers to understand where failures occur and why," said Vikram Chatterji, CEO and co-founder of Galileo. "With LLMs driving decision-making, teams need tools to pinpoint and understand an agent's failure modes. Agentic Evaluations delivers unprecedented visibility into every action, across entire workflows, empowering developers to build, ship, and scale reliable, trustworthy AI solutions."

Galileo's Agentic Evaluations offers an end-to-end framework that offers both system-level and step-by-step evaluation, enabling developers to build reliable, resilient, and high-performing AI agents.

Key capabilities include:

  • Complete Visibility into Agent Workflows: Gain a clear view of entire multi-step agent completions, from input to final action, with comprehensive tracing and simple visualizations that help developers quickly pinpoint inefficiencies and errors in agent sessions.
  • Agent-Specific Metrics: Measure agent performance at every level with proprietary, research-backed metrics built to evaluate agents at multiple levels.
    • LLM Planner: Assess tool selection quality and passing on the right instructions.
    • Tool Calls: Assess errors in individual tool completions.
    • Overall session success: Measure overall task completion and successful agentic interactions.
  • Granular Cost and Latency Tracking: Optimize the cost-effectiveness of agents with aggregate tracking for cost, latency, and errors across sessions and spans.
  • Seamless Integrations: Support for popular AI frameworks like LangGraph and CrewAI.
  • Proactive Insights: Alerts and dashboards help developers identify systemic issues and uncover actionable insights for continuous improvement such as failed tool calls or misalignment between the final action and initial instructions.

Agentic Evaluations is now available to all Galileo users.

The Latest

The gap is widening between what teams spend on observability tools and the value they receive amid surging data volumes and budget pressures, according to The Breaking Point for Observability Leaders, a report from Imply ...

Seamless shopping is a basic demand of today's boundaryless consumer — one with little patience for friction, limited tolerance for disconnected experiences and minimal hesitation in switching brands. Customers expect intuitive, highly personalized experiences and the ability to move effortlessly across physical and digital channels within the same journey. Failure to deliver can cost dearly ...

If your best engineers spend their days sorting tickets and resetting access, you are wasting talent. New global data shows that employees in the IT sector rank among the least motivated across industries. They're under a lot of pressure from many angles. Pressure to upskill and uncertainty around what agentic AI means for job security is creating anxiety. Meanwhile, these roles often function like an on-call job and require many repetitive tasks ...

In a 2026 survey conducted by Liquibase, the research found that 96.5% of organizations reported at least one AI or LLM interaction with their production databases, often through analytics and reporting, training pipelines, internal copilots, and AI generated SQL. Only a small fraction reported no interaction at all. That means the database is no longer a downstream system that AI "might" reach later. AI is already there ...

In many organizations, IT still operates as a reactive service provider. Systems are managed through fragmented tools, teams focus heavily on operational metrics, and business leaders often see IT as a necessary cost center rather than a strategic partner. Even well-run ITIL environments can struggle to bridge the gap between operational excellence and business impact. This is where the concept of ITIL+ comes in ...

UK IT leaders are reaching a critical inflection point in how they manage observability, according to research from LogicMonitor. As infrastructure complexity grows and AI adoption accelerates, fragmented monitoring environments are driving organizations to rethink their operational strategies and consolidate tools ...

For years, many infrastructure teams treated the edge as a deployment variation. It was seen as the same cloud model, only stretched outward: more devices, more gateways, more locations and a little more latency. That assumption is proving costly. The edge is not just another place to run workloads. It is a fundamentally different operating condition ...

AI can't fix broken data. CIOs who modernize revenue data governance unlock predictable growth-those who don't risk millions in failed AI investments. For decades, CIOs kept the lights on. Revenue was someone else's problem, owned by sales, led by the CRO, measured by finance. Those days are behind us ...

Over the past few years, organizations have made enormous strides in enabling remote and hybrid work. But the foundational technologies powering today's digital workplace were never designed for the volume, velocity, and complexity that is coming next. By 2026 and beyond, three forces — 5G, the metaverse, and edge AI — will fundamentally reshape how people connect, collaborate, and access enterprise resources ... The businesses that begin preparing now will gain a competitive head start. Those that wait will find themselves trying to secure environments that have already outgrown their architecture ...

Ask where enterprise AI is making its most decisive impact, and the answer might surprise you: not marketing, not finance, not customer experience. It's IT. Across three years of industry research conducted by Digitate, one constant holds true is that IT is both the testing ground and the proving ground for enterprise AI. Last year, that position only strengthened ...

Galileo Releases Agentic Evaluations

Galileo unveiled Agentic Evaluations, a solution for evaluating the performance of AI agents powered by large language models (LLMs). 

With Agentic Evaluations, developers gain the tools and insights needed to optimize agent performance and reliability at every step—ensuring readiness for real-world deployment.

"AI agents are unlocking a new era of innovation, but their complexity has made it difficult for developers to understand where failures occur and why," said Vikram Chatterji, CEO and co-founder of Galileo. "With LLMs driving decision-making, teams need tools to pinpoint and understand an agent's failure modes. Agentic Evaluations delivers unprecedented visibility into every action, across entire workflows, empowering developers to build, ship, and scale reliable, trustworthy AI solutions."

Galileo's Agentic Evaluations offers an end-to-end framework that offers both system-level and step-by-step evaluation, enabling developers to build reliable, resilient, and high-performing AI agents.

Key capabilities include:

  • Complete Visibility into Agent Workflows: Gain a clear view of entire multi-step agent completions, from input to final action, with comprehensive tracing and simple visualizations that help developers quickly pinpoint inefficiencies and errors in agent sessions.
  • Agent-Specific Metrics: Measure agent performance at every level with proprietary, research-backed metrics built to evaluate agents at multiple levels.
    • LLM Planner: Assess tool selection quality and passing on the right instructions.
    • Tool Calls: Assess errors in individual tool completions.
    • Overall session success: Measure overall task completion and successful agentic interactions.
  • Granular Cost and Latency Tracking: Optimize the cost-effectiveness of agents with aggregate tracking for cost, latency, and errors across sessions and spans.
  • Seamless Integrations: Support for popular AI frameworks like LangGraph and CrewAI.
  • Proactive Insights: Alerts and dashboards help developers identify systemic issues and uncover actionable insights for continuous improvement such as failed tool calls or misalignment between the final action and initial instructions.

Agentic Evaluations is now available to all Galileo users.

The Latest

The gap is widening between what teams spend on observability tools and the value they receive amid surging data volumes and budget pressures, according to The Breaking Point for Observability Leaders, a report from Imply ...

Seamless shopping is a basic demand of today's boundaryless consumer — one with little patience for friction, limited tolerance for disconnected experiences and minimal hesitation in switching brands. Customers expect intuitive, highly personalized experiences and the ability to move effortlessly across physical and digital channels within the same journey. Failure to deliver can cost dearly ...

If your best engineers spend their days sorting tickets and resetting access, you are wasting talent. New global data shows that employees in the IT sector rank among the least motivated across industries. They're under a lot of pressure from many angles. Pressure to upskill and uncertainty around what agentic AI means for job security is creating anxiety. Meanwhile, these roles often function like an on-call job and require many repetitive tasks ...

In a 2026 survey conducted by Liquibase, the research found that 96.5% of organizations reported at least one AI or LLM interaction with their production databases, often through analytics and reporting, training pipelines, internal copilots, and AI generated SQL. Only a small fraction reported no interaction at all. That means the database is no longer a downstream system that AI "might" reach later. AI is already there ...

In many organizations, IT still operates as a reactive service provider. Systems are managed through fragmented tools, teams focus heavily on operational metrics, and business leaders often see IT as a necessary cost center rather than a strategic partner. Even well-run ITIL environments can struggle to bridge the gap between operational excellence and business impact. This is where the concept of ITIL+ comes in ...

UK IT leaders are reaching a critical inflection point in how they manage observability, according to research from LogicMonitor. As infrastructure complexity grows and AI adoption accelerates, fragmented monitoring environments are driving organizations to rethink their operational strategies and consolidate tools ...

For years, many infrastructure teams treated the edge as a deployment variation. It was seen as the same cloud model, only stretched outward: more devices, more gateways, more locations and a little more latency. That assumption is proving costly. The edge is not just another place to run workloads. It is a fundamentally different operating condition ...

AI can't fix broken data. CIOs who modernize revenue data governance unlock predictable growth-those who don't risk millions in failed AI investments. For decades, CIOs kept the lights on. Revenue was someone else's problem, owned by sales, led by the CRO, measured by finance. Those days are behind us ...

Over the past few years, organizations have made enormous strides in enabling remote and hybrid work. But the foundational technologies powering today's digital workplace were never designed for the volume, velocity, and complexity that is coming next. By 2026 and beyond, three forces — 5G, the metaverse, and edge AI — will fundamentally reshape how people connect, collaborate, and access enterprise resources ... The businesses that begin preparing now will gain a competitive head start. Those that wait will find themselves trying to secure environments that have already outgrown their architecture ...

Ask where enterprise AI is making its most decisive impact, and the answer might surprise you: not marketing, not finance, not customer experience. It's IT. Across three years of industry research conducted by Digitate, one constant holds true is that IT is both the testing ground and the proving ground for enterprise AI. Last year, that position only strengthened ...