Skip to content
Friday, 20 November 2026
Tenesys AI News
Subscribe

AI Agents

AI agents, MCP, tool and function calling, coding and browser agents, multi-agent systems.

#Evaluation — 5 articles ✕

Agents· Important· 🧪 Worth Testing

AWS introduces framework-agnostic evaluation for AI agents

Amazon has released the Universal Agent Evaluation Framework (UAEF), an open-source tool designed to standardize the evaluation of AI agents. It uses adapters to normalize execution traces from various frameworks like LangChain and LangGraph into a single format, enabling consistent measurement across 36 metrics and 7 quality dimensions.

AWS Machine Learning
Agents· Important· 🧪 Worth Testing

Amazon Bedrock AgentCore adds native support for DeepEval and AutoEval

Amazon Bedrock AgentCore now includes a comprehensive catalog of built-in, third-party, and custom evaluators to monitor agent behavior in production. The platform allows you to run metrics from DeepEval and AutoEval in a managed environment, supporting on-demand, online, and batch evaluation workflows.

AWS Machine Learning
Agents· Important· 🧪 Worth Testing

Automate Agent Optimization with NVIDIA NeMo

NVIDIA introduced a workflow for turning production agent failures into structured test cases using NeMo Compass and NeMo Eval Author. This process analyzes trace logs to identify recurring issues, generates targeted evaluations, and validates harness improvements.

NVIDIA Developer
Agents· Important· 🧪 Worth Testing

Automated Quality Evaluation for AI Agents

Google released a new Agents CLI evaluation namespace designed to help developers perform 'hill-climbing'—an iterative process of improving agent performance through testing, grading, and analysis. The tool enables regression tracking by comparing agent traces across model swaps or prompt changes, surfacing issues like tool-use regressions that standard unit tests miss.

Google Developers
Agents· 🧪 Worth Testing

Siemens uses NVIDIA NeMo Gym to make chip-design agents faster and more accurate

NVIDIA published a case study showing how Siemens EDA applied its open NeMo Gym evaluation library to tighten up an agentic tool used for chip characterization. Instead of checking individual tool calls, the team scored complete final output files with a domain-specific verifier, then used the failure patterns to rewrite the agent's skill instructions and MCP tool descriptions. After several rounds of this loop, a composite accuracy benchmark climbed from roughly 55% to 95%, while the agent needed far fewer steps and far less output to get there. The experiments relied on about 25 evaluation rollouts running Claude Opus 4.8 as the agent model inside Claude Code.

NVIDIA Developer