NVIDIA introduced a workflow for turning production agent failures into structured test cases using NeMo Compass and NeMo Eval Author. This process analyzes trace logs to identify recurring issues, generates targeted evaluations, and validates harness improvements.
Amazon Bedrock AgentCore now supports Session endpoints, allowing developers to view and interact with web applications live as an AI coding agent builds them. By routing traffic through an authenticated, isolated microVM session, changes appear in the browser instantly without requiring separate deployments.
Google announced Public Preview of streaming support in API Gateway, covering Server-Sent Events, chunked/NDJSON responses, WebSockets and gRPC streaming. Streaming endpoints can now sit behind the same gateway as regular APIs, keeping existing authentication, logging and monitoring, without any changes to the API spec. Streams can stay open up to one hour, and gateways now get a predictable default hostname instead of a generated hash. The feature also ties into model routing, letting a single gateway stream responses from Gemini, Claude and OpenAI gpt-oss models.
Google has added an Extension System to its Agents CLI (from v1.5.0, with a first-party LangChain extension in v1.8.0) that lets developers override or add CLI commands without forking the tool. Previously, Agents CLI's deployment, evaluation and observability pipeline was tightly coupled to Google's own Agent Development Kit (ADK); now teams can scaffold, run, deploy and evaluate LangChain, LangGraph or Deep Agents projects through the same command surface. Extensions are distributed as directories in Git repositories, pinned to a commit SHA in a lockfile, and can be installed at project or user scope. The system also lets enterprise platform teams wrap commands like deploy with custom policies, such as compliance scans or SSO gates. The feature is marked experimental in v1.8.0.
Google Cloud has made Anthropic's Claude Opus 5.5 and Claude Sonnet 5.5 selectable inside its Antigravity agentic coding platform, alongside Gemini 3.8 Flash and Gemini 4 Argon. Developers can switch between model families mid-conversation across Antigravity 2.0, the CLI, and IDE extensions for VS Code, JetBrains and Visual Studio, all under one enterprise billing and security boundary. Google also describes two engineering patterns: using a second model family to independently review code written by the first ('LLM-as-a-judge'), and assigning fast Gemini Flash subagents to handle high-volume mechanical tasks while a stronger model handles deep reasoning.
Eon, a data protection ISV running on AWS, replaced per-tool credentials and local MCP servers with a single Amazon Bedrock AgentCore MCP Gateway. The gateway uses Cedar-based policies to enforce least-privilege access for both human engineers and an autonomous SRE agent running Claude on Amazon Bedrock, routing calls to MCP servers hosted on AgentCore Runtimes across multiple AWS accounts. Developer onboarding time dropped from about two days to about two minutes after rolling the system out to 100+ developers and roughly 10,000 sessions.
AWS released a push-based NIXL connector for vLLM that changes how key-value (KV) cache data moves between prefill and decode instances in disaggregated LLM serving. Instead of the decode instance pulling KV blocks after prefill finishes, the decode instance registers its target memory in advance and the prefill instance writes the KV data directly once ready, moving coordination work off the critical path. Benchmarked on a 1-prefill/1-decode Qwen3-32B deployment using EC2 P5en instances with EFA, push mode delivered up to 3x better time-to-first-token (TTFT) and up to 30% better time-per-output-token (TPOT) than the default pull mode, especially under high request rates.
Anthropic rolled out a beta tracing feature that exports OpenTelemetry spans from both the Messages API and Claude Managed Agents sessions. Developers using the Claude SDK can now capture these spans natively in seven languages: Python, TypeScript, C#, Go, Java, PHP, and Ruby. Enabling the feature requires setting up a destination for the telemetry data inside the Claude Console.
Google released ML Drift, an open-source, cross-platform GPU compute engine for on-device ML inference, replacing the legacy TFLite GPU delegate. It unifies shader handling across OpenGL ES, OpenCL, Metal and WebGPU, adds 5D tensor support, and introduces stage-aware optimizations for LLM prefill/decode. It is already running in production in Chrome, YouTube Shorts, Google Photos, Meet and partner apps from Adobe and Snap.
Google introduced AQuA (Ambient Quality Agent), a tool that runs continuously beside production AI agents inside a Google Cloud project to find failures that don't show up in logs or health checks, such as skipped validation steps or dropped context between sub-agents. It samples production session traces, grades them against a checklist, clusters recurring failure patterns, verifies clusters against full transcripts, and tracks them over time as new, recurring, or resolved. On request, it can also trace a failure back to the exact line of code or prompt responsible, using an immutable source snapshot captured at deploy time.
Google has released the Developer Knowledge API, a structured, machine-readable source for Google Cloud, Firebase and Android documentation aimed at AI agents and developer tooling. Instead of scraping web pages or relying on an LLM's training cutoff, agents and CLIs can now query fresh, Markdown-formatted docs through several interfaces: a gcloud CLI surface, an installable agent skill, client libraries, and a browser-based API explorer. The underlying index is refreshed frequently so retrieved answers stay close to the latest published documentation.
Google Cloud introduced, in public preview, a remote MCP server that exposes the gcloud and bq command-line tools to AI agents via two tools: run_gcloud_command and run_bq_command. The server runs in an isolated, network-restricted sandbox on Google Cloud infrastructure, removing the need for agents to install or maintain local CLI binaries. It uses Agent Identity, OAuth 2.0, and IAM for authentication, integrates with Model Armor to screen for prompt injection, and supports Cloud Audit Logging for full visibility into tool calls.