Google has released Agent Substrate 1.0, an open-source platform designed to handle AI agent sessions on Kubernetes. By separating stateful sessions from compute resources, it allows idle agents to be 'parked' in object storage, freeing up worker nodes.
Amazon has released a reference architecture that integrates the NVIDIA NeMo Switchyard library with LiteLLM to dynamically route coding agent requests between different models on Bedrock. By using stage or random routing, you can shift traffic between high-capability and high-efficiency models to balance performance and cost.
Amazon has published a workflow for using Sequence-Level Knowledge Distillation (SeqKD) to fine-tune smaller models on trajectories generated by frontier models. By using a 'teacher' model to generate successful tool-use trajectories and filtering them with a programmatic scorer, teams can train compact 'student' models that perform complex reasoning at a fraction of the cost.
OpenAI's Responses API now supports a 12-hour prompt cache option, keeping shared instructions, tools and context cached for longer so repeated requests hours apart can still benefit from cheaper cached-input pricing. Writing to this longer cache costs 2.5x the standard input token price. This is an optional setting alongside the existing shorter default cache.
Cohere built a controlled testbed to study how teams of coding agents should be organized, testing where work is delegated, how leads wait on workers, which models play which role, team size, and communication patterns. On ProgramBench, well-organized teams outperformed single agents by up to ~10 percentage points but at 3–7x higher cost. The key finding: delegating only exploration and planning to workers matched the performance of delegating all stages (implementation and verification too) at half the cost, and a strong lead paired with 16 cheap planning workers reached 61.8% reward versus 63.2% for an all-strong-model team, cutting cost from $510 to $155.
Google Cloud announced the Gemini agent, a unified agent that combines chat, knowledge work, content creation, and coding into one interface accessible across devices and channels. It integrates directly inside Gmail, Docs, Sheets, Slides, Chat, and Calendar, connects to enterprise tools and databases via MCP and a tools registry, and orchestrates across multiple models — including Google's Gemini family and Anthropic's Claude — to balance quality and cost. Google also detailed security/governance features, cost controls like Smart Routing and spend caps, and shared customer results from companies like BNP Paribas, Bradesco, and Orange Spain.