Skip to content
Monday, 23 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

#Cost Optimization — 6 articles ✕

Automation· Important· 🧪 Worth Testing

Optimizing GKE node costs for long-running AI agent sessions

Google has released Agent Substrate 1.0, an open-source platform designed to handle AI agent sessions on Kubernetes. By separating stateful sessions from compute resources, it allows idle agents to be 'parked' in object storage, freeing up worker nodes.

Google Developers
Models· Important· 🧪 Worth Testing

Optimizing coding agent costs on Amazon Bedrock with NVIDIA NeMo Switchyard

Amazon has released a reference architecture that integrates the NVIDIA NeMo Switchyard library with LiteLLM to dynamically route coding agent requests between different models on Bedrock. By using stage or random routing, you can shift traffic between high-capability and high-efficiency models to balance performance and cost.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Cost-Efficient Agent Scaling via Knowledge Distillation on Amazon SageMaker

Amazon has published a workflow for using Sequence-Level Knowledge Distillation (SeqKD) to fine-tune smaller models on trajectories generated by frontier models. By using a 'teacher' model to generate successful tool-use trajectories and filtering them with a programmatic scorer, teams can train compact 'student' models that perform complex reasoning at a fraction of the cost.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

OpenAI adds optional 12-hour prompt caching to the Responses API

OpenAI's Responses API now supports a 12-hour prompt cache option, keeping shared instructions, tools and context cached for longer so repeated requests hours apart can still benefit from cheaper cached-input pricing. Writing to this longer cache costs 2.5x the standard input token price. This is an optional setting alongside the existing shorter default cache.

OpenAI API Changelog
Agents· Important· 🧪 Worth Testing

Cohere study: well-organized agent teams beat solo coding agents at a fraction of the cost

Cohere built a controlled testbed to study how teams of coding agents should be organized, testing where work is delegated, how leads wait on workers, which models play which role, team size, and communication patterns. On ProgramBench, well-organized teams outperformed single agents by up to ~10 percentage points but at 3–7x higher cost. The key finding: delegating only exploration and planning to workers matched the performance of delegating all stages (implementation and verification too) at half the cost, and a strong lead paired with 16 cheap planning workers reached 61.8% reward versus 63.2% for an all-strong-model team, cutting cost from $510 to $155.

Cohere
Agents· Important· 🧪 Worth Testing

Google launches 'Gemini agent': a single universal AI agent for work across Workspace and enterprise systems

Google Cloud announced the Gemini agent, a unified agent that combines chat, knowledge work, content creation, and coding into one interface accessible across devices and channels. It integrates directly inside Gmail, Docs, Sheets, Slides, Chat, and Calendar, connects to enterprise tools and databases via MCP and a tools registry, and orchestrates across multiple models — including Google's Gemini family and Anthropic's Claude — to balance quality and cost. Google also detailed security/governance features, cost controls like Smart Routing and spend caps, and shared customer results from companies like BNP Paribas, Bradesco, and Orange Spain.

Google Cloud AI