Skip to content
Monday, 23 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

#Cost Optimization — 5 articles ✕

Automation· Important· 🧪 Worth Testing

Optimizing GKE node costs for long-running AI agent sessions

Google has released Agent Substrate 1.0, an open-source platform designed to handle AI agent sessions on Kubernetes. By separating stateful sessions from compute resources, it allows idle agents to be 'parked' in object storage, freeing up worker nodes.

Google Developers
Models· Important· 🧪 Worth Testing

Optimizing coding agent costs on Amazon Bedrock with NVIDIA NeMo Switchyard

Amazon has released a reference architecture that integrates the NVIDIA NeMo Switchyard library with LiteLLM to dynamically route coding agent requests between different models on Bedrock. By using stage or random routing, you can shift traffic between high-capability and high-efficiency models to balance performance and cost.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Cost-Efficient Agent Scaling via Knowledge Distillation on Amazon SageMaker

Amazon has published a workflow for using Sequence-Level Knowledge Distillation (SeqKD) to fine-tune smaller models on trajectories generated by frontier models. By using a 'teacher' model to generate successful tool-use trajectories and filtering them with a programmatic scorer, teams can train compact 'student' models that perform complex reasoning at a fraction of the cost.

AWS Machine Learning
Agents· 🧪 Worth Testing

AWS shows hybrid local-plus-cloud agent framework to cut LLM costs

AWS published a walkthrough for the Adaptive Agentic Intelligence Framework (AAIF), built on Strands Agents, which routes simple requests to small local models (via Ollama) and only sends complex requests to cloud models through Amazon Bedrock. A lightweight 1B-parameter model (llama3.2:1b) acts as an orchestrator deciding where each request should go, with an example IoT monitoring agent that uses local telemetry retrieval, local vision analysis, and cloud-based expert insights. AWS states that in the hybrid setup, roughly 80 percent of traffic can be handled locally without hitting a paid API, and the architecture can run fully on edge hardware (e.g. Raspberry Pi with 8GB memory), fully in the cloud, or in a hybrid mode.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

OpenAI adds optional 12-hour prompt caching to the Responses API

OpenAI's Responses API now supports a 12-hour prompt cache option, keeping shared instructions, tools and context cached for longer so repeated requests hours apart can still benefit from cheaper cached-input pricing. Writing to this longer cache costs 2.5x the standard input token price. This is an optional setting alongside the existing shorter default cache.

OpenAI API Changelog