Skip to content
Sunday, 22 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

#Latency — 3 articles ✕

Agents· Important· 🧪 Worth Testing

Google Launches Tool Retrieval for Gemini API Agents

Google has introduced Tool Retrieval, a new preview feature for the Gemini Interactions API that allows agents to load tool schemas on demand. By keeping only names and descriptions in the context and fetching parameter details only when needed, developers can handle large tool libraries without bloating input tokens.

Google AI
Automation· Important· 🧪 Worth Testing

Optimizing large JSON workloads for AI agents

AWS details three strategies to manage massive JSON payloads (20MB+) in AI agents, achieving up to 71% fewer tokens and 80% lower latency. The approach involves offloading state to Amazon S3, paginating large tool results, and compacting dictionary outputs.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Amazon SageMaker AI introduces KV cache-aware routing for LLMs

Amazon SageMaker AI has launched a new 'KV_AWARE' routing strategy that directs LLM inference requests to instances based on their actual KV cache state rather than just prompt headers. This optimizes multi-turn conversations and long-context workloads by ensuring requests land where relevant data is already cached.

AWS Machine Learning