Skip to content
Monday, 23 November 2026
Tenesys AI News
Subscribe

AI Models

New models and versions from OpenAI, Anthropic, Google, Meta, Mistral, xAI, DeepSeek, Qwen and others.

#Cost Optimization — 3 articles ✕

Models· Important· 🧪 Worth Testing

Optimizing coding agent costs on Amazon Bedrock with NVIDIA NeMo Switchyard

Amazon has released a reference architecture that integrates the NVIDIA NeMo Switchyard library with LiteLLM to dynamically route coding agent requests between different models on Bedrock. By using stage or random routing, you can shift traffic between high-capability and high-efficiency models to balance performance and cost.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Cost-Efficient Agent Scaling via Knowledge Distillation on Amazon SageMaker

Amazon has published a workflow for using Sequence-Level Knowledge Distillation (SeqKD) to fine-tune smaller models on trajectories generated by frontier models. By using a 'teacher' model to generate successful tool-use trajectories and filtering them with a programmatic scorer, teams can train compact 'student' models that perform complex reasoning at a fraction of the cost.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

OpenAI adds optional 12-hour prompt caching to the Responses API

OpenAI's Responses API now supports a 12-hour prompt cache option, keeping shared instructions, tools and context cached for longer so repeated requests hours apart can still benefit from cheaper cached-input pricing. Writing to this longer cache costs 2.5x the standard input token price. This is an optional setting alongside the existing shorter default cache.

OpenAI API Changelog