Skip to content
Thursday, 19 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

“API” — 196 articles ✕

Models· Important· 🧪 Worth Testing

OpenAI adds optional 12-hour prompt caching to the Responses API

OpenAI's Responses API now supports a 12-hour prompt cache option, keeping shared instructions, tools and context cached for longer so repeated requests hours apart can still benefit from cheaper cached-input pricing. Writing to this longer cache costs 2.5x the standard input token price. This is an optional setting alongside the existing shorter default cache.

OpenAI API Changelog
Agents· Important· 🧪 Worth Testing

AWS launches Agent Registry for runtime discovery of MCP tools and agents

AWS introduced Agent Registry, a managed catalog service for Model Context Protocol (MCP) servers, agents, and agent skills. Instead of hardcoding every tool into an orchestrator, agents can now search an approved, versioned catalog at runtime and build a client from the returned descriptor. A reference sample demonstrates a Discover → Instantiate → Execute loop using Amazon Bedrock AgentCore Gateway and AgentCore runtime, with Anthropic Claude Sonnet as the foundation model.

AWS Machine Learning
Agents· 🧪 Worth Testing

Eon uses AWS Bedrock AgentCore to build a single MCP gateway for multi-cloud incident investigation

Eon, a data protection ISV running on AWS, replaced per-tool credentials and local MCP servers with a single Amazon Bedrock AgentCore MCP Gateway. The gateway uses Cedar-based policies to enforce least-privilege access for both human engineers and an autonomous SRE agent running Claude on Amazon Bedrock, routing calls to MCP servers hosted on AgentCore Runtimes across multiple AWS accounts. Developer onboarding time dropped from about two days to about two minutes after rolling the system out to 100+ developers and roughly 10,000 sessions.

AWS Machine Learning
Agents· Important· 🧪 Worth Testing

AWS and Keyfactor show how to lock down multi-agent identity using certificates instead of shared tokens

AWS and Keyfactor published a reference design that fixes a known weak point in Model Context Protocol (MCP) deployments: MCP has no built-in way to authenticate which agent is actually making a request. The architecture adds three trust layers — user-to-system, agent-to-agent, and agent-to-tool-server — built on signed request envelopes, delegation assertions signed by the user, RFC 8693 audience-restricted tokens, and live OCSP revocation checks. A working example runs on Amazon Bedrock and the AWS Strands Agents SDK with Keyfactor EJBCA issuing and validating the X.509 certificates, and the full code is on GitHub.

AWS Machine Learning
Voice AI· Important· 🧪 Worth Testing

Mistral launches Voxtral 3 voice stack: speech models plus a real-time agent SDK

Mistral AI released Voxtral 3, a set of speech recognition and speech synthesis models paired with an SDK that lets a single real-time pipeline listen, reason, call tools and speak back. The recognition models (Small, Mini and Realtime Transcribe 3) cover 50+ languages with speaker diarization, keyword-biasing for technical vocabulary, and transcription latency under 500ms, which Mistral claims beats Whisper, Scribe v2 and Gemini 3.5 Transcribe on its benchmarks. The speech synthesis model, Mini TTS 3, handles 35+ languages and 50+ dialects with emotion, pacing and emphasis that adapt to context, priced at $13 per million characters, and a separate Pro Voice feature can reproduce a person's voice and emotional range from just 30 minutes of recorded audio. All components can run through Mistral's EU-hosted API or be deployed on a customer's own servers.

Mistral AI
Agents· Important· 🧪 Worth Testing

IBM's ALTK-Evolve boosts customer-service agents with learned prompt guidelines, no fine-tuning needed

IBM Research's ALTK-Evolve extracts short behavioral rules from an agent's own training-task attempts and appends them to the system prompt of a basic ReAct agent running on GPT-4.1. On the τ²-bench customer-service benchmark (retail and airline domains), this learned-memory approach raised accuracy and reliability without updating model weights or using human annotation. The full 'lossless' guideline set pushed a GPT-4.1 agent to a retail Pass^4 score of 67.5%, topping the October 12, 2026 leaderboard snapshot, including beating a model fine-tuned specifically on synthetic retail data. The technique also improved a frontier GPT-5.5 agent on airline tasks, taking it to the top of that leaderboard as well.

Hugging Face
Agents· Important· 🧪 Worth Testing

llm-d 1.0 released: open-source Kubernetes-native inference stack matures for production

Red Hat, IBM, and Google announced llm-d 1.0, a Kubernetes-native distributed inference serving system that moves beyond proof-of-concept performance tricks into full production readiness. The release adds multi-tenant quality of service, zero-downtime operations, and agent-aware serving so the same endpoint can handle both human users and autonomous agents efficiently. In one test, llm-d's prefix-aware router captured 97% of available cache reuse on an agentic coding workload, and IBM/Red Hat ran 3,000 concurrent software-engineering agents for 5 to 10 times less cost than using the same model as a hosted service.

IBM Research
Agents· Important· 🧪 Worth Testing

Amazon Bedrock Enforces Schema-Accurate JSON for All Claude Models

AWS has rolled out structured outputs across every Anthropic Claude model hosted on Amazon Bedrock, reaching both the standard runtime endpoint and the newer Mantle endpoint built for agentic workloads. Instead of hoping the model returns valid JSON, developers can now lock responses to an exact schema through constrained decoding, which blocks the model from generating tokens that would break the format. A companion feature, strict tool use, applies the same guarantee to function-calling arguments so agent workflows don't fail on malformed inputs.

AWS Machine Learning
Voice AI· Important· 🧪 Worth Testing

Deepgram cuts batch transcription costs by porting Nova-3 to AWS Trainium2

AWS and Deepgram jointly rebuilt the Nova-3 speech-to-text model to run natively on Trainium2 chips instead of standard GPU-based PyTorch setups, targeting large offline transcription jobs. The work involved rewriting bottleneck layers as custom kernels and replacing Deepgram's Python serving layer with a Rust runtime calling Trainium directly. The result: a single trn2.3xlarge instance running eight parallel model copies delivers 11-70% more transcribed audio per dollar than Deepgram's prior infrastructure, with similar savings potentially available to customers self-hosting on SageMaker.

AWS Machine Learning
Research· Important· 🧪 Worth Testing

AWS introduces push-based KV transfer to cut latency in disaggregated vLLM inference

AWS released a push-based NIXL connector for vLLM that changes how key-value (KV) cache data moves between prefill and decode instances in disaggregated LLM serving. Instead of the decode instance pulling KV blocks after prefill finishes, the decode instance registers its target memory in advance and the prefill instance writes the KV data directly once ready, moving coordination work off the critical path. Benchmarked on a 1-prefill/1-decode Qwen3-32B deployment using EC2 P5en instances with EFA, push mode delivered up to 3x better time-to-first-token (TTFT) and up to 30% better time-per-output-token (TPOT) than the default pull mode, especially under high request rates.

AWS Machine Learning
Cyber Security· Important· 🧪 Worth Testing

Microsoft treats AI agents as insider threats, launches new containment controls

Microsoft announced an expansion of its Project Perception security framework to address risks from autonomous AI agents, framing them as a new category of 'insider' that needs distinct identity, permission, and risk controls. The update introduces Dynamic Permissions (least-privilege, task-scoped, time-bound access), Dynamic Agent Risk (continuous risk scoring based on behavior drift and context), and Dynamic Conditional Access (graduated responses from narrowing access to full runtime isolation). Microsoft is also extending discovery and identity support (Microsoft Entra Agent ID) to 60 types of local agents, including Claude Code, OpenAI Codex, and GitHub Copilot, and introducing 'Guardian Agents' that monitor and respond to risky agent behavior at machine speed.

Microsoft Security
Models· Important· 🧪 Worth Testing

DeepSeek upgrades V4.1 Flash model and opens its search API

DeepSeek released DeepSeek-V4.1-Flash-1017, an upgraded version of its Flash model, accessible through the same API endpoint and pricing as before. The update brings notable gains across agentic, coding, and tool-use benchmarks while reducing task runtime and output length. DeepSeek also detailed its in-house search engine, which now powers both web/app search and a developer-facing Search & Fetch API.

DeepSeek API Updates
Voice AI· Important· 🧪 Worth Testing

OpenAI makes custom voice generation available to every GPT-Live API user

OpenAI has rolled out prompt-to-voice access to all GPT-Live API customers, allowing a spoken voice to be designed simply by describing it in text, either through the API or the voice Playground, and then reused inside live voice sessions. Designing the voice costs nothing, but speaking with it still runs on normal GPT-Live session billing. Alongside this rollout, nine additional built-in voices covering German, French, Hindi, Japanese and Korean were added to the platform.

OpenAI API Changelog
Agents· 🧪 Worth Testing

Google Cloud outlines a three-layer agent architecture for high-compute, governed biotech workflows

Google Cloud published a reference architecture for building AI agents that coordinate long-running, GPU-heavy scientific tasks like protein folding and compound screening, which break standard single-LLM-agent setups due to timeouts and context overflow. The design separates a cognitive orchestrator (Gemini on Agent Runtime) from a GPU execution layer (NVIDIA NIMs like ESMFold and GenMol on GKE) and wraps both in an enterprise governance plane with agent identity, a gateway, a registry and Model Armor. It also lays out best practices such as passing bulky data by reference instead of inline, streaming progress updates, and gating irreversible actions behind human approval.

Google Cloud AI
Models· Important· 🧪 Worth Testing

IBM combines transcription, decision-making and chat in a single Granite Switch model

IBM has released Granite Switch 4.1 in 8B and 30B sizes, a modular system that runs chat, decision-making and speech transcription from one hosted endpoint instead of separate models. The update adds a general-purpose Decision adapter, a specialized Guardian adapter for safety-related classifications, and an embedded ASR model, Granite-Speech-5.0-Turbo-CTC, which tops the OpenASR Leaderboard. Despite bundling three capabilities, the combined model uses roughly the same VRAM as the base model alone.

Hugging Face
Cyber Security· Important· 🧪 Worth Testing

Google Adds DPoP Support to OAuth to Protect Refresh Tokens from Theft

Google has announced support for DPoP (Demonstrating Proof-of-Possession, RFC 9449) in its OAuth platform, cryptographically binding refresh tokens to a client-generated key pair so stolen tokens cannot be replayed by attackers. The protection applies only to long-lived refresh tokens, while short-lived access tokens remain standard Bearer tokens to avoid added cryptographic overhead on high-throughput API calls. Google also highlights DPoP's relevance for securing multi-agent and Model Context Protocol (MCP) architectures, recommending Google Cloud Secure Token Service for token delegation chains between agents.

Google Developers
Models· Important· 🧪 Worth Testing

Meta releases Muse Spark Open, an 816B-parameter open-weight multimodal MoE model

Meta published Muse Spark Open, an open-weight mixture-of-experts model with about 816 billion total parameters and 42 billion active per token. It accepts text, images, audio and video as input and generates text, with a context window of up to 1 million tokens. Meta positions it as a coding-optimized, agentic model built on top of the smaller Muse Glimmer architecture, calling it the most capable US open-weights model released so far.

Hugging Face
Agents· Important· 🧪 Worth Testing

AWS proposes 'Trust in Depth' framework to let AI agents act autonomously without losing control

AWS published a governance framework called Trust in Depth, designed to let AI agents operate with more autonomy while staying within enforceable limits. It combines scoping agent permissions before deployment, giving each agent a verifiable identity, enforcing boundaries at runtime via policy gateways, and observing agent behavior afterward. The framework leans on automated reasoning (mathematical proof) for rules that can be precisely defined, and human judgment for ambiguous cases, using AWS tools like Bedrock AgentCore, Guardrails, Kiro, Strands, Agent Registry and CloudWatch Omni.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Apertus 1.5 adds image/audio understanding, longer context and a thinking mode to the open 8B/70B models

Swiss AI released Apertus 1.5, a continued pretraining of its open Apertus 1.0 models (8B and 70B, Apache 2.0) with native image and experimental audio understanding, a 4x larger context window of 262,144 tokens, an optional thinking mode, and improved instruction-following and tool use. The models were trained on a total of 19T (8B) and 17T (70B) tokens, with full training data, recipes and intermediate checkpoints published for reproducibility. The team also published detailed, standardized evaluation cards and announced early API access from providers like Swisscom and Infomaniak, plus a roadmap for a ~600B-parameter MoE Apertus 2.0.

Hugging Face
Voice AI· Important· 🧪 Worth Testing

Deepgram's Flux STT cuts unwanted interruptions in Anam's avatar conversations by ~50%

Anam, which builds photorealistic interactive avatars, switched to Deepgram's Flux speech-to-text model to solve turn-taking problems in unscripted, real-time conversation. In A/B testing against a self-hosted open-source STT option, Flux cut unwanted avatar barge-ins by roughly 50% with no added latency penalty, and complaints about turn-taking on English sessions dropped to near zero. Anam deployed Flux self-hosted on its own Kubernetes/H100 infrastructure, rolling it out to 100% of turnkey users after a two-week self-hosted deployment (versus days for Deepgram's hosted option).

Deepgram
Cyber Security· Important· 🧪 Worth Testing

NCSC updates TLS guidance with post-quantum cryptography recommendations

The UK's NCSC has published updated TLS guidance adding recommended configurations for post-quantum cryptography (PQC), following the IETF's RFC 10024 on hybrid post-quantum/traditional key agreement for TLS 1.3. The guidance covers both hybrid PQC/traditional and pure PQC cipher choices, and is suitable for general use and government OFFICIAL information. Only TLS 1.3 supports PQC, so organisations still on TLS 1.2 or earlier are urged to upgrade. NCSC's existing migration timeline sets 2031 as the deadline for high-priority PQC migrations, and recommends starting now given that standardised configurations and library support already exist.

NCSC UK
Voice AI· 🧪 Worth Testing

Small Fine-Tuned Model Learns to Follow New Regulated Call Scripts Without Retraining

Researchers describe a system called FlowSpec that converts a creditor's legal call procedure into machine-readable instructions, tool restrictions, training signals and test cases for a voice agent. A 9-billion-parameter model was trained on calls covering nearly 300 randomly generated procedures, then tested on four procedures it had never encountered, including one entirely held-out family of scripts, to see whether compliance behavior transfers.

arXiv cs.CL
Agents· Important· 🧪 Worth Testing

Google brings MCP tool support to Apigee hybrid for on-premises and multi-cloud deployments

Google has released Apigee hybrid 1.17.0 (September 14, 2026), adding Model Context Protocol (MCP) support that runs entirely inside a customer's own Kubernetes cluster rather than on Google-managed infrastructure. This lets organizations with data-residency or regulatory requirements turn existing OpenAPI-described APIs into AI-agent-callable tools without MCP request traffic leaving their network. The feature reuses existing Apigee identity, security policies and API product controls, and it is an optional, off-by-default capability enabled via a Helm chart upgrade.

Google Developers
Agents· 🧪 Worth Testing

Claude Platform Gets Beta OpenTelemetry Tracing Support

Anthropic rolled out a beta tracing feature that exports OpenTelemetry spans from both the Messages API and Claude Managed Agents sessions. Developers using the Claude SDK can now capture these spans natively in seven languages: Python, TypeScript, C#, Go, Java, PHP, and Ruby. Enabling the feature requires setting up a destination for the telemetry data inside the Claude Console.

Claude Platform Release Notes