Google has updated its A2UI generative UI protocol to include swappable inference formats, addressing latency and reliability issues found in the previous Direct JSON approach. A new format, A2UI Express, reduces token usage by up to 3x and latency by up to 3x by using a concise Python-like syntax.
Researchers have introduced the Boa Compressor, an online tool utilizing a Mamba state-space model to compress long-form context into shorter representations in linear time. By distilling knowledge from full-context LLM interactions, this method allows for efficient per-query inference without the massive latency overhead of transformer-based compression.
Researchers introduced Recursive Semantic Divergence (RSD), an unsupervised metric that measures and penalizes inconsistency in LLM agent trajectories. By applying RSD as a reward signal during fine-tuning, models exhibit significantly more stable behavior and higher success rates across tool-use benchmarks.
Amazon Bedrock now supports explicit and implicit prompt caching for OpenAI models, allowing you to store and reuse static prompt prefixes like tools, instructions, and conversation history. By avoiding the re-processing of identical tokens across turns, you can significantly lower input costs and improve responsiveness in complex agent workflows.
Google Cloud has released IAM Helper, a suite of agent-facing building blocks designed to automate complex Identity and Access Management (IAM) workflows. By integrating with Google Cloud's core IAM engines via MCP (Model Context Protocol), these tools enable autonomous agents to handle tasks like troubleshooting 403 errors, simulating policy impacts, and requesting just-in-time access.
Google has updated the Gemini API to automatically store requests (store=true) for all new projects on the paid tier. This change aligns standard content generation methods with the Interactions API, requiring developers to manually opt out if they prefer not to store request data.
This research introduces a verification-based framework that refines multimodal emotion reasoning in AI agents. Instead of retraining models, the system identifies specific component failures and applies targeted prompt updates to improve performance.
A malicious version of the LiteLLM package (1.107.0) was distributed via PyPI, executing code automatically whenever Python started in an affected environment. The payload targeted credentials across developer tools, cloud providers, and AI configurations without requiring the LiteLLM package to be explicitly imported by the application.
Amazon Bedrock AgentCore is a new service designed to streamline the deployment and management of multi-agent architectures. It handles agent hosting, secure tool access via MCP, and session isolation, enabling teams to focus on agent behavior rather than operational overhead.
Amazon has released TorchNeuron, an open-source backend that lets existing PyTorch code run on AWS Trainium accelerators without major rewrites. The release introduces a new execution mode plus layered caching to reduce recompilation, and its reliability was validated through an AI-agent-driven testing pipeline that distilled hundreds of thousands of Hugging Face models down to a manageable benchmark set. Internal large-model tests reported roughly a 33% reduction in the delay before the first training step begins.
Z.ai's GLM 5.3 Flash, a multimodal 320B-parameter Mixture-of-Experts model with 18B active parameters, is now available through Mistral's platform. It offers a 1M-token context window and is built for developer agent workflows, visual coding, and complex tool-use tasks. Pricing is set at $0.15 per million input tokens, $0.03 per million cached input tokens, and $0.50 per million output tokens.
AWS announced general availability of training sessions within Amazon SageMaker AI serverless model customization. Teams can write their own post-training loops — including custom loss functions and reward signals for reinforcement learning — while SageMaker AI handles GPU allocation, distributed execution, fault recovery, and checkpoint storage. Supported techniques include SFT, DPO, RLVR, RLAIF, and multi-turn RL, and users can choose LoRA or full fine-tuning. The feature supports models including gpt-oss-20b, gemma-4-31B-it, Qwen3.6-27B, and Qwen3.8-27B, and billing is based on tokens processed, pausing while a user's reward function scores responses.
Google announced Public Preview of streaming support in API Gateway, covering Server-Sent Events, chunked/NDJSON responses, WebSockets and gRPC streaming. Streaming endpoints can now sit behind the same gateway as regular APIs, keeping existing authentication, logging and monitoring, without any changes to the API spec. Streams can stay open up to one hour, and gateways now get a predictable default hostname instead of a generated hash. The feature also ties into model routing, letting a single gateway stream responses from Gemini, Claude and OpenAI gpt-oss models.
AWS published a walkthrough for the Adaptive Agentic Intelligence Framework (AAIF), built on Strands Agents, which routes simple requests to small local models (via Ollama) and only sends complex requests to cloud models through Amazon Bedrock. A lightweight 1B-parameter model (llama3.2:1b) acts as an orchestrator deciding where each request should go, with an example IoT monitoring agent that uses local telemetry retrieval, local vision analysis, and cloud-based expert insights. AWS states that in the hybrid setup, roughly 80 percent of traffic can be handled locally without hitting a paid API, and the architecture can run fully on edge hardware (e.g. Raspberry Pi with 8GB memory), fully in the cloud, or in a hybrid mode.
Cloudflare has launched full transaction detection and response rules for its web application firewall, which evaluate both the HTTP request and the origin's response to confirm whether an attack actually succeeded. Previously the WAF only inspected incoming requests, which could miss exploits that only reveal themselves in the response (e.g. leaked file contents) or create false positives when blocking based on request signatures alone. The first managed protections target the recently disclosed php2shell vulnerability, and the feature is generally available to all customers, including Free plans.
NVIDIA has added three new open, commercially licensed components to its Nemotron Retriever lineup: Embed models (8B and 1B, in BF16 and NVFP4) for searching text and images, a Rerank model (8B) that reorders retrieved evidence by relevance, and a compact 631M Parse model that converts document images into structured text. The goal is to feed AI agents with better, more relevant evidence so they need fewer search rounds and fewer inference tokens to answer a question. NVIDIA reports the new Embed and Rerank models top the ViDoRe v3.1 leaderboards for dense retrieval and reranking respectively.
NVIDIA has published OpenShell, an open-source runtime that treats agent workloads as untrusted and grants access to files, tools and systems only when needed. It pairs with the new NVIDIA Vera CPU and, optionally, BlueField-4 DPUs with NVIDIA Sentry for hardware-enforced monitoring. NVIDIA says this combination forms a full reference architecture for running autonomous agents safely at data-center scale.
NVIDIA has detailed Sentry, a new security framework that sits outside an AI agent's reach, enforcing policy and watching behavior from a dedicated hardware trust domain on BlueField-4 DPUs. The idea is simple: even if an agent is compromised or goes off-script while using tools and credentials, Sentry keeps watching and can cut it off because it doesn't depend on the host OS the agent runs on. Two components do the work — DOCA Tower, a proxy that inspects and authorizes every agent network request, and DOCA Argus, which reads live memory to understand what's actually running. When something looks wrong, the system can quarantine the agent within milliseconds, without needing the agent or the host to cooperate.
Google Cloud has made Anthropic's Claude Opus 5.5 and Claude Sonnet 5.5 selectable inside its Antigravity agentic coding platform, alongside Gemini 3.8 Flash and Gemini 4 Argon. Developers can switch between model families mid-conversation across Antigravity 2.0, the CLI, and IDE extensions for VS Code, JetBrains and Visual Studio, all under one enterprise billing and security boundary. Google also describes two engineering patterns: using a second model family to independently review code written by the first ('LLM-as-a-judge'), and assigning fast Gemini Flash subagents to handle high-volume mechanical tasks while a stronger model handles deep reasoning.
AWS introduced Agent Registry, a managed catalog service for Model Context Protocol (MCP) servers, agents, and agent skills. Instead of hardcoding every tool into an orchestrator, agents can now search an approved, versioned catalog at runtime and build a client from the returned descriptor. A reference sample demonstrates a Discover → Instantiate → Execute loop using Amazon Bedrock AgentCore Gateway and AgentCore runtime, with Anthropic Claude Sonnet as the foundation model.
Eon, a data protection ISV running on AWS, replaced per-tool credentials and local MCP servers with a single Amazon Bedrock AgentCore MCP Gateway. The gateway uses Cedar-based policies to enforce least-privilege access for both human engineers and an autonomous SRE agent running Claude on Amazon Bedrock, routing calls to MCP servers hosted on AgentCore Runtimes across multiple AWS accounts. Developer onboarding time dropped from about two days to about two minutes after rolling the system out to 100+ developers and roughly 10,000 sessions.
AWS and Keyfactor published a reference design that fixes a known weak point in Model Context Protocol (MCP) deployments: MCP has no built-in way to authenticate which agent is actually making a request. The architecture adds three trust layers — user-to-system, agent-to-agent, and agent-to-tool-server — built on signed request envelopes, delegation assertions signed by the user, RFC 8693 audience-restricted tokens, and live OCSP revocation checks. A working example runs on Amazon Bedrock and the AWS Strands Agents SDK with Keyfactor EJBCA issuing and validating the X.509 certificates, and the full code is on GitHub.
IBM Research's ALTK-Evolve extracts short behavioral rules from an agent's own training-task attempts and appends them to the system prompt of a basic ReAct agent running on GPT-4.1. On the τ²-bench customer-service benchmark (retail and airline domains), this learned-memory approach raised accuracy and reliability without updating model weights or using human annotation. The full 'lossless' guideline set pushed a GPT-4.1 agent to a retail Pass^4 score of 67.5%, topping the October 12, 2026 leaderboard snapshot, including beating a model fine-tuned specifically on synthetic retail data. The technique also improved a frontier GPT-5.5 agent on airline tasks, taking it to the top of that leaderboard as well.
Red Hat, IBM, and Google announced llm-d 1.0, a Kubernetes-native distributed inference serving system that moves beyond proof-of-concept performance tricks into full production readiness. The release adds multi-tenant quality of service, zero-downtime operations, and agent-aware serving so the same endpoint can handle both human users and autonomous agents efficiently. In one test, llm-d's prefix-aware router captured 97% of available cache reuse on an agentic coding workload, and IBM/Red Hat ran 3,000 concurrent software-engineering agents for 5 to 10 times less cost than using the same model as a hosted service.