Skip to content
Thursday, 19 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

#Developer Tools — 9 articles ✕

Agents· Important· 🧪 Worth Testing

Automate Agent Optimization with NVIDIA NeMo

NVIDIA introduced a workflow for turning production agent failures into structured test cases using NeMo Compass and NeMo Eval Author. This process analyzes trace logs to identify recurring issues, generates targeted evaluations, and validates harness improvements.

NVIDIA Developer
Agents· Important· 🧪 Worth Testing

Real-time web application previews for Amazon Bedrock coding agents

Amazon Bedrock AgentCore now supports Session endpoints, allowing developers to view and interact with web applications live as an AI coding agent builds them. By routing traffic through an authenticated, isolated microVM session, changes appear in the browser instantly without requiring separate deployments.

AWS Machine Learning
Agents· Important· 🧪 Worth Testing

Google API Gateway adds streaming support for real-time and AI traffic

Google announced Public Preview of streaming support in API Gateway, covering Server-Sent Events, chunked/NDJSON responses, WebSockets and gRPC streaming. Streaming endpoints can now sit behind the same gateway as regular APIs, keeping existing authentication, logging and monitoring, without any changes to the API spec. Streams can stay open up to one hour, and gateways now get a predictable default hostname instead of a generated hash. The feature also ties into model routing, letting a single gateway stream responses from Gemini, Claude and OpenAI gpt-oss models.

Google Developers
Agents· Important· 🧪 Worth Testing

Google's Agents CLI gets an Extension System to support LangChain and other frameworks beyond ADK

Google has added an Extension System to its Agents CLI (from v1.5.0, with a first-party LangChain extension in v1.8.0) that lets developers override or add CLI commands without forking the tool. Previously, Agents CLI's deployment, evaluation and observability pipeline was tightly coupled to Google's own Agent Development Kit (ADK); now teams can scaffold, run, deploy and evaluate LangChain, LangGraph or Deep Agents projects through the same command surface. Extensions are distributed as directories in Git repositories, pinned to a commit SHA in a lockfile, and can be installed at project or user scope. The system also lets enterprise platform teams wrap commands like deploy with custom policies, such as compliance scans or SSO gates. The feature is marked experimental in v1.8.0.

Google Developers
Research· Important

Google and Meta bring native TPU support to PyTorch's TorchTitan training framework

Google introduced TorchTPU, a native PyTorch backend for Cloud TPUs (torch.device("tpu")), and co-developed a fork of Meta's TorchTitan trainer adapted for TPU training. Previously, running PyTorch training on TPUs meant rewriting code in JAX or relying on the older torch_xla path; now only minimal device-initialization changes are needed. The fork provides tested recipes for pre-training large dense models (Llama 3 70B/405B, Qwen 3 8B/32B), Mixture-of-Experts models (Qwen 3 235B), and diffusion transformers (FLUX.1 12B), plus a 'Graph Trainer' that captures an entire training step as one XLA program for better compiler optimization.

Google Developers
Research· Important· 🧪 Worth Testing

AWS introduces push-based KV transfer to cut latency in disaggregated vLLM inference

AWS released a push-based NIXL connector for vLLM that changes how key-value (KV) cache data moves between prefill and decode instances in disaggregated LLM serving. Instead of the decode instance pulling KV blocks after prefill finishes, the decode instance registers its target memory in advance and the prefill instance writes the KV data directly once ready, moving coordination work off the critical path. Benchmarked on a 1-prefill/1-decode Qwen3-32B deployment using EC2 P5en instances with EFA, push mode delivered up to 3x better time-to-first-token (TTFT) and up to 30% better time-per-output-token (TPOT) than the default pull mode, especially under high request rates.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Google Open-Sources ML Drift, a New GPU Engine for On-Device AI Inference

Google released ML Drift, an open-source, cross-platform GPU compute engine for on-device ML inference, replacing the legacy TFLite GPU delegate. It unifies shader handling across OpenGL ES, OpenCL, Metal and WebGPU, adds 5D tensor support, and introduces stage-aware optimizations for LLM prefill/decode. It is already running in production in Chrome, YouTube Shorts, Google Photos, Meet and partner apps from Adobe and Snap.

Google Developers
Agents· Important· 🧪 Worth Testing

Google releases AQuA, an ambient agent that diagnoses silent production failures in AI agents

Google introduced AQuA (Ambient Quality Agent), a tool that runs continuously beside production AI agents inside a Google Cloud project to find failures that don't show up in logs or health checks, such as skipped validation steps or dropped context between sub-agents. It samples production session traces, grades them against a checklist, clusters recurring failure patterns, verifies clusters against full transcripts, and tracks them over time as new, recurring, or resolved. On request, it can also trace a failure back to the exact line of code or prompt responsible, using an immutable source snapshot captured at deploy time.

Google Developers
Agents· Important· 🧪 Worth Testing

Google Cloud Launches Remote MCP Server for gcloud and BigQuery CLI Access

Google Cloud introduced, in public preview, a remote MCP server that exposes the gcloud and bq command-line tools to AI agents via two tools: run_gcloud_command and run_bq_command. The server runs in an isolated, network-restricted sandbox on Google Cloud infrastructure, removing the need for agents to install or maintain local CLI binaries. It uses Agent Identity, OAuth 2.0, and IAM for authentication, integrates with Model Armor to screen for prompt injection, and supports Cloud Audit Logging for full visibility into tool calls.

Google Cloud AI