Skip to content
Thursday, 19 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

#Developer Tools — 6 articles ✕

Agents· Important· 🧪 Worth Testing

Automate Agent Optimization with NVIDIA NeMo

NVIDIA introduced a workflow for turning production agent failures into structured test cases using NeMo Compass and NeMo Eval Author. This process analyzes trace logs to identify recurring issues, generates targeted evaluations, and validates harness improvements.

NVIDIA Developer
Agents· Important· 🧪 Worth Testing

Real-time web application previews for Amazon Bedrock coding agents

Amazon Bedrock AgentCore now supports Session endpoints, allowing developers to view and interact with web applications live as an AI coding agent builds them. By routing traffic through an authenticated, isolated microVM session, changes appear in the browser instantly without requiring separate deployments.

AWS Machine Learning
Agents· Important· 🧪 Worth Testing

Google API Gateway adds streaming support for real-time and AI traffic

Google announced Public Preview of streaming support in API Gateway, covering Server-Sent Events, chunked/NDJSON responses, WebSockets and gRPC streaming. Streaming endpoints can now sit behind the same gateway as regular APIs, keeping existing authentication, logging and monitoring, without any changes to the API spec. Streams can stay open up to one hour, and gateways now get a predictable default hostname instead of a generated hash. The feature also ties into model routing, letting a single gateway stream responses from Gemini, Claude and OpenAI gpt-oss models.

Google Developers
Agents· Important· 🧪 Worth Testing

Google's Agents CLI gets an Extension System to support LangChain and other frameworks beyond ADK

Google has added an Extension System to its Agents CLI (from v1.5.0, with a first-party LangChain extension in v1.8.0) that lets developers override or add CLI commands without forking the tool. Previously, Agents CLI's deployment, evaluation and observability pipeline was tightly coupled to Google's own Agent Development Kit (ADK); now teams can scaffold, run, deploy and evaluate LangChain, LangGraph or Deep Agents projects through the same command surface. Extensions are distributed as directories in Git repositories, pinned to a commit SHA in a lockfile, and can be installed at project or user scope. The system also lets enterprise platform teams wrap commands like deploy with custom policies, such as compliance scans or SSO gates. The feature is marked experimental in v1.8.0.

Google Developers
Research· Important

Google and Meta bring native TPU support to PyTorch's TorchTitan training framework

Google introduced TorchTPU, a native PyTorch backend for Cloud TPUs (torch.device("tpu")), and co-developed a fork of Meta's TorchTitan trainer adapted for TPU training. Previously, running PyTorch training on TPUs meant rewriting code in JAX or relying on the older torch_xla path; now only minimal device-initialization changes are needed. The fork provides tested recipes for pre-training large dense models (Llama 3 70B/405B, Qwen 3 8B/32B), Mixture-of-Experts models (Qwen 3 235B), and diffusion transformers (FLUX.1 12B), plus a 'Graph Trainer' that captures an entire training step as one XLA program for better compiler optimization.

Google Developers
Research· Important· 🧪 Worth Testing

AWS introduces push-based KV transfer to cut latency in disaggregated vLLM inference

AWS released a push-based NIXL connector for vLLM that changes how key-value (KV) cache data moves between prefill and decode instances in disaggregated LLM serving. Instead of the decode instance pulling KV blocks after prefill finishes, the decode instance registers its target memory in advance and the prefill instance writes the KV data directly once ready, moving coordination work off the critical path. Benchmarked on a 1-prefill/1-decode Qwen3-32B deployment using EC2 P5en instances with EFA, push mode delivered up to 3x better time-to-first-token (TTFT) and up to 30% better time-per-output-token (TPOT) than the default pull mode, especially under high request rates.

AWS Machine Learning