Skip to content
Thursday, 19 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

“API” — 290 articles ✕

Agents· Important· 🧪 Worth Testing

IBM's ALTK-Evolve boosts customer-service agents with learned prompt guidelines, no fine-tuning needed

IBM Research's ALTK-Evolve extracts short behavioral rules from an agent's own training-task attempts and appends them to the system prompt of a basic ReAct agent running on GPT-4.1. On the τ²-bench customer-service benchmark (retail and airline domains), this learned-memory approach raised accuracy and reliability without updating model weights or using human annotation. The full 'lossless' guideline set pushed a GPT-4.1 agent to a retail Pass^4 score of 67.5%, topping the October 12, 2026 leaderboard snapshot, including beating a model fine-tuned specifically on synthetic retail data. The technique also improved a frontier GPT-5.5 agent on airline tasks, taking it to the top of that leaderboard as well.

Hugging Face
Models· Important

Google launches native PyTorch inference engines for vLLM and SGLang on TPU

Google announced new vLLM and SGLang inference engines built directly on PyTorch for TPU, developed with Inferact and RadixArk respectively. The engines run on a new TorchTPU layer that makes TPUs a native PyTorch device, replacing the previous JAX-based backend approach. Google reports a public benchmark result of 2.01 cents per million tokens in high-concurrency configurations via the SemiAnalysis InferenceX project, plus support for agentic workloads, long context, disaggregated serving and multimodal models.

Google Developers
Research· Important

Google completes open Coral NPU edge-AI architecture and compiler, first commercial chips ship

Google Research announced the final milestone of its Coral NPU open hardware standard — a 32-bit RISC-V architecture with a new Matrix Execution Unit for up to 1 TOPS at roughly 10mW — plus a v1.0 open-source IREE/MLIR compiler that takes JAX, PyTorch and TensorFlow models directly to the hardware. Synaptics is launching the first commercial silicon built on this standard, including the Astra SR200 microcontroller series (400 GOPS) and new Coralboard SR and SL developer kits, with the SL now generally available via DigiKey. Google is also partnering with VeriSilicon and GlobalFoundries to bring the open RTL into production chips.

Google Developers
Agents· Important· 🧪 Worth Testing

llm-d 1.0 released: open-source Kubernetes-native inference stack matures for production

Red Hat, IBM, and Google announced llm-d 1.0, a Kubernetes-native distributed inference serving system that moves beyond proof-of-concept performance tricks into full production readiness. The release adds multi-tenant quality of service, zero-downtime operations, and agent-aware serving so the same endpoint can handle both human users and autonomous agents efficiently. In one test, llm-d's prefix-aware router captured 97% of available cache reuse on an agentic coding workload, and IBM/Red Hat ran 3,000 concurrent software-engineering agents for 5 to 10 times less cost than using the same model as a hosted service.

IBM Research
Agents· Important· 🧪 Worth Testing

Amazon Bedrock Enforces Schema-Accurate JSON for All Claude Models

AWS has rolled out structured outputs across every Anthropic Claude model hosted on Amazon Bedrock, reaching both the standard runtime endpoint and the newer Mantle endpoint built for agentic workloads. Instead of hoping the model returns valid JSON, developers can now lock responses to an exact schema through constrained decoding, which blocks the model from generating tokens that would break the format. A companion feature, strict tool use, applies the same guarantee to function-calling arguments so agent workflows don't fail on malformed inputs.

AWS Machine Learning

AWS Bedrock adds TwelveLabs' Pegasus 1.5 for structured video search

AWS has rolled out Pegasus 1.5, a video-language model built by TwelveLabs, as a fully managed option inside Amazon Bedrock. Unlike earlier versions that answered one question per clip, this release scans an entire video and outputs a JSON list of every moment matching criteria you define, complete with start and end times. It also handles longer recordings — up to two hours in one call — and lets you feed in a video straight from an S3 bucket or as a base64 string, skipping any indexing step.

AWS Machine Learning
Voice AI· Important· 🧪 Worth Testing

Deepgram cuts batch transcription costs by porting Nova-3 to AWS Trainium2

AWS and Deepgram jointly rebuilt the Nova-3 speech-to-text model to run natively on Trainium2 chips instead of standard GPU-based PyTorch setups, targeting large offline transcription jobs. The work involved rewriting bottleneck layers as custom kernels and replacing Deepgram's Python serving layer with a Rust runtime calling Trainium directly. The result: a single trn2.3xlarge instance running eight parallel model copies delivers 11-70% more transcribed audio per dollar than Deepgram's prior infrastructure, with similar savings potentially available to customers self-hosting on SageMaker.

AWS Machine Learning
Research· Important· 🧪 Worth Testing

AWS introduces push-based KV transfer to cut latency in disaggregated vLLM inference

AWS released a push-based NIXL connector for vLLM that changes how key-value (KV) cache data moves between prefill and decode instances in disaggregated LLM serving. Instead of the decode instance pulling KV blocks after prefill finishes, the decode instance registers its target memory in advance and the prefill instance writes the KV data directly once ready, moving coordination work off the critical path. Benchmarked on a 1-prefill/1-decode Qwen3-32B deployment using EC2 P5en instances with EFA, push mode delivered up to 3x better time-to-first-token (TTFT) and up to 30% better time-per-output-token (TPOT) than the default pull mode, especially under high request rates.

AWS Machine Learning
Cyber Security· Important· 🧪 Worth Testing

Microsoft treats AI agents as insider threats, launches new containment controls

Microsoft announced an expansion of its Project Perception security framework to address risks from autonomous AI agents, framing them as a new category of 'insider' that needs distinct identity, permission, and risk controls. The update introduces Dynamic Permissions (least-privilege, task-scoped, time-bound access), Dynamic Agent Risk (continuous risk scoring based on behavior drift and context), and Dynamic Conditional Access (graduated responses from narrowing access to full runtime isolation). Microsoft is also extending discovery and identity support (Microsoft Entra Agent ID) to 60 types of local agents, including Claude Code, OpenAI Codex, and GitHub Copilot, and introducing 'Guardian Agents' that monitor and respond to risky agent behavior at machine speed.

Microsoft Security
Models· Important· 🧪 Worth Testing

DeepSeek upgrades V4.1 Flash model and opens its search API

DeepSeek released DeepSeek-V4.1-Flash-1017, an upgraded version of its Flash model, accessible through the same API endpoint and pricing as before. The update brings notable gains across agentic, coding, and tool-use benchmarks while reducing task runtime and output length. DeepSeek also detailed its in-house search engine, which now powers both web/app search and a developer-facing Search & Fetch API.

DeepSeek API Updates

CISA Warns of Actively Exploited Critical Flaw in BeyondTrust Remote Support

CISA has flagged CVE-2026-102764, a critical authentication bypass affecting self-hosted BeyondTrust Remote Support versions 26.2.3 and earlier. Threat actors are actively using it to gain initial access, establish persistence, escalate privileges, and move laterally inside networks. The flaw was added to CISA's Known Exploited Vulnerabilities catalog on October 16, 2026, and a patch (BT26-05-RS) is available for supported versions 24.3.1 and later.

CISA Advisories

Microsoft and NVIDIA publish joint framework for managing open-weight model risk

Microsoft and NVIDIA released a joint whitepaper, 'Risk Management for Open-Weight Models in Enterprise,' the first in a planned series offering enterprises a shared risk taxonomy and methodology for evaluating open-weight AI models. The paper argues that whether a model is open or closed-weight is not the key risk factor — what matters is the use case, deployment architecture, and surrounding safeguards. It organizes risks into five categories (Cybersecurity, Data Protection, Content, Human-AI Interaction, Bias) and maps evaluations to those risks, aligning with ISO standards and the NIST AI Risk Management Framework.

Microsoft Security
Cyber Security· Important

NIST, NSA and CISA publish incident-response guidance for advanced AI agent training

NIST's Super Intelligence Security Center, together with the NSA and CISA, released a joint publication outlining ten voluntary core practices for organizations that train and evaluate highly capable 'super intelligence' (SI) agents, especially pre-deployment or high-risk non-public systems. The guidance defines an 'SI control incident' as an AI agent taking uninstructed actions that bypass or compromise human oversight and security controls. It builds on existing cyber incident response practices but adds AI-specific steps such as testing containment and validating it before resuming agent activity.

CISA Advisories
Voice AI· Important· 🧪 Worth Testing

OpenAI makes custom voice generation available to every GPT-Live API user

OpenAI has rolled out prompt-to-voice access to all GPT-Live API customers, allowing a spoken voice to be designed simply by describing it in text, either through the API or the voice Playground, and then reused inside live voice sessions. Designing the voice costs nothing, but speaking with it still runs on normal GPT-Live session billing. Alongside this rollout, nine additional built-in voices covering German, French, Hindi, Japanese and Korean were added to the platform.

OpenAI API Changelog
Agents· 🧪 Worth Testing

Google Cloud outlines a three-layer agent architecture for high-compute, governed biotech workflows

Google Cloud published a reference architecture for building AI agents that coordinate long-running, GPU-heavy scientific tasks like protein folding and compound screening, which break standard single-LLM-agent setups due to timeouts and context overflow. The design separates a cognitive orchestrator (Gemini on Agent Runtime) from a GPU execution layer (NVIDIA NIMs like ESMFold and GenMol on GKE) and wraps both in an enterprise governance plane with agent identity, a gateway, a registry and Model Armor. It also lays out best practices such as passing bulky data by reference instead of inline, streaming progress updates, and gating irreversible actions behind human approval.

Google Cloud AI
Models· Important

Reflection releases Beam, a 501B open-weight MoE model with 1M-token context

Reflection, a new US AI lab, has launched Beam, its first model, as an open-weight mixture-of-experts system with 501B total parameters (23B active per token) and a 1M-token context window, released under Apache 2.0. The model is built for coding and agentic use cases, ships with a custom Rust-based inference harness, and has day-0 support in transformers, vLLM and SGLang. Reflection reports strong results on coding, reasoning and tool-calling benchmarks across BF16, FP8 and NVFP4 checkpoints.

Hugging Face

NVIDIA and AI4Bharat Release 2.8 Trillion-Token Indic Pretraining Corpus and Open Data Pipeline

NVIDIA, working with IIT Madras's AI4Bharat lab, is releasing Nemotron-pretraining-Indic-v1, a roughly 2.8 trillion token synthetic pretraining corpus covering 22 Indian languages, along with the open GPU-accelerated pipeline used to generate it. The corpus includes native-script data for all 22 languages and romanized text for twelve, built by translating curated English source material (web text, math, code, Q&A) using NeMo Data Designer and quality-checked with an MQM-inspired rubric. NVIDIA already used a 10-billion-token Indic subset for continued pretraining of Nemotron 3.5 Super VL, which showed measurable gains on Indic benchmarks.

Hugging Face
Models· Important· 🧪 Worth Testing

IBM combines transcription, decision-making and chat in a single Granite Switch model

IBM has released Granite Switch 4.1 in 8B and 30B sizes, a modular system that runs chat, decision-making and speech transcription from one hosted endpoint instead of separate models. The update adds a general-purpose Decision adapter, a specialized Guardian adapter for safety-related classifications, and an embedded ASR model, Granite-Speech-5.0-Turbo-CTC, which tops the OpenASR Leaderboard. Despite bundling three capabilities, the combined model uses roughly the same VRAM as the base model alone.

Hugging Face
Cyber Security· Important· 🧪 Worth Testing

Google Adds DPoP Support to OAuth to Protect Refresh Tokens from Theft

Google has announced support for DPoP (Demonstrating Proof-of-Possession, RFC 9449) in its OAuth platform, cryptographically binding refresh tokens to a client-generated key pair so stolen tokens cannot be replayed by attackers. The protection applies only to long-lived refresh tokens, while short-lived access tokens remain standard Bearer tokens to avoid added cryptographic overhead on high-throughput API calls. Google also highlights DPoP's relevance for securing multi-agent and Model Context Protocol (MCP) architectures, recommending Google Cloud Secure Token Service for token delegation chains between agents.

Google Developers
Models· Important· 🧪 Worth Testing

Meta releases Muse Spark Open, an 816B-parameter open-weight multimodal MoE model

Meta published Muse Spark Open, an open-weight mixture-of-experts model with about 816 billion total parameters and 42 billion active per token. It accepts text, images, audio and video as input and generates text, with a context window of up to 1 million tokens. Meta positions it as a coding-optimized, agentic model built on top of the smaller Muse Glimmer architecture, calling it the most capable US open-weights model released so far.

Hugging Face

Apple Shows Trillion-Parameter-Class LLMs Running Locally on Mac Studio Clusters with MLX

Apple's MLX team published benchmarks showing large open-weight models — including a near-trillion-parameter MoE model called Muse Spark Open — running on Mac Studio hardware, both on a single machine and distributed across up to four Mac Studios using a new RDMA-over-Thunderbolt driver. The new M5 Ultra chip, with dedicated GPU Neural Accelerators and 1.2 TB/s memory bandwidth, delivers up to 4.6x faster time-to-first-token and 1.6x faster generation speed versus the previous M3 Ultra. For models too large to fit on one machine, MLX now supports pipeline and tensor parallelization across multiple Macs connected via Thunderbolt RDMA, letting a four-Mac-Studio cluster generate over 36 tokens per second on an 816B-parameter model.

Apple Machine Learning
Research· Important

Microsoft Research debuts Magnetar, a zero-knowledge proving system for ordinary code

Microsoft Research released Magnetar, a zero-knowledge virtual machine (zkVM) capable of generating cryptographic proofs that a program executed correctly, without needing anyone to rerun it or trust the operator. Instead of forcing developers to rewrite applications as custom cryptographic circuits, Magnetar proves standard RISC-V machine code, so programs written in Rust, Go, or C can be compiled normally and proven as-is. Benchmarks across 15 programs show it processing 7.2 to 8.7 million instructions per second on a laptop, with proofs checkable in roughly 12 milliseconds, and its cryptographic security depends only on established hash functions like SHA-256 or SHA-3 rather than elliptic curves or lattice-based schemes.

Microsoft Research
Cyber Security· Important

AWS's autonomous pentest agent exploits 33 of 37 fresh CVEs end-to-end

AWS tested its AWS Security Agent (now part of AWS Continuum) against a freshly built benchmark of 37 real, recently disclosed CVEs, each run as a live containerized target with a hidden flag. Starting from a low-privilege endpoint with only a one-line hint and no proof-of-concept, the agent, running on Claude Opus 5, captured 33 of 37 flags through genuine end-to-end exploitation after an integrity audit, with 2 captures reclassified as unintended-path solves and 2 genuine misses where the agent broke the target before extracting the flag. AWS built this benchmark to avoid the contamination problem of public CVE suites, which models may have memorized from training data.

AWS Security
Agents· Important· 🧪 Worth Testing

AWS proposes 'Trust in Depth' framework to let AI agents act autonomously without losing control

AWS published a governance framework called Trust in Depth, designed to let AI agents operate with more autonomy while staying within enforceable limits. It combines scoping agent permissions before deployment, giving each agent a verifiable identity, enforcing boundaries at runtime via policy gateways, and observing agent behavior afterward. The framework leans on automated reasoning (mathematical proof) for rules that can be precisely defined, and human judgment for ambiguous cases, using AWS tools like Bedrock AgentCore, Guardrails, Kiro, Strands, Agent Registry and CloudWatch Omni.

AWS Machine Learning