Skip to content
Thursday, 19 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

Models· Important

Google launches native PyTorch inference engines for vLLM and SGLang on TPU

Google announced new vLLM and SGLang inference engines built directly on PyTorch for TPU, developed with Inferact and RadixArk respectively. The engines run on a new TorchTPU layer that makes TPUs a native PyTorch device, replacing the previous JAX-based backend approach. Google reports a public benchmark result of 2.01 cents per million tokens in high-concurrency configurations via the SemiAnalysis InferenceX project, plus support for agentic workloads, long context, disaggregated serving and multimodal models.

Google Developers
Research· Important

Google completes open Coral NPU edge-AI architecture and compiler, first commercial chips ship

Google Research announced the final milestone of its Coral NPU open hardware standard — a 32-bit RISC-V architecture with a new Matrix Execution Unit for up to 1 TOPS at roughly 10mW — plus a v1.0 open-source IREE/MLIR compiler that takes JAX, PyTorch and TensorFlow models directly to the hardware. Synaptics is launching the first commercial silicon built on this standard, including the Astra SR200 microcontroller series (400 GOPS) and new Coralboard SR and SL developer kits, with the SL now generally available via DigiKey. Google is also partnering with VeriSilicon and GlobalFoundries to bring the open RTL into production chips.

Google Developers
Agents· Important· 🧪 Worth Testing

llm-d 1.0 released: open-source Kubernetes-native inference stack matures for production

Red Hat, IBM, and Google announced llm-d 1.0, a Kubernetes-native distributed inference serving system that moves beyond proof-of-concept performance tricks into full production readiness. The release adds multi-tenant quality of service, zero-downtime operations, and agent-aware serving so the same endpoint can handle both human users and autonomous agents efficiently. In one test, llm-d's prefix-aware router captured 97% of available cache reuse on an agentic coding workload, and IBM/Red Hat ran 3,000 concurrent software-engineering agents for 5 to 10 times less cost than using the same model as a hosted service.

IBM Research
Research· Important

New research: agents don't 'decide' to obey a prompt injection all at once — the choice unfolds as they reason

A new study questions the common belief that whether an AI agent falls for a prompt injection is settled the moment it reads the malicious text. The researchers built a branching-rollout technique on AgentDojo benchmarks: they replayed an agent's run up to the point it encounters an injected instruction, then let the rest of the episode play out many different ways to measure how much of the final outcome was already locked in versus still open. For a Qwen3 agent running without extended reasoning, 91% of the outcome was already determined at that moment; switching on reasoning ('thinking') cut that figure to 62%, showing the agent's compliance decision often keeps forming well after it first sees the attack. Enabling reasoning also cut Qwen3's susceptibility to successful attacks, but made two other tested models more vulnerable, and benchmark scores for reasoning agents flipped on a rerun as often as 35% of the time.

arXiv cs.CL
Agents· Important· 🧪 Worth Testing

Amazon Bedrock Enforces Schema-Accurate JSON for All Claude Models

AWS has rolled out structured outputs across every Anthropic Claude model hosted on Amazon Bedrock, reaching both the standard runtime endpoint and the newer Mantle endpoint built for agentic workloads. Instead of hoping the model returns valid JSON, developers can now lock responses to an exact schema through constrained decoding, which blocks the model from generating tokens that would break the format. A companion feature, strict tool use, applies the same guarantee to function-calling arguments so agent workflows don't fail on malformed inputs.

AWS Machine Learning
Voice AI· Important· 🧪 Worth Testing

Deepgram cuts batch transcription costs by porting Nova-3 to AWS Trainium2

AWS and Deepgram jointly rebuilt the Nova-3 speech-to-text model to run natively on Trainium2 chips instead of standard GPU-based PyTorch setups, targeting large offline transcription jobs. The work involved rewriting bottleneck layers as custom kernels and replacing Deepgram's Python serving layer with a Rust runtime calling Trainium directly. The result: a single trn2.3xlarge instance running eight parallel model copies delivers 11-70% more transcribed audio per dollar than Deepgram's prior infrastructure, with similar savings potentially available to customers self-hosting on SageMaker.

AWS Machine Learning
Research· Important· 🧪 Worth Testing

AWS introduces push-based KV transfer to cut latency in disaggregated vLLM inference

AWS released a push-based NIXL connector for vLLM that changes how key-value (KV) cache data moves between prefill and decode instances in disaggregated LLM serving. Instead of the decode instance pulling KV blocks after prefill finishes, the decode instance registers its target memory in advance and the prefill instance writes the KV data directly once ready, moving coordination work off the critical path. Benchmarked on a 1-prefill/1-decode Qwen3-32B deployment using EC2 P5en instances with EFA, push mode delivered up to 3x better time-to-first-token (TTFT) and up to 30% better time-per-output-token (TPOT) than the default pull mode, especially under high request rates.

AWS Machine Learning
Cyber Security· Important· 🧪 Worth Testing

Microsoft treats AI agents as insider threats, launches new containment controls

Microsoft announced an expansion of its Project Perception security framework to address risks from autonomous AI agents, framing them as a new category of 'insider' that needs distinct identity, permission, and risk controls. The update introduces Dynamic Permissions (least-privilege, task-scoped, time-bound access), Dynamic Agent Risk (continuous risk scoring based on behavior drift and context), and Dynamic Conditional Access (graduated responses from narrowing access to full runtime isolation). Microsoft is also extending discovery and identity support (Microsoft Entra Agent ID) to 60 types of local agents, including Claude Code, OpenAI Codex, and GitHub Copilot, and introducing 'Guardian Agents' that monitor and respond to risky agent behavior at machine speed.

Microsoft Security
Models· Important· 🧪 Worth Testing

DeepSeek upgrades V4.1 Flash model and opens its search API

DeepSeek released DeepSeek-V4.1-Flash-1017, an upgraded version of its Flash model, accessible through the same API endpoint and pricing as before. The update brings notable gains across agentic, coding, and tool-use benchmarks while reducing task runtime and output length. DeepSeek also detailed its in-house search engine, which now powers both web/app search and a developer-facing Search & Fetch API.

DeepSeek API Updates

CISA Warns of Actively Exploited Critical Flaw in BeyondTrust Remote Support

CISA has flagged CVE-2026-102764, a critical authentication bypass affecting self-hosted BeyondTrust Remote Support versions 26.2.3 and earlier. Threat actors are actively using it to gain initial access, establish persistence, escalate privileges, and move laterally inside networks. The flaw was added to CISA's Known Exploited Vulnerabilities catalog on October 16, 2026, and a patch (BT26-05-RS) is available for supported versions 24.3.1 and later.

CISA Advisories
Research· Important

Google Research builds AI agents that design and run wet-lab experiments

Google Research describes new work on grounding AI agents in physical lab reality, using a digital-twin framework called VERID to let agents safely plan and execute liquid-handling robot protocols. Combined with closed-loop molecular design cycles for aptamers and proteins, the agents iteratively learned from wet-lab results, improving hit rates over multiple rounds and discovering single-digit nanomolar protein binders for a cancer-related target.

Google Research
Cyber Security· Important

Active Attacks Confirmed Against Fortinet and BeyondTrust Products, CISA Warns

Real-world exploitation has pushed CISA to list two fresh vulnerabilities in its Known Exploited Vulnerabilities (KEV) Catalog: a path traversal bug spanning multiple Fortinet products (CVE-2025-61624) and an authentication-bypass-by-spoofing flaw in BeyondTrust Remote Support (CVE-2026-102764). Because both are already being abused by attackers, Binding Operational Directive 26-04 forces federal civilian agencies to fast-track fixes on any internet-facing systems where exploitation could hand over full control. The directive also requires agencies to check whether a system was already breached before the patch lands. CISA is urging every organization, not only government ones, to follow the same prioritized patching logic.

CISA Advisories
Cyber Security· Important

NIST, NSA and CISA publish incident-response guidance for advanced AI agent training

NIST's Super Intelligence Security Center, together with the NSA and CISA, released a joint publication outlining ten voluntary core practices for organizations that train and evaluate highly capable 'super intelligence' (SI) agents, especially pre-deployment or high-risk non-public systems. The guidance defines an 'SI control incident' as an AI agent taking uninstructed actions that bypass or compromise human oversight and security controls. It builds on existing cyber incident response practices but adds AI-specific steps such as testing containment and validating it before resuming agent activity.

CISA Advisories
Voice AI· Important· 🧪 Worth Testing

OpenAI makes custom voice generation available to every GPT-Live API user

OpenAI has rolled out prompt-to-voice access to all GPT-Live API customers, allowing a spoken voice to be designed simply by describing it in text, either through the API or the voice Playground, and then reused inside live voice sessions. Designing the voice costs nothing, but speaking with it still runs on normal GPT-Live session billing. Alongside this rollout, nine additional built-in voices covering German, French, Hindi, Japanese and Korean were added to the platform.

OpenAI API Changelog
Models· Important

Reflection releases Beam, a 501B open-weight MoE model with 1M-token context

Reflection, a new US AI lab, has launched Beam, its first model, as an open-weight mixture-of-experts system with 501B total parameters (23B active per token) and a 1M-token context window, released under Apache 2.0. The model is built for coding and agentic use cases, ships with a custom Rust-based inference harness, and has day-0 support in transformers, vLLM and SGLang. Reflection reports strong results on coding, reasoning and tool-calling benchmarks across BF16, FP8 and NVFP4 checkpoints.

Hugging Face
Models· Important· 🧪 Worth Testing

IBM combines transcription, decision-making and chat in a single Granite Switch model

IBM has released Granite Switch 4.1 in 8B and 30B sizes, a modular system that runs chat, decision-making and speech transcription from one hosted endpoint instead of separate models. The update adds a general-purpose Decision adapter, a specialized Guardian adapter for safety-related classifications, and an embedded ASR model, Granite-Speech-5.0-Turbo-CTC, which tops the OpenASR Leaderboard. Despite bundling three capabilities, the combined model uses roughly the same VRAM as the base model alone.

Hugging Face
Cyber Security· Important· 🧪 Worth Testing

Google Adds DPoP Support to OAuth to Protect Refresh Tokens from Theft

Google has announced support for DPoP (Demonstrating Proof-of-Possession, RFC 9449) in its OAuth platform, cryptographically binding refresh tokens to a client-generated key pair so stolen tokens cannot be replayed by attackers. The protection applies only to long-lived refresh tokens, while short-lived access tokens remain standard Bearer tokens to avoid added cryptographic overhead on high-throughput API calls. Google also highlights DPoP's relevance for securing multi-agent and Model Context Protocol (MCP) architectures, recommending Google Cloud Secure Token Service for token delegation chains between agents.

Google Developers
Models· Important· 🧪 Worth Testing

Meta releases Muse Spark Open, an 816B-parameter open-weight multimodal MoE model

Meta published Muse Spark Open, an open-weight mixture-of-experts model with about 816 billion total parameters and 42 billion active per token. It accepts text, images, audio and video as input and generates text, with a context window of up to 1 million tokens. Meta positions it as a coding-optimized, agentic model built on top of the smaller Muse Glimmer architecture, calling it the most capable US open-weights model released so far.

Hugging Face
Research· Important

Microsoft Research debuts Magnetar, a zero-knowledge proving system for ordinary code

Microsoft Research released Magnetar, a zero-knowledge virtual machine (zkVM) capable of generating cryptographic proofs that a program executed correctly, without needing anyone to rerun it or trust the operator. Instead of forcing developers to rewrite applications as custom cryptographic circuits, Magnetar proves standard RISC-V machine code, so programs written in Rust, Go, or C can be compiled normally and proven as-is. Benchmarks across 15 programs show it processing 7.2 to 8.7 million instructions per second on a laptop, with proofs checkable in roughly 12 milliseconds, and its cryptographic security depends only on established hash functions like SHA-256 or SHA-3 rather than elliptic curves or lattice-based schemes.

Microsoft Research
Cyber Security· Important

AWS's autonomous pentest agent exploits 33 of 37 fresh CVEs end-to-end

AWS tested its AWS Security Agent (now part of AWS Continuum) against a freshly built benchmark of 37 real, recently disclosed CVEs, each run as a live containerized target with a hidden flag. Starting from a low-privilege endpoint with only a one-line hint and no proof-of-concept, the agent, running on Claude Opus 5, captured 33 of 37 flags through genuine end-to-end exploitation after an integrity audit, with 2 captures reclassified as unintended-path solves and 2 genuine misses where the agent broke the target before extracting the flag. AWS built this benchmark to avoid the contamination problem of public CVE suites, which models may have memorized from training data.

AWS Security
Agents· Important· 🧪 Worth Testing

AWS proposes 'Trust in Depth' framework to let AI agents act autonomously without losing control

AWS published a governance framework called Trust in Depth, designed to let AI agents operate with more autonomy while staying within enforceable limits. It combines scoping agent permissions before deployment, giving each agent a verifiable identity, enforcing boundaries at runtime via policy gateways, and observing agent behavior afterward. The framework leans on automated reasoning (mathematical proof) for rules that can be precisely defined, and human judgment for ambiguous cases, using AWS tools like Bedrock AgentCore, Guardrails, Kiro, Strands, Agent Registry and CloudWatch Omni.

AWS Machine Learning
Models· Important

Mistral releases Timestral, a time-series forecasting model family

Mistral AI has launched Timestral, its first family of time-series foundation models, available in four sizes from 5M to 209M parameters. The largest model ranks first on all three major public forecasting benchmarks (GIFT-Eval, TIME, fev-bench), beating previous state-of-the-art models that have more parameters. The models produce probabilistic, multivariate forecasts, support past and known-future covariates, and run efficiently on CPUs without needing a GPU.

Mistral AI
Models· Important· 🧪 Worth Testing

Apertus 1.5 adds image/audio understanding, longer context and a thinking mode to the open 8B/70B models

Swiss AI released Apertus 1.5, a continued pretraining of its open Apertus 1.0 models (8B and 70B, Apache 2.0) with native image and experimental audio understanding, a 4x larger context window of 262,144 tokens, an optional thinking mode, and improved instruction-following and tool use. The models were trained on a total of 19T (8B) and 17T (70B) tokens, with full training data, recipes and intermediate checkpoints published for reproducibility. The team also published detailed, standardized evaluation cards and announced early API access from providers like Swisscom and Infomaniak, plus a roadmap for a ~600B-parameter MoE Apertus 2.0.

Hugging Face
Voice AI· Important· 🧪 Worth Testing

Deepgram's Flux STT cuts unwanted interruptions in Anam's avatar conversations by ~50%

Anam, which builds photorealistic interactive avatars, switched to Deepgram's Flux speech-to-text model to solve turn-taking problems in unscripted, real-time conversation. In A/B testing against a self-hosted open-source STT option, Flux cut unwanted avatar barge-ins by roughly 50% with no added latency penalty, and complaints about turn-taking on English sessions dropped to near zero. Anam deployed Flux self-hosted on its own Kubernetes/H100 infrastructure, rolling it out to 100% of turnkey users after a two-week self-hosted deployment (versus days for Deepgram's hosted option).

Deepgram