Skip to content
Thursday, 19 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

“Inference” — 82 articles ✕

Business· Important· 🧪 Worth Testing

AWS adds usage-based billing for SageMaker bidirectional streaming

Amazon has enabled usage-based software metering for bidirectional streaming models on SageMaker AI. Previously, software charges for long-running streaming sessions were difficult to capture, as they could not be reconciled with simple HTTP response headers. Model providers can now report usage incrementally via a dedicated metadata WebSocket connection.

AWS Machine Learning
Models· 🧪 Worth Testing

MiniMax releases H3-Image-PE for automated prompt expansion

MiniMax has launched MiniMax-H3-Image-PE, a fine-tuned version of the Qwen3.8-27B model designed to transform brief text prompts into highly detailed descriptions for image generation. The release includes specific workflows for text-to-image expansion and early-stage support for image editing prompts.

MiniMax (Hugging Face)
Automation· Important· 🧪 Worth Testing

NVIDIA Snapshot Accelerates GPU Inference Startup Times to Seconds

NVIDIA has released an open-source tool, NVIDIA Snapshot, for Kubernetes-based GPU workloads. By checkpointing fully initialized models and their states, the system allows inference replicas to resume in seconds rather than minutes, effectively eliminating repetitive initialization steps.

NVIDIA Developer
Agents· Important· 🧪 Worth Testing

Standardizing enterprise agentic AI with a seven-layer architecture

Amazon introduced a seven-layer reference architecture to move AI agent applications from initial prototypes to production-ready systems. The framework emphasizes a modular, pluggable design using stable contracts between layers such as data, inference, orchestration, and security.

AWS Machine Learning
Automation· Important· 🧪 Worth Testing

Google Cloud introduces GKE dynamic slicing for faster TPU workload deployment

Google Cloud has launched dynamic slicing for TPUs on GKE, allowing developers to decouple logical hardware configurations from physical nodepools. This update eliminates the need to manually recreate nodepools when workload requirements change, enabling faster scaling and improved fault tolerance.

Google Cloud AI
Models· Important· 🧪 Worth Testing

NVIDIA releases Dynamo deployment recipes for Korean open models

NVIDIA has introduced deployment recipes for four prominent Korean open models, including A.X K2 and Solar Open 2, within the Dynamo framework. These recipes are specifically optimized for multi-node NVIDIA B200 GPU clusters, designed to handle large-scale inference efficiently.

NVIDIA
Cyber Security· Important· 🧪 Worth Testing

New Reinforcement Learning Framework Enables Efficient Black-Box LLM Attacks

Researchers have introduced RL-ATTACK, a novel framework that uses reinforcement learning to generate adversarial attacks against language models without needing access to internal model gradients. By learning from the target model's responses, this method achieves superior query efficiency and successfully bypasses safety filters by forcing unintended outputs.

arXiv cs.CL
Automation· Important· 🧪 Worth Testing

Amazon SageMaker now supports Multi-Instance GPU for managed endpoints

Amazon SageMaker Inference has introduced support for NVIDIA Multi-Instance GPU (MIG), allowing you to partition a single physical GPU into multiple independent units. This hardware-level division provides dedicated compute and memory to each partition, ensuring predictable latency and strong isolation between models hosted on the same accelerator.

AWS Machine Learning
Agents· Important· 🧪 Worth Testing

Scaling production AI agents with Amazon Bedrock AgentCore

Taxbit has deployed a secure, role-aware AI assistant using Amazon Bedrock AgentCore to automate product documentation support. The agent uses RAG to ground answers in verified content while strictly enforcing PII masking, regional data residency, and user-role permissions.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

NVIDIA Unveils Co-Design Strategies to Maximize AI Memory Efficiency

NVIDIA has introduced five co-design pillars for its Vera Rubin NVL72 platform, aimed at maximizing throughput in agentic AI workloads. By combining new precision formats like NVFP4, wide expert parallelism, and the Dynamo distributed serving layer, the system treats memory as a unified, tiered resource across GPUs, host CPUs, and specialized storage.

NVIDIA Developer
Voice AI· Important· 🧪 Worth Testing

Gradium launches Phonon, a lightweight on-device TTS model

Gradium has released Phonon, a suite of compact (65-75 MB) text-to-speech models designed to run entirely on edge devices. It supports five languages, operates offline, and performs competitively against models significantly larger in size.

Hugging Face
Models· Important· 🧪 Worth Testing

NVIDIA Releases CUDA 13.5 with General Availability for Vera Rubin Architecture

NVIDIA has launched CUDA 13.5, reaching general availability for its new Vera Rubin GPU architecture. This update introduces significant enhancements to multi-process service (MPS) resource scheduling, locality domain partitioning, and deeper integration with SIMT libraries via CUDA Tile.

NVIDIA Developer
Research· Important· 🧪 Worth Testing

FlagRot Technique Improves Low-Bit KV Cache Precision

A new method called FlagRot optimizes key-value (KV) cache quantization for long-context models. By selectively rotating key segments based on attention error rather than applying global rotation, it reduces accuracy loss in 2-bit or 4-bit caches.

arXiv cs.CL
Research· Important· 🧪 Worth Testing

Compacting reasoning history reduces AI agent costs

New research shows that reasoning history can be rewritten into compact state records before new tool results are introduced. This method effectively reduces future reasoning tokens and total agent spending by eliminating redundant thoughts without requiring model retraining.

arXiv cs.CL
Research· 🧪 Worth Testing

Optimizing Multi-Draft Speculative Decoding Efficiency

Researchers have developed a method to calculate the theoretical upper bound for Multi-Draft Speculative Decoding (MDSD) efficiency by solving the dual of the optimal transport problem. The study reveals that current verification algorithms often fall short of this theoretical limit, and that sampling without replacement significantly improves acceptance rates compared to sampling with replacement.

arXiv cs.CL
Models· Important· 🧪 Worth Testing

NVIDIA Launches Cosmos Platform for Physical AI and World Simulation

NVIDIA has introduced Cosmos, a platform offering world foundation models and development tools specifically designed for physical AI applications, such as robotics and autonomous vehicles. The framework includes modular training recipes and NIM microservices for GPU-accelerated inference, enabling the generation of synchronized video and LiDAR observations.

NVIDIA Developer
Models· Important· 🧪 Worth Testing

Cost-Efficient Agent Scaling via Knowledge Distillation on Amazon SageMaker

Amazon has published a workflow for using Sequence-Level Knowledge Distillation (SeqKD) to fine-tune smaller models on trajectories generated by frontier models. By using a 'teacher' model to generate successful tool-use trajectories and filtering them with a programmatic scorer, teams can train compact 'student' models that perform complex reasoning at a fraction of the cost.

AWS Machine Learning
Automation· Important· 🧪 Worth Testing

Unified Kubernetes Workload Management with NVIDIA Workload Map

NVIDIA has released Workload Map, a tool designed to provide a common way for Kubernetes schedulers and platforms to interpret diverse distributed AI workloads. By using declarative YAML definitions, it eliminates the need for developers to build custom parsing adapters for every new framework like JobSet, Ray, or KServe.

NVIDIA Developer
Research· Important· 🧪 Worth Testing

Scalable Online Reinforcement Learning for Mobile Interface Agents

Apple researchers have unveiled an online training infrastructure for mobile UI agents that utilizes a two-part architecture to split navigational logic from visual interpretation. By employing step-level feedback provided by an LLM-as-a-Judge and a novel value estimation technique known as GiGPPO, these agents demonstrate significantly better adaptability than static models trained on pre-recorded sequences.

Apple Machine Learning
Research· Important· 🧪 Worth Testing

Pruning Redundant Attention Heads Reduces LLM Memorisation

Recent research shows that many attention heads in large language models are redundant and specifically contribute to verbatim memorisation of training data. By selectively pruning these heads at inference time, researchers achieved a 91.5% reduction in memorisation events while simultaneously improving performance on standard benchmarks.

arXiv cs.CL
Automation· Important· 🧪 Worth Testing

Streamlining Kubernetes Inference Deployments with NVIDIA Dynamo 1.4.2

NVIDIA has released AI Cluster Runtime (AICR) to package Dynamo inference infrastructure into validated recipes. This update simplifies deployment by pinning versions and removing mandatory external dependencies like NATS, while introducing new KV-aware routing paths for Kubernetes.

NVIDIA Developer