Skip to content
Thursday, 19 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

“NVIDIA” — 46 articles ✕

Models· Important· 🧪 Worth Testing

Scaling LLM Inference with NVIDIA Dynamo on SageMaker HyperPod

AWS now provides managed support for NVIDIA Dynamo within SageMaker HyperPod, simplifying the deployment of large-scale language models. This update introduces multi-node inference, allowing teams to run models that exceed single-GPU memory through disaggregated prefill and decode worker pools.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Optimizing Sparse Attention Kernels for Long-Context LLMs

NVIDIA has released a technical primer on co-designing sparse attention for long-context models. By focusing on GPU-friendly indexer kernels—which identify relevant tokens before full attention—developers can significantly improve inference efficiency for context lengths surpassing 100K tokens.

NVIDIA Developer
Models· Important· 🧪 Worth Testing

NVIDIA Launches Nemotron for Science for Autonomous Research Agents

NVIDIA unveiled 'Nemotron for Science', a toolkit combining the Nemotron 3.5 Super VL model with specialized chemistry datasets and post-training recipes. This platform allows researchers to deploy local agents that can autonomously plan experiments, execute code, and validate data findings.

NVIDIA
Models· Important· 🧪 Worth Testing

Optimizing coding agent costs on Amazon Bedrock with NVIDIA NeMo Switchyard

Amazon has released a reference architecture that integrates the NVIDIA NeMo Switchyard library with LiteLLM to dynamically route coding agent requests between different models on Bedrock. By using stage or random routing, you can shift traffic between high-capability and high-efficiency models to balance performance and cost.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Scaling Large MoE Models Across Multiple NVIDIA DGX Stations

NVIDIA has released a technical workflow for serving the 753B parameter GLM-5.3 MoE model across two GB300-equipped DGX Stations. By utilizing tensor parallelism (TP=2) over RDMA connections and vLLM, you can overcome single-GPU memory constraints (252 GB HBM3e) for massive frontier-scale models.

NVIDIA Developer
Models· Important· 🧪 Worth Testing

llama.cpp reaches v1.0.0 with formalized API stability

The llama.cpp project has officially reached its 1.0.0 milestone, three and a half years after its inception. The release introduces strict semantic versioning to ensure better predictability for developers relying on its C/C++ libraries, libllama and libggml.

Hugging Face
Automation· Important· 🧪 Worth Testing

NVIDIA AICR Now Includes AI Bill of Materials for Workload Tracking

NVIDIA has integrated the open-source k8s-aibom project into its AI Cluster Runtime (AICR). This allows platform teams to automatically generate and audit an AI Bill of Materials (AIBOM) for workloads running on Kubernetes, identifying models, inference runtimes, and dependencies.

NVIDIA Developer
Automation· Important· 🧪 Worth Testing

NVIDIA Launches Open Source Kubernetes Engine for GPU Infrastructure

NVIDIA has released NVIDIA Kubernetes Engine (NVKE) and NVIDIA Kubernetes Recipes (NVKR) as open-source projects in public preview. These tools aim to help providers build, deploy, and manage Kubernetes clusters specifically optimized for GPU-accelerated workloads.

NVIDIA Developer
Automation· Important· 🧪 Worth Testing

NVIDIA Snapshot Accelerates GPU Inference Startup Times to Seconds

NVIDIA has released an open-source tool, NVIDIA Snapshot, for Kubernetes-based GPU workloads. By checkpointing fully initialized models and their states, the system allows inference replicas to resume in seconds rather than minutes, effectively eliminating repetitive initialization steps.

NVIDIA Developer
Models· Important· 🧪 Worth Testing

NVIDIA releases Dynamo deployment recipes for Korean open models

NVIDIA has introduced deployment recipes for four prominent Korean open models, including A.X K2 and Solar Open 2, within the Dynamo framework. These recipes are specifically optimized for multi-node NVIDIA B200 GPU clusters, designed to handle large-scale inference efficiently.

NVIDIA
Agents· Important· 🧪 Worth Testing

NVIDIA Enhances Agentic Security and Expands Korean Model Capabilities

NVIDIA has introduced the Open Agent Safety Platform, featuring the OpenShell runtime to provide sandboxed execution and policy-based governance for enterprise AI agents. Concurrently, LG AI Research has opened API access to K-EXAONE-2.5, a model supported by the new Nemotron-Personas-Korea dataset consisting of 7 million synthetic personas.

NVIDIA
Automation· Important· 🧪 Worth Testing

Amazon SageMaker now supports Multi-Instance GPU for managed endpoints

Amazon SageMaker Inference has introduced support for NVIDIA Multi-Instance GPU (MIG), allowing you to partition a single physical GPU into multiple independent units. This hardware-level division provides dedicated compute and memory to each partition, ensuring predictable latency and strong isolation between models hosted on the same accelerator.

AWS Machine Learning
Business· Important· 🧪 Worth Testing

NVIDIA Launches Vera CPU for High-Capacity AI Agent Workloads

NVIDIA has introduced the Vera CPU, specifically engineered to optimize the performance of AI agents that cycle between GPU reasoning and CPU-bound tasks. The architecture aims to solve the power and throughput limitations currently faced by AI factories using standard x86 infrastructure.

NVIDIA
Models· Important· 🧪 Worth Testing

NVIDIA Releases Four Open-Weight Cosmos 3 World Models

NVIDIA introduced four 16B parameter checkpoints within its Cosmos 3 Nano family, designed for interactive world simulation. These models enable developers to generate synthetic multi-sensor driving data, simulate robotic movements, and convert simulator controls into photorealistic video.

Hugging Face
Models· Important· 🧪 Worth Testing

NVIDIA Unveils Co-Design Strategies to Maximize AI Memory Efficiency

NVIDIA has introduced five co-design pillars for its Vera Rubin NVL72 platform, aimed at maximizing throughput in agentic AI workloads. By combining new precision formats like NVFP4, wide expert parallelism, and the Dynamo distributed serving layer, the system treats memory as a unified, tiered resource across GPUs, host CPUs, and specialized storage.

NVIDIA Developer
Agents· Important· 🧪 Worth Testing

NVIDIA releases open-source agent framework for GPU cluster management

NVIDIA has introduced the AI Factory Operations Agent, a framework built on NemoClaw and OpenShell, designed to automate the management and troubleshooting of large-scale GPU clusters. By leveraging specialized sub-agents and Model Context Protocol (MCP), it enables SREs to perform root cause analysis across hardware, network, and software layers through a unified chat interface.

NVIDIA Developer
Models· Important· 🧪 Worth Testing

NVIDIA Releases CUDA 13.5 with General Availability for Vera Rubin Architecture

NVIDIA has launched CUDA 13.5, reaching general availability for its new Vera Rubin GPU architecture. This update introduces significant enhancements to multi-process service (MPS) resource scheduling, locality domain partitioning, and deeper integration with SIMT libraries via CUDA Tile.

NVIDIA Developer
Agents· Important· 🧪 Worth Testing

Automate Agent Optimization with NVIDIA NeMo

NVIDIA introduced a workflow for turning production agent failures into structured test cases using NeMo Compass and NeMo Eval Author. This process analyzes trace logs to identify recurring issues, generates targeted evaluations, and validates harness improvements.

NVIDIA Developer
Automation· Important· 🧪 Worth Testing

NVIDIA Releases Open-Source Diagnostic Tool for Distributed AI Workload Failures

NVIDIA has open-sourced 'NVIDIA Attribution,' a tool designed to correlate logs, metrics, and scheduler states into structured diagnoses for distributed AI training jobs. By identifying root causes and distinguishing them from downstream symptoms (like NCCL errors), it helps infrastructure teams manage large-scale GPU deployments more effectively.

NVIDIA Developer
Automation· Important· 🧪 Worth Testing

Simplifying Kubernetes Readiness for NVIDIA Vera Rubin NVL72

NVIDIA has released updated AI Cluster Runtime (AICR) recipes designed to streamline the deployment of Kubernetes on the new Vera Rubin NVL72 hardware. These recipes provide pre-validated configurations for drivers, kernels, and network components, ensuring production-ready clusters from day one.

NVIDIA Developer