NVIDIA introduced NemoClaw, an open blueprint framework designed to combine agent harnesses with optimized Nemotron models and secure runtimes. It enables developers to deploy agents that are governed by strict security policies while maintaining high performance on owned infrastructure.
NVIDIA has introduced Nemotron 3.5 Super VL, a 120B-parameter multimodal model featuring a 1M token context window. The model utilizes a hybrid Mamba-2 and MoE architecture to balance reasoning capabilities with efficient inference, and is now available for deployment on Amazon EKS and SageMaker HyperPod.
AWS introduced pre-built Ray Train Deep Learning Containers (DLCs) that consolidate PyTorch, CUDA, NCCL, and EFA networking libraries into a single tested image. This approach allows your team to deploy distributed training clusters on Amazon EKS without maintaining custom build pipelines or resolving complex driver compatibility issues.
NVIDIA has introduced Nemotron 3.5 Transcribe, an open-weight, promptable model for speech-to-text, speaker diarization, and translation. It utilizes a hybrid Mamba-Transformer architecture to achieve industry-leading performance with only 4 billion active parameters.
NVIDIA released CUDA 13.4, adding hardware-transparent memory boundary enforcement for GPU sharing. Paired with the new open-source GPU Fractioning Operator and KAI Scheduler v0.18.0, teams can now define specific memory requests, burst limits, and compute modes directly in Kubernetes Pod annotations.
NVIDIA has released 'Nemotron-Personas' datasets for France and Belgium, designed to improve LLM accuracy regarding regional procedures, demographics, and cultural nuances. The update provides a complete post-training workflow—including data generation, LoRA fine-tuning via NVIDIA NeMo, and evaluation—to help developers transition from generic models to domain-specific agents.
NVIDIA has documented a threefold optimization approach to accelerate MoE inference, tested on the 124-billion-parameter Ling-3.0-flash model. By utilizing specialized Humming kernels, FP8 precision for the LM head, and Multi-Token Prediction, developers can achieve a 42.5% throughput increase and a 24.5% reduction in latency.
NVIDIA has expanded its Mission Control platform to include autonomous recovery for Kubernetes environments managed by Run:ai. The system now separates job-level recovery from hardware-level maintenance, allowing training tasks to restart on healthy nodes while simultaneously diagnosing faulty infrastructure.
Cohere has released a public beta of Confidential Computing on Model Vault, running on NVIDIA H100 GPUs via Microsoft Azure. The system encrypts data in use across both CPU and GPU, encrypts the request payload itself using Oblivious HTTP (OHTTP), and uses remote attestation so clients can verify the environment before sending sensitive data. If verification fails, the client refuses to send the protected request. Cohere plans to open-source the confidential inference stack and extend support to NVIDIA Blackwell (B200) GPUs toward general availability.
NVIDIA has introduced Minerva, an operations platform that pulls together telemetry across GPUs, networking gear, storage and running jobs so operators can spot trouble in massive GPU clusters before it causes downtime. Machine learning models build a live map of the hardware and workloads, flag unusual behavior, and bundle related alerts into one incident with a likely cause rather than flooding teams with separate warnings. A built-in assistant lets staff query cluster health in plain language, and the system can link to automation tools to act on fixes. IREN, Aolani, Bitdeer AI, IBM, Jio, Lambda, Quake AI and Tesla are lined up to use it, while Dell, Lenovo and Supermicro will sell it as part of their infrastructure offerings.
Google Cloud and NVIDIA announced general availability of A5X instances built on NVIDIA Vera Rubin NVL72 GPUs, ConnectX-9 SuperNICs and Google's Virgo network, targeting large-scale agentic inference and reinforcement learning. Google Cloud plans to scale Vera Rubin infrastructure to up to 960,000 Rubin GPUs across multiple sites, with general availability next month and planned expansion to Europe. London-based Ineffable Intelligence, founded by AlphaGo creator David Silver, is the first customer, using the platform for continuous reinforcement-learning 'superlearner' systems. WPP also demonstrated a creative agent architecture on A5X using NVIDIA Nemotron models and OpenShell, running workloads on a single instance that previously needed a multi-node cluster.
NVIDIA has added three new open, commercially licensed components to its Nemotron Retriever lineup: Embed models (8B and 1B, in BF16 and NVFP4) for searching text and images, a Rerank model (8B) that reorders retrieved evidence by relevance, and a compact 631M Parse model that converts document images into structured text. The goal is to feed AI agents with better, more relevant evidence so they need fewer search rounds and fewer inference tokens to answer a question. NVIDIA reports the new Embed and Rerank models top the ViDoRe v3.1 leaderboards for dense retrieval and reranking respectively.
NVIDIA has published OpenShell, an open-source runtime that treats agent workloads as untrusted and grants access to files, tools and systems only when needed. It pairs with the new NVIDIA Vera CPU and, optionally, BlueField-4 DPUs with NVIDIA Sentry for hardware-enforced monitoring. NVIDIA says this combination forms a full reference architecture for running autonomous agents safely at data-center scale.
NVIDIA has detailed Sentry, a new security framework that sits outside an AI agent's reach, enforcing policy and watching behavior from a dedicated hardware trust domain on BlueField-4 DPUs. The idea is simple: even if an agent is compromised or goes off-script while using tools and credentials, Sentry keeps watching and can cut it off because it doesn't depend on the host OS the agent runs on. Two components do the work — DOCA Tower, a proxy that inspects and authorizes every agent network request, and DOCA Argus, which reads live memory to understand what's actually running. When something looks wrong, the system can quarantine the agent within milliseconds, without needing the agent or the host to cooperate.
Meta published Muse Spark Open, an open-weight mixture-of-experts model with about 816 billion total parameters and 42 billion active per token. It accepts text, images, audio and video as input and generates text, with a context window of up to 1 million tokens. Meta positions it as a coding-optimized, agentic model built on top of the smaller Muse Glimmer architecture, calling it the most capable US open-weights model released so far.
Liquid AI has published LFM2.5-24B-A2B, a mixture-of-experts model with 24B total parameters but only 2B active per token, designed to run reasoning agents on local hardware. The release expands the context window to 131K tokens, doubles the vocabulary size, and was trained on roughly double the pretraining data of its predecessor. On agentic and tool-use benchmarks the model performs on par with or better than models that have about 50% more parameters, while delivering fast inference speeds on both consumer and data-center hardware.
NVIDIA has released the full Run:ai platform as open source, adding it as a foundation of the NVIDIA DSX AI Factory Platform for AI workload and GPU orchestration on Kubernetes. The release includes four modular components — KAI Scheduler, GPU Fractioning Operator, KAI Resource Management, and Workload Map — that can be adopted together or independently. Eight ecosystem partners, including Crusoe, Mirantis, Nebius, OpenNebula Systems, Rafay, Saturn Cloud, Spectro Cloud, and vCluster, are integrating the platform into their own offerings.
NVIDIA released a detailed workflow for fine-tuning its Nemotron 3.5 ASR multilingual streaming model on Saudi Arabic dialects (Najdi and Hijazi). Using minimal data curation, replay mixing with FLEURS data, duration-based bucketing, and partial encoder unfreezing, they reduced word error rate on the target dialects from 55.05% to 29.96% while also slightly improving English and other Arabic performance. The post also covers decoding tweaks and speaker diarization extensions for multi-speaker transcription.