NVIDIA has introduced Cosmos, a platform offering world foundation models and development tools specifically designed for physical AI applications, such as robotics and autonomous vehicles. The framework includes modular training recipes and NIM microservices for GPU-accelerated inference, enabling the generation of synchronized video and LiDAR observations.
NVIDIA has released Workload Map, a tool designed to provide a common way for Kubernetes schedulers and platforms to interpret diverse distributed AI workloads. By using declarative YAML definitions, it eliminates the need for developers to build custom parsing adapters for every new framework like JobSet, Ray, or KServe.
NVIDIA has released AI Cluster Runtime (AICR) to package Dynamo inference infrastructure into validated recipes. This update simplifies deployment by pinning versions and removing mandatory external dependencies like NATS, while introducing new KV-aware routing paths for Kubernetes.
NVIDIA has released a new command-line interface for the TensorRT Edge-LLM runtime, allowing developers to quickly prototype and test AI models on the DGX Spark 64GB workstation. The tool chain facilitates local model serving and supports DSpark speculative decoding to boost generation performance on edge-constrained hardware.
NVIDIA introduced NemoClaw, an open blueprint framework designed to combine agent harnesses with optimized Nemotron models and secure runtimes. It enables developers to deploy agents that are governed by strict security policies while maintaining high performance on owned infrastructure.
NVIDIA has introduced Nemotron 3.5 Super VL, a 120B-parameter multimodal model featuring a 1M token context window. The model utilizes a hybrid Mamba-2 and MoE architecture to balance reasoning capabilities with efficient inference, and is now available for deployment on Amazon EKS and SageMaker HyperPod.
AWS introduced pre-built Ray Train Deep Learning Containers (DLCs) that consolidate PyTorch, CUDA, NCCL, and EFA networking libraries into a single tested image. This approach allows your team to deploy distributed training clusters on Amazon EKS without maintaining custom build pipelines or resolving complex driver compatibility issues.
NVIDIA has introduced Nemotron 3.5 Transcribe, an open-weight, promptable model for speech-to-text, speaker diarization, and translation. It utilizes a hybrid Mamba-Transformer architecture to achieve industry-leading performance with only 4 billion active parameters.
NVIDIA released CUDA 13.4, adding hardware-transparent memory boundary enforcement for GPU sharing. Paired with the new open-source GPU Fractioning Operator and KAI Scheduler v0.18.0, teams can now define specific memory requests, burst limits, and compute modes directly in Kubernetes Pod annotations.
NVIDIA has released 'Nemotron-Personas' datasets for France and Belgium, designed to improve LLM accuracy regarding regional procedures, demographics, and cultural nuances. The update provides a complete post-training workflow—including data generation, LoRA fine-tuning via NVIDIA NeMo, and evaluation—to help developers transition from generic models to domain-specific agents.
NVIDIA has documented a threefold optimization approach to accelerate MoE inference, tested on the 124-billion-parameter Ling-3.0-flash model. By utilizing specialized Humming kernels, FP8 precision for the LM head, and Multi-Token Prediction, developers can achieve a 42.5% throughput increase and a 24.5% reduction in latency.
NVIDIA has expanded its Mission Control platform to include autonomous recovery for Kubernetes environments managed by Run:ai. The system now separates job-level recovery from hardware-level maintenance, allowing training tasks to restart on healthy nodes while simultaneously diagnosing faulty infrastructure.
Cohere has released a public beta of Confidential Computing on Model Vault, running on NVIDIA H100 GPUs via Microsoft Azure. The system encrypts data in use across both CPU and GPU, encrypts the request payload itself using Oblivious HTTP (OHTTP), and uses remote attestation so clients can verify the environment before sending sensitive data. If verification fails, the client refuses to send the protected request. Cohere plans to open-source the confidential inference stack and extend support to NVIDIA Blackwell (B200) GPUs toward general availability.
NVIDIA has introduced Minerva, an operations platform that pulls together telemetry across GPUs, networking gear, storage and running jobs so operators can spot trouble in massive GPU clusters before it causes downtime. Machine learning models build a live map of the hardware and workloads, flag unusual behavior, and bundle related alerts into one incident with a likely cause rather than flooding teams with separate warnings. A built-in assistant lets staff query cluster health in plain language, and the system can link to automation tools to act on fixes. IREN, Aolani, Bitdeer AI, IBM, Jio, Lambda, Quake AI and Tesla are lined up to use it, while Dell, Lenovo and Supermicro will sell it as part of their infrastructure offerings.
NVIDIA has broadened its Cosmos platform, aimed at building 'world models' for physical AI and robotics, with new data curation blueprints, model fine-tuning support and faster deployment pipelines. The update includes five Cosmos Data Factory blueprints for synthetic and augmented training data, expanded Cosmos Framework support for adapting open models such as GR00T, Alpamayo, QWEN and Pi0.5, and upgraded Cosmos 3 NIM microservices for inference. Companies including Porsche, ANYbotics, Ultralytics and ADNOC are already applying these tools to autonomous vehicle data generation, robot anomaly detection, defect inspection and safety monitoring.
NVIDIA's BioNeMo team, working with the University of Washington's Institute for Protein Design, has introduced RFD4-Proteina, a model that generates both a protein's sequence and its full atomic structure in a single pass instead of handing off to a separate inverse-folding tool. By working with a residue-level representation and a streamlined diffusion process, the model needs only about 60 denoising steps instead of roughly 400, which translates into markedly quicker runs and a much smaller memory footprint than its predecessor RFD3 when generating a 200-residue protein. During generation, the model can also run a reward-guided search that scores and branches partial designs using GPU-accelerated evaluation tools such as OpenFold3 and TMol, steering computation toward the most promising candidates. It ships both as an open-source model on GitHub and as a NIM microservice reachable over HTTP, with toolkit skills available to let automated agents chain generation, scoring and evaluation steps together.
Google Cloud and NVIDIA announced general availability of A5X instances built on NVIDIA Vera Rubin NVL72 GPUs, ConnectX-9 SuperNICs and Google's Virgo network, targeting large-scale agentic inference and reinforcement learning. Google Cloud plans to scale Vera Rubin infrastructure to up to 960,000 Rubin GPUs across multiple sites, with general availability next month and planned expansion to Europe. London-based Ineffable Intelligence, founded by AlphaGo creator David Silver, is the first customer, using the platform for continuous reinforcement-learning 'superlearner' systems. WPP also demonstrated a creative agent architecture on A5X using NVIDIA Nemotron models and OpenShell, running workloads on a single instance that previously needed a multi-node cluster.
NVIDIA has added three new open, commercially licensed components to its Nemotron Retriever lineup: Embed models (8B and 1B, in BF16 and NVFP4) for searching text and images, a Rerank model (8B) that reorders retrieved evidence by relevance, and a compact 631M Parse model that converts document images into structured text. The goal is to feed AI agents with better, more relevant evidence so they need fewer search rounds and fewer inference tokens to answer a question. NVIDIA reports the new Embed and Rerank models top the ViDoRe v3.1 leaderboards for dense retrieval and reranking respectively.
NVIDIA has published OpenShell, an open-source runtime that treats agent workloads as untrusted and grants access to files, tools and systems only when needed. It pairs with the new NVIDIA Vera CPU and, optionally, BlueField-4 DPUs with NVIDIA Sentry for hardware-enforced monitoring. NVIDIA says this combination forms a full reference architecture for running autonomous agents safely at data-center scale.
NVIDIA has detailed Sentry, a new security framework that sits outside an AI agent's reach, enforcing policy and watching behavior from a dedicated hardware trust domain on BlueField-4 DPUs. The idea is simple: even if an agent is compromised or goes off-script while using tools and credentials, Sentry keeps watching and can cut it off because it doesn't depend on the host OS the agent runs on. Two components do the work — DOCA Tower, a proxy that inspects and authorizes every agent network request, and DOCA Argus, which reads live memory to understand what's actually running. When something looks wrong, the system can quarantine the agent within milliseconds, without needing the agent or the host to cooperate.
NVIDIA released Cosmos3-H-Dreams, a world foundation model that generates interactive, real-time surgical scenes based on robot kinematics from actual clinical cholecystectomy procedures recorded on the CMR Surgical Versius platform. Built on the 16-billion-parameter Cosmos3-H-Embodied-Nano model and accelerated with NVIDIA's FlashDreams streaming-inference library, it runs on a single RTX PRO 6000 GPU. The system learns visual surgical dynamics directly from video and kinematics data rather than explicit physics modeling, and offers four-step and two-step distilled checkpoints trading quality for speed.
Microsoft and NVIDIA released a joint whitepaper, 'Risk Management for Open-Weight Models in Enterprise,' the first in a planned series offering enterprises a shared risk taxonomy and methodology for evaluating open-weight AI models. The paper argues that whether a model is open or closed-weight is not the key risk factor — what matters is the use case, deployment architecture, and surrounding safeguards. It organizes risks into five categories (Cybersecurity, Data Protection, Content, Human-AI Interaction, Bias) and maps evaluations to those risks, aligning with ISO standards and the NIST AI Risk Management Framework.
Google Cloud published a reference architecture for building AI agents that coordinate long-running, GPU-heavy scientific tasks like protein folding and compound screening, which break standard single-LLM-agent setups due to timeouts and context overflow. The design separates a cognitive orchestrator (Gemini on Agent Runtime) from a GPU execution layer (NVIDIA NIMs like ESMFold and GenMol on GKE) and wraps both in an enterprise governance plane with agent identity, a gateway, a registry and Model Armor. It also lays out best practices such as passing bulky data by reference instead of inline, streaming progress updates, and gating irreversible actions behind human approval.
NVIDIA, working with IIT Madras's AI4Bharat lab, is releasing Nemotron-pretraining-Indic-v1, a roughly 2.8 trillion token synthetic pretraining corpus covering 22 Indian languages, along with the open GPU-accelerated pipeline used to generate it. The corpus includes native-script data for all 22 languages and romanized text for twelve, built by translating curated English source material (web text, math, code, Q&A) using NeMo Data Designer and quality-checked with an MQM-inspired rubric. NVIDIA already used a 10-billion-token Indic subset for continued pretraining of Nemotron 3.5 Super VL, which showed measurable gains on Indic benchmarks.