NVIDIA has detailed Sentry, a new security framework that sits outside an AI agent's reach, enforcing policy and watching behavior from a dedicated hardware trust domain on BlueField-4 DPUs. The idea is simple: even if an agent is compromised or goes off-script while using tools and credentials, Sentry keeps watching and can cut it off because it doesn't depend on the host OS the agent runs on. Two components do the work — DOCA Tower, a proxy that inspects and authorizes every agent network request, and DOCA Argus, which reads live memory to understand what's actually running. When something looks wrong, the system can quarantine the agent within milliseconds, without needing the agent or the host to cooperate.
NVIDIA released Cosmos3-H-Dreams, a world foundation model that generates interactive, real-time surgical scenes based on robot kinematics from actual clinical cholecystectomy procedures recorded on the CMR Surgical Versius platform. Built on the 16-billion-parameter Cosmos3-H-Embodied-Nano model and accelerated with NVIDIA's FlashDreams streaming-inference library, it runs on a single RTX PRO 6000 GPU. The system learns visual surgical dynamics directly from video and kinematics data rather than explicit physics modeling, and offers four-step and two-step distilled checkpoints trading quality for speed.
Microsoft and NVIDIA released a joint whitepaper, 'Risk Management for Open-Weight Models in Enterprise,' the first in a planned series offering enterprises a shared risk taxonomy and methodology for evaluating open-weight AI models. The paper argues that whether a model is open or closed-weight is not the key risk factor — what matters is the use case, deployment architecture, and surrounding safeguards. It organizes risks into five categories (Cybersecurity, Data Protection, Content, Human-AI Interaction, Bias) and maps evaluations to those risks, aligning with ISO standards and the NIST AI Risk Management Framework.
Google Cloud published a reference architecture for building AI agents that coordinate long-running, GPU-heavy scientific tasks like protein folding and compound screening, which break standard single-LLM-agent setups due to timeouts and context overflow. The design separates a cognitive orchestrator (Gemini on Agent Runtime) from a GPU execution layer (NVIDIA NIMs like ESMFold and GenMol on GKE) and wraps both in an enterprise governance plane with agent identity, a gateway, a registry and Model Armor. It also lays out best practices such as passing bulky data by reference instead of inline, streaming progress updates, and gating irreversible actions behind human approval.
NVIDIA, working with IIT Madras's AI4Bharat lab, is releasing Nemotron-pretraining-Indic-v1, a roughly 2.8 trillion token synthetic pretraining corpus covering 22 Indian languages, along with the open GPU-accelerated pipeline used to generate it. The corpus includes native-script data for all 22 languages and romanized text for twelve, built by translating curated English source material (web text, math, code, Q&A) using NeMo Data Designer and quality-checked with an MQM-inspired rubric. NVIDIA already used a 10-billion-token Indic subset for continued pretraining of Nemotron 3.5 Super VL, which showed measurable gains on Indic benchmarks.
Meta published Muse Spark Open, an open-weight mixture-of-experts model with about 816 billion total parameters and 42 billion active per token. It accepts text, images, audio and video as input and generates text, with a context window of up to 1 million tokens. Meta positions it as a coding-optimized, agentic model built on top of the smaller Muse Glimmer architecture, calling it the most capable US open-weights model released so far.
NVIDIA published a case study showing how Siemens EDA applied its open NeMo Gym evaluation library to tighten up an agentic tool used for chip characterization. Instead of checking individual tool calls, the team scored complete final output files with a domain-specific verifier, then used the failure patterns to rewrite the agent's skill instructions and MCP tool descriptions. After several rounds of this loop, a composite accuracy benchmark climbed from roughly 55% to 95%, while the agent needed far fewer steps and far less output to get there. The experiments relied on about 25 evaluation rollouts running Claude Opus 4.8 as the agent model inside Claude Code.
Liquid AI has published LFM2.5-24B-A2B, a mixture-of-experts model with 24B total parameters but only 2B active per token, designed to run reasoning agents on local hardware. The release expands the context window to 131K tokens, doubles the vocabulary size, and was trained on roughly double the pretraining data of its predecessor. On agentic and tool-use benchmarks the model performs on par with or better than models that have about 50% more parameters, while delivering fast inference speeds on both consumer and data-center hardware.
NVIDIA has released the full Run:ai platform as open source, adding it as a foundation of the NVIDIA DSX AI Factory Platform for AI workload and GPU orchestration on Kubernetes. The release includes four modular components — KAI Scheduler, GPU Fractioning Operator, KAI Resource Management, and Workload Map — that can be adopted together or independently. Eight ecosystem partners, including Crusoe, Mirantis, Nebius, OpenNebula Systems, Rafay, Saturn Cloud, Spectro Cloud, and vCluster, are integrating the platform into their own offerings.
NVIDIA, working with Princeton's Dao AI Lab, built ReplaySSM, a new way to store state in hybrid models that mix state-space (SSM) layers with attention layers. Instead of rewriting the entire state on every token, the method keeps a periodic checkpoint plus a short list of recent inputs, splitting the job of producing output from the job of updating memory. The result is roughly half the memory traffic, decode kernels running up to 1.80x faster at scale, and speculative decoding throughput more than doubling on 120B-class models, all while keeping accuracy close to full precision. The method already ships inside TensorRT-LLM, vLLM, and FlashInfer, and is running in production for GLM-5.3-Flash and Kimi-K3.
At the OCP Global Summit, NVIDIA contributed its Vera Rubin rack and compute tray designs to the open MGX architecture and announced a series of partnerships covering AI factory power, cooling and networking standards. Partners include hyperscalers such as Meta, Google, Microsoft and AMD, plus Cisco and Visionbay. The announcements cover rack design specs (MGX 1.2), new open-source software for managing AI data centers (DSX OS components), grid resilience standards, an 800VDC power architecture, new Ethernet switching (Spectrum-6) and a new optical transceiver standard (USFP) with Cisco.
NVIDIA described a workflow built into Megatron Core that makes large-scale pretraining bitwise deterministic, meaning independent or checkpoint-resumed training runs follow the exact same numerical trajectory. Using tensor fingerprinting across training phases, modules, operations and kernels, engineers can trace nondeterminism down to a specific kernel and fix it. On a trillion-parameter Nemotron model running on 2,432 GPUs, optimizations brought the performance cost of enforcing determinism (the 'determinism tax') down to about 2%, while keeping bitwise-identical results over 800 training steps.
NVIDIA released a detailed workflow for fine-tuning its Nemotron 3.5 ASR multilingual streaming model on Saudi Arabic dialects (Najdi and Hijazi). Using minimal data curation, replay mixing with FLEURS data, duration-based bucketing, and partial encoder unfreezing, they reduced word error rate on the target dialects from 55.05% to 29.96% while also slightly improving English and other Arabic performance. The post also covers decoding tweaks and speaker diarization extensions for multi-speaker transcription.
NVIDIA is releasing a new 64GB unified memory configuration of its DGX Spark personal AI supercomputer, available from partners like Acer, ASUS, Dell, HP, Gigabyte and MSI starting Oct. 23 at $4,999. The system runs up to 100-billion-parameter models locally on device, and two units can be clustered via NVIDIA Sync Cluster Assistant to pool memory to 128GB and support models up to 200 billion parameters, with up to 1.7x performance gains in NVIDIA's Qwen 3.8 27B test. It ships with the NVIDIA Agent Toolkit, CUDA-X AI libraries, Nemotron models and support for Ollama, vLLM and PyTorch out of the box.