NVIDIA has integrated the open-source k8s-aibom project into its AI Cluster Runtime (AICR). This allows platform teams to automatically generate and audit an AI Bill of Materials (AIBOM) for workloads running on Kubernetes, identifying models, inference runtimes, and dependencies.
NVIDIA has released NVIDIA Kubernetes Engine (NVKE) and NVIDIA Kubernetes Recipes (NVKR) as open-source projects in public preview. These tools aim to help providers build, deploy, and manage Kubernetes clusters specifically optimized for GPU-accelerated workloads.
NVIDIA has released an open-source tool, NVIDIA Snapshot, for Kubernetes-based GPU workloads. By checkpointing fully initialized models and their states, the system allows inference replicas to resume in seconds rather than minutes, effectively eliminating repetitive initialization steps.
Amazon SageMaker Inference has introduced support for NVIDIA Multi-Instance GPU (MIG), allowing you to partition a single physical GPU into multiple independent units. This hardware-level division provides dedicated compute and memory to each partition, ensuring predictable latency and strong isolation between models hosted on the same accelerator.
NVIDIA has open-sourced 'NVIDIA Attribution,' a tool designed to correlate logs, metrics, and scheduler states into structured diagnoses for distributed AI training jobs. By identifying root causes and distinguishing them from downstream symptoms (like NCCL errors), it helps infrastructure teams manage large-scale GPU deployments more effectively.
NVIDIA Recovery is a new open-source service built to maintain productive training by automating job-level fault handling across GPU clusters. It replaces manual oversight with a systematic loop that detects errors, identifies causes, and triggers restarts or node exclusions.
NVIDIA has released updated AI Cluster Runtime (AICR) recipes designed to streamline the deployment of Kubernetes on the new Vera Rubin NVL72 hardware. These recipes provide pre-validated configurations for drivers, kernels, and network components, ensuring production-ready clusters from day one.
NVIDIA has released Workload Map, a tool designed to provide a common way for Kubernetes schedulers and platforms to interpret diverse distributed AI workloads. By using declarative YAML definitions, it eliminates the need for developers to build custom parsing adapters for every new framework like JobSet, Ray, or KServe.
NVIDIA has released AI Cluster Runtime (AICR) to package Dynamo inference infrastructure into validated recipes. This update simplifies deployment by pinning versions and removing mandatory external dependencies like NATS, while introducing new KV-aware routing paths for Kubernetes.
AWS introduced pre-built Ray Train Deep Learning Containers (DLCs) that consolidate PyTorch, CUDA, NCCL, and EFA networking libraries into a single tested image. This approach allows your team to deploy distributed training clusters on Amazon EKS without maintaining custom build pipelines or resolving complex driver compatibility issues.
NVIDIA has expanded its Mission Control platform to include autonomous recovery for Kubernetes environments managed by Run:ai. The system now separates job-level recovery from hardware-level maintenance, allowing training tasks to restart on healthy nodes while simultaneously diagnosing faulty infrastructure.
NVIDIA has introduced Minerva, an operations platform that pulls together telemetry across GPUs, networking gear, storage and running jobs so operators can spot trouble in massive GPU clusters before it causes downtime. Machine learning models build a live map of the hardware and workloads, flag unusual behavior, and bundle related alerts into one incident with a likely cause rather than flooding teams with separate warnings. A built-in assistant lets staff query cluster health in plain language, and the system can link to automation tools to act on fixes. IREN, Aolani, Bitdeer AI, IBM, Jio, Lambda, Quake AI and Tesla are lined up to use it, while Dell, Lenovo and Supermicro will sell it as part of their infrastructure offerings.
NVIDIA is releasing a new 64GB unified memory configuration of its DGX Spark personal AI supercomputer, available from partners like Acer, ASUS, Dell, HP, Gigabyte and MSI starting Oct. 23 at $4,999. The system runs up to 100-billion-parameter models locally on device, and two units can be clustered via NVIDIA Sync Cluster Assistant to pool memory to 128GB and support models up to 200 billion parameters, with up to 1.7x performance gains in NVIDIA's Qwen 3.8 27B test. It ships with the NVIDIA Agent Toolkit, CUDA-X AI libraries, Nemotron models and support for Ollama, vLLM and PyTorch out of the box.