NVIDIA has integrated the open-source k8s-aibom project into its AI Cluster Runtime (AICR). This allows platform teams to automatically generate and audit an AI Bill of Materials (AIBOM) for workloads running on Kubernetes, identifying models, inference runtimes, and dependencies.
NVIDIA has released NVIDIA Kubernetes Engine (NVKE) and NVIDIA Kubernetes Recipes (NVKR) as open-source projects in public preview. These tools aim to help providers build, deploy, and manage Kubernetes clusters specifically optimized for GPU-accelerated workloads.
NVIDIA has released an open-source tool, NVIDIA Snapshot, for Kubernetes-based GPU workloads. By checkpointing fully initialized models and their states, the system allows inference replicas to resume in seconds rather than minutes, effectively eliminating repetitive initialization steps.
Amazon SageMaker Inference has introduced support for NVIDIA Multi-Instance GPU (MIG), allowing you to partition a single physical GPU into multiple independent units. This hardware-level division provides dedicated compute and memory to each partition, ensuring predictable latency and strong isolation between models hosted on the same accelerator.
NVIDIA has open-sourced 'NVIDIA Attribution,' a tool designed to correlate logs, metrics, and scheduler states into structured diagnoses for distributed AI training jobs. By identifying root causes and distinguishing them from downstream symptoms (like NCCL errors), it helps infrastructure teams manage large-scale GPU deployments more effectively.
NVIDIA Recovery is a new open-source service built to maintain productive training by automating job-level fault handling across GPU clusters. It replaces manual oversight with a systematic loop that detects errors, identifies causes, and triggers restarts or node exclusions.
NVIDIA has released updated AI Cluster Runtime (AICR) recipes designed to streamline the deployment of Kubernetes on the new Vera Rubin NVL72 hardware. These recipes provide pre-validated configurations for drivers, kernels, and network components, ensuring production-ready clusters from day one.
NVIDIA has released Workload Map, a tool designed to provide a common way for Kubernetes schedulers and platforms to interpret diverse distributed AI workloads. By using declarative YAML definitions, it eliminates the need for developers to build custom parsing adapters for every new framework like JobSet, Ray, or KServe.
NVIDIA has released AI Cluster Runtime (AICR) to package Dynamo inference infrastructure into validated recipes. This update simplifies deployment by pinning versions and removing mandatory external dependencies like NATS, while introducing new KV-aware routing paths for Kubernetes.
AWS introduced pre-built Ray Train Deep Learning Containers (DLCs) that consolidate PyTorch, CUDA, NCCL, and EFA networking libraries into a single tested image. This approach allows your team to deploy distributed training clusters on Amazon EKS without maintaining custom build pipelines or resolving complex driver compatibility issues.
NVIDIA has expanded its Mission Control platform to include autonomous recovery for Kubernetes environments managed by Run:ai. The system now separates job-level recovery from hardware-level maintenance, allowing training tasks to restart on healthy nodes while simultaneously diagnosing faulty infrastructure.