NVIDIA has released a technical primer on co-designing sparse attention for long-context models. By focusing on GPU-friendly indexer kernels—which identify relevant tokens before full attention—developers can significantly improve inference efficiency for context lengths surpassing 100K tokens.
NVIDIA unveiled 'Nemotron for Science', a toolkit combining the Nemotron 3.5 Super VL model with specialized chemistry datasets and post-training recipes. This platform allows researchers to deploy local agents that can autonomously plan experiments, execute code, and validate data findings.
NVIDIA has released the initial MLPerf Training v6.1 and Endpoints v1.0 results for its new Vera Rubin architecture. The system demonstrated significant leaps in both training speed and power efficiency for agent-based AI workloads.
Amazon has released a reference architecture that integrates the NVIDIA NeMo Switchyard library with LiteLLM to dynamically route coding agent requests between different models on Bedrock. By using stage or random routing, you can shift traffic between high-capability and high-efficiency models to balance performance and cost.
NVIDIA has released the cuda.bindings.cudla module, enabling direct Python-based management of the Deep Learning Accelerator (DLA) on Jetson AGX Orin. Developers can now orchestrate hybrid workflows where GPU preprocessing and DLA inference share a single CUDA stream.
NVIDIA has launched v0.2 of the SOMA Retargeter, an open-source tool designed to adapt human motion data for humanoid robot platforms. It processes motion sources—such as mocap, video reconstruction, or generative models—and aligns them with specific robot anatomy using inverse kinematics.
NVIDIA has released a technical workflow for serving the 753B parameter GLM-5.3 MoE model across two GB300-equipped DGX Stations. By utilizing tensor parallelism (TP=2) over RDMA connections and vLLM, you can overcome single-GPU memory constraints (252 GB HBM3e) for massive frontier-scale models.
The llama.cpp project has officially reached its 1.0.0 milestone, three and a half years after its inception. The release introduces strict semantic versioning to ensure better predictability for developers relying on its C/C++ libraries, libllama and libggml.
NVIDIA has integrated the open-source k8s-aibom project into its AI Cluster Runtime (AICR). This allows platform teams to automatically generate and audit an AI Bill of Materials (AIBOM) for workloads running on Kubernetes, identifying models, inference runtimes, and dependencies.