Skip to content
Thursday, 19 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

“NVIDIA” — 8 articles ✕

Models· Important· 🧪 Worth Testing

Optimizing coding agent costs on Amazon Bedrock with NVIDIA NeMo Switchyard

Amazon has released a reference architecture that integrates the NVIDIA NeMo Switchyard library with LiteLLM to dynamically route coding agent requests between different models on Bedrock. By using stage or random routing, you can shift traffic between high-capability and high-efficiency models to balance performance and cost.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Scaling Large MoE Models Across Multiple NVIDIA DGX Stations

NVIDIA has released a technical workflow for serving the 753B parameter GLM-5.3 MoE model across two GB300-equipped DGX Stations. By utilizing tensor parallelism (TP=2) over RDMA connections and vLLM, you can overcome single-GPU memory constraints (252 GB HBM3e) for massive frontier-scale models.

NVIDIA Developer
Models· Important· 🧪 Worth Testing

llama.cpp reaches v1.0.0 with formalized API stability

The llama.cpp project has officially reached its 1.0.0 milestone, three and a half years after its inception. The release introduces strict semantic versioning to ensure better predictability for developers relying on its C/C++ libraries, libllama and libggml.

Hugging Face
Automation· Important· 🧪 Worth Testing

NVIDIA AICR Now Includes AI Bill of Materials for Workload Tracking

NVIDIA has integrated the open-source k8s-aibom project into its AI Cluster Runtime (AICR). This allows platform teams to automatically generate and audit an AI Bill of Materials (AIBOM) for workloads running on Kubernetes, identifying models, inference runtimes, and dependencies.

NVIDIA Developer
Automation· Important· 🧪 Worth Testing

NVIDIA Launches Open Source Kubernetes Engine for GPU Infrastructure

NVIDIA has released NVIDIA Kubernetes Engine (NVKE) and NVIDIA Kubernetes Recipes (NVKR) as open-source projects in public preview. These tools aim to help providers build, deploy, and manage Kubernetes clusters specifically optimized for GPU-accelerated workloads.

NVIDIA Developer
Automation· Important· 🧪 Worth Testing

NVIDIA Snapshot Accelerates GPU Inference Startup Times to Seconds

NVIDIA has released an open-source tool, NVIDIA Snapshot, for Kubernetes-based GPU workloads. By checkpointing fully initialized models and their states, the system allows inference replicas to resume in seconds rather than minutes, effectively eliminating repetitive initialization steps.

NVIDIA Developer