Skip to content
Thursday, 19 November 2026
Tenesys AI News
Subscribe

AI Models

New models and versions from OpenAI, Anthropic, Google, Meta, Mistral, xAI, DeepSeek, Qwen and others.

“Inference” — 35 articles ✕

Models· 🧪 Worth Testing

Optimizing MoE Model Inference via Expert Streaming

Hugging Face has introduced expert streaming for Mixture-of-Experts (MoE) models within the Transformers library. This technique allows running massive models that would typically exceed standard hardware memory limits by streaming active experts on demand.

Hugging Face
Models· Important· 🧪 Worth Testing

Real-time Voice Reasoning Model Available via SageMaker JumpStart

PolyAI has introduced Dialog-RSN-1, a model specifically trained to handle live voice conversations by processing audio directly without intermediate transcription. It is now accessible in the AWS ecosystem for deployment as a private, secure inference endpoint.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

NVIDIA Launches RTX Spark Compact Desktops for Local AI

NVIDIA has released a new line of compact desktop PCs from ASUS, Dell, and MSI designed specifically for local AI workloads. These systems feature a 20-core NVIDIA Grace CPU, Blackwell RTX GPU, and up to 128GB of unified memory to support large language models and persistent agents.

NVIDIA
Models· Important· 🧪 Worth Testing

New 1B parameter model focused on mathematical reasoning

Researchers released Limite 1B - Violetto, a compact 1-billion-parameter model built for mathematical problem-solving. It supports a 131k token context window and is licensed under Apache 2.0.

arXiv cs.CL
Models· Important· 🧪 Worth Testing

OpenTSLM temporal foundation models now available on Amazon SageMaker

Aionic Labs has launched OpenTSLM-Flamingo, a time-series language model (TSLM) now deployable via Amazon SageMaker JumpStart. It combines the Gemma 3 4B architecture with a time-series encoder to interpret operational metrics alongside text context.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Scaling LLM Inference with NVIDIA Dynamo on SageMaker HyperPod

AWS now provides managed support for NVIDIA Dynamo within SageMaker HyperPod, simplifying the deployment of large-scale language models. This update introduces multi-node inference, allowing teams to run models that exceed single-GPU memory through disaggregated prefill and decode worker pools.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Amazon SageMaker AI introduces KV cache-aware routing for LLMs

Amazon SageMaker AI has launched a new 'KV_AWARE' routing strategy that directs LLM inference requests to instances based on their actual KV cache state rather than just prompt headers. This optimizes multi-turn conversations and long-context workloads by ensuring requests land where relevant data is already cached.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Optimizing Sparse Attention Kernels for Long-Context LLMs

NVIDIA has released a technical primer on co-designing sparse attention for long-context models. By focusing on GPU-friendly indexer kernels—which identify relevant tokens before full attention—developers can significantly improve inference efficiency for context lengths surpassing 100K tokens.

NVIDIA Developer
Models· Important· 🧪 Worth Testing

NVIDIA Launches Nemotron for Science for Autonomous Research Agents

NVIDIA unveiled 'Nemotron for Science', a toolkit combining the Nemotron 3.5 Super VL model with specialized chemistry datasets and post-training recipes. This platform allows researchers to deploy local agents that can autonomously plan experiments, execute code, and validate data findings.

NVIDIA
Models· Important· 🧪 Worth Testing

Unified Multilingual Speech Tagging with Multimodal LLMs

Researchers introduced OmniTag-Bench, a new five-language framework for evaluating multimodal LLMs on simultaneous speech transcription and metadata tagging. Instead of using separate specialist models, the study demonstrates that a single, fine-tuned multimodal LLM can extract transcripts, emotion, gender, language, and named entities in a single inference pass.

arXiv cs.CL
Models· Important· 🧪 Worth Testing

Hugging Face migrates Inference Providers to OpenRouter

Hugging Face has partnered with OpenRouter to power its language model inference. All language model requests now use OpenRouter to automatically select the optimal provider based on real-time price, speed, and reliability metrics.

Hugging Face
Models· Important· 🧪 Worth Testing

Optimizing coding agent costs on Amazon Bedrock with NVIDIA NeMo Switchyard

Amazon has released a reference architecture that integrates the NVIDIA NeMo Switchyard library with LiteLLM to dynamically route coding agent requests between different models on Bedrock. By using stage or random routing, you can shift traffic between high-capability and high-efficiency models to balance performance and cost.

AWS Machine Learning
Models· 🧪 Worth Testing

NVIDIA Adds Native Python Support for DLA Inference

NVIDIA has released the cuda.bindings.cudla module, enabling direct Python-based management of the Deep Learning Accelerator (DLA) on Jetson AGX Orin. Developers can now orchestrate hybrid workflows where GPU preprocessing and DLA inference share a single CUDA stream.

NVIDIA Developer
Models· Important· 🧪 Worth Testing

Scaling Large MoE Models Across Multiple NVIDIA DGX Stations

NVIDIA has released a technical workflow for serving the 753B parameter GLM-5.3 MoE model across two GB300-equipped DGX Stations. By utilizing tensor parallelism (TP=2) over RDMA connections and vLLM, you can overcome single-GPU memory constraints (252 GB HBM3e) for massive frontier-scale models.

NVIDIA Developer
Models· Important· 🧪 Worth Testing

llama.cpp reaches v1.0.0 with formalized API stability

The llama.cpp project has officially reached its 1.0.0 milestone, three and a half years after its inception. The release introduces strict semantic versioning to ensure better predictability for developers relying on its C/C++ libraries, libllama and libggml.

Hugging Face
Models· Important· 🧪 Worth Testing

DeepSeek Launches Native API Capabilities for Search, Files, and Voice

DeepSeek has moved beyond basic model inference by exposing its full application-level toolkit to API users. Developers can now enable parameters for web search, URL reading, file parsing, and safety filtering directly in chat completions, or utilize standalone ASR, TTS, and OCR endpoints.

DeepSeek API Updates
Models· Important· 🧪 Worth Testing

AWS launches SGLang support for Trainium chips

Amazon has released SGLang-Neuron, a plugin allowing developers to run large-scale AI models on AWS Trainium hardware using the standard SGLang interface. This integration enables native PyTorch execution and supports advanced features like PD disaggregation over EFA for optimized serving.

AWS Machine Learning
Models· 🧪 Worth Testing

MiniMax releases H3-Image-PE for automated prompt expansion

MiniMax has launched MiniMax-H3-Image-PE, a fine-tuned version of the Qwen3.8-27B model designed to transform brief text prompts into highly detailed descriptions for image generation. The release includes specific workflows for text-to-image expansion and early-stage support for image editing prompts.

MiniMax (Hugging Face)
Models· Important· 🧪 Worth Testing

NVIDIA releases Dynamo deployment recipes for Korean open models

NVIDIA has introduced deployment recipes for four prominent Korean open models, including A.X K2 and Solar Open 2, within the Dynamo framework. These recipes are specifically optimized for multi-node NVIDIA B200 GPU clusters, designed to handle large-scale inference efficiently.

NVIDIA
Models· Important· 🧪 Worth Testing

NVIDIA Unveils Co-Design Strategies to Maximize AI Memory Efficiency

NVIDIA has introduced five co-design pillars for its Vera Rubin NVL72 platform, aimed at maximizing throughput in agentic AI workloads. By combining new precision formats like NVFP4, wide expert parallelism, and the Dynamo distributed serving layer, the system treats memory as a unified, tiered resource across GPUs, host CPUs, and specialized storage.

NVIDIA Developer
Models· Important· 🧪 Worth Testing

NVIDIA Releases CUDA 13.5 with General Availability for Vera Rubin Architecture

NVIDIA has launched CUDA 13.5, reaching general availability for its new Vera Rubin GPU architecture. This update introduces significant enhancements to multi-process service (MPS) resource scheduling, locality domain partitioning, and deeper integration with SIMT libraries via CUDA Tile.

NVIDIA Developer
Models· Important· 🧪 Worth Testing

NVIDIA Launches Cosmos Platform for Physical AI and World Simulation

NVIDIA has introduced Cosmos, a platform offering world foundation models and development tools specifically designed for physical AI applications, such as robotics and autonomous vehicles. The framework includes modular training recipes and NIM microservices for GPU-accelerated inference, enabling the generation of synchronized video and LiDAR observations.

NVIDIA Developer