NVIDIA has launched CUDA 13.5, reaching general availability for its new Vera Rubin GPU architecture. This update introduces significant enhancements to multi-process service (MPS) resource scheduling, locality domain partitioning, and deeper integration with SIMT libraries via CUDA Tile.
Dharma-AI has introduced a 2-billion-parameter model specialized in extracting structured JSON fields from various documents. It supports both open extraction and schema-directed modes, consistently outperforming frontier LLMs on field-level F1 benchmarks while significantly reducing operational costs.
Moonshot AI has introduced Kimi-K3.1-Pro, an open-weight, natively multimodal model with 2.8 trillion parameters. It features a 1-million-token context window, uses a Mixture-of-Experts (MoE) architecture, and is specifically optimized for agentic workflows and long-horizon tasks.
Cohere has integrated its state-of-the-art Embed 5 and Rerank 5 retrieval models into the OpenRouter API. This update allows developers to build RAG pipelines using a single API key and billing source without needing additional SDKs.
Researchers have introduced MEMENTO, a specialized agentic framework built on Qwen3-8B designed to manage long context by compacting history into concise notes. By utilizing fine-tuning on synthetic trajectories followed by reinforcement learning, it achieves high accuracy on book-level tasks while strictly limiting context usage to 20K tokens, even for inputs as large as 2.5 million tokens.
The new message threads feature in beta allows developers to keep conversation state on the server. By sending only incremental updates instead of the full history, you can achieve faster response times in complex agentic loops.
NVIDIA has introduced Cosmos, a platform offering world foundation models and development tools specifically designed for physical AI applications, such as robotics and autonomous vehicles. The framework includes modular training recipes and NIM microservices for GPU-accelerated inference, enabling the generation of synchronized video and LiDAR observations.
Amazon has published a workflow for using Sequence-Level Knowledge Distillation (SeqKD) to fine-tune smaller models on trajectories generated by frontier models. By using a 'teacher' model to generate successful tool-use trajectories and filtering them with a programmatic scorer, teams can train compact 'student' models that perform complex reasoning at a fraction of the cost.
Anthropic has announced the deprecation of the fast mode for the Claude Opus 4.8 model. Support for this mode will be completely removed on November 30, 2026, after which requests will result in an error.
NVIDIA has released a new command-line interface for the TensorRT Edge-LLM runtime, allowing developers to quickly prototype and test AI models on the DGX Spark 64GB workstation. The tool chain facilitates local model serving and supports DSpark speculative decoding to boost generation performance on edge-constrained hardware.
OpenAI has released GPT-6 Rosalind, a variant designed specifically for biological reasoning and scientific tool integration. Access is currently limited to approved organizations through a trusted-access program.
The first-party Claude API now supports larger data submissions through its Messages and Token Counting endpoints. Developers can now send requests up to 128 MB, a substantial upgrade from the previous 32 MB cap.
Google has announced Gemini 4 Carbon, a new high-performance model designed for complex engineering and cybersecurity. The model excels in vulnerability detection, secure patching, and long-horizon reasoning, while introducing improved alignment and prompt-injection resistance.
NVIDIA has introduced Nemotron 3.5 Transcribe, an open-weight, promptable model for speech-to-text, speaker diarization, and translation. It utilizes a hybrid Mamba-Transformer architecture to achieve industry-leading performance with only 4 billion active parameters.
NVIDIA has released 'Nemotron-Personas' datasets for France and Belgium, designed to improve LLM accuracy regarding regional procedures, demographics, and cultural nuances. The update provides a complete post-training workflow—including data generation, LoRA fine-tuning via NVIDIA NeMo, and evaluation—to help developers transition from generic models to domain-specific agents.
Google DeepMind introduced Genie 4, a multimodal world model that enables real-time interactive simulations. It natively generates video, ambient audio, and responsive dialogue, utilizing Gemini 3.8 Flash to maintain physical consistency and handle multi-step reasoning.
Google has launched Gemini Robotics Embodied Reasoning 2 (ER 2) in public preview on the Gemini platform. This model acts as a high-level cognitive layer for robotics, capable of planning, self-correcting tasks, and managing multi-robot systems via natural language instructions.
Google has introduced Gemini Omni, a new video-generation model capable of creating and editing clips from text and image prompts. The model is now the default for Google's video workflows, while the previous Veo model has been deprecated in the API.
OpenAI has officially released GPT-6.1 Terra, a new model specifically engineered to excel in visual reasoning, precise computer navigation, and natural language generation.
Amazon Bedrock now supports explicit and implicit prompt caching for OpenAI models, allowing you to store and reuse static prompt prefixes like tools, instructions, and conversation history. By avoiding the re-processing of identical tokens across turns, you can significantly lower input costs and improve responsiveness in complex agent workflows.
IBM has updated its software ecosystem to treat the Spyre dataflow accelerator as a first-class PyTorch backend. By leveraging TorchDynamo and TorchInductor, developers can now run models on IBM Z, LinuxONE, and Power systems using standard PyTorch workflows and vLLM plugins.
Google has updated the Gemini API to automatically store requests (store=true) for all new projects on the paid tier. This change aligns standard content generation methods with the Interactions API, requiring developers to manually opt out if they prefer not to store request data.
Cohere launched Rerank 5, its newest enterprise reranking models, in Pro and Fast tiers. Rerank 5 Pro leads major public benchmarks including BRIGHT, ViDoRe V3, BEIR and nanoMTEB, while Rerank 5 Fast offers near-leading quality at lower cost and higher throughput. The release introduces Context Focus, which returns the most relevant text spans within documents rather than whole documents, and calibrated relevance scores that read as probabilities across models and domains.
NVIDIA has added three new open, commercially licensed components to its Nemotron Retriever lineup: Embed models (8B and 1B, in BF16 and NVFP4) for searching text and images, a Rerank model (8B) that reorders retrieved evidence by relevance, and a compact 631M Parse model that converts document images into structured text. The goal is to feed AI agents with better, more relevant evidence so they need fewer search rounds and fewer inference tokens to answer a question. NVIDIA reports the new Embed and Rerank models top the ViDoRe v3.1 leaderboards for dense retrieval and reranking respectively.