Amazon has expanded the capabilities of the AgenticRetrieveStream API, allowing developers to specify the iteration level for knowledge base requests. You can now choose between zero, one, or multiple retrieval steps to balance speed, cost, and complexity per request.
Anthropic has launched Claude Fable 5.2 and Claude Mythos 5.2, models designed for long-horizon agentic tasks and advanced reasoning. The update features a price decrease and an optional 'fast mode' to boost throughput. Developers must note new prefix checks, computer tool updates, and specific advisor model constraints.
NVIDIA has introduced deployment recipes for four prominent Korean open models, including A.X K2 and Solar Open 2, within the Dynamo framework. These recipes are specifically optimized for multi-node NVIDIA B200 GPU clusters, designed to handle large-scale inference efficiently.
NVIDIA has introduced new optimization tools in TensorRT LLM VisualGen for the FLUX 3 Image Klein model. By utilizing NVFP4 quantization, kernel fusion, sparse attention, and step caching, developers can achieve up to 3.46x faster text-to-image generation on NVIDIA Blackwell hardware.
NVIDIA introduced four 16B parameter checkpoints within its Cosmos 3 Nano family, designed for interactive world simulation. These models enable developers to generate synthetic multi-sensor driving data, simulate robotic movements, and convert simulator controls into photorealistic video.
Apple researchers have introduced an approach to accelerate Maximum Inner Product Search (MIPS) in RAG systems using small, task-specific neural networks. By training models (SupportNet and KeyNet) on query distributions, systems can achieve higher recall at lower latency compared to traditional centroid-based partitioning.
OpenAI has introduced GPT-6-Cyber, a new model variant tailored for identifying, reproducing, and patching security vulnerabilities. The release requires configuration of the Daybreak environment prior to implementation.
Google has launched Gemini Omni 1.2 Flash, a model update focused on video production. It extends native video generation to 15 seconds, improves object and character consistency, and introduces multi-turn conversational editing.
NVIDIA has introduced five co-design pillars for its Vera Rubin NVL72 platform, aimed at maximizing throughput in agentic AI workloads. By combining new precision formats like NVFP4, wide expert parallelism, and the Dynamo distributed serving layer, the system treats memory as a unified, tiered resource across GPUs, host CPUs, and specialized storage.
OpenAI has introduced two new models, GPT-Image-2.6 Sunburst and Flare, designed for advanced image generation and editing. These models add support for complex tasks including SVG rendering and animated GIF creation.
NVIDIA has launched CUDA 13.5, reaching general availability for its new Vera Rubin GPU architecture. This update introduces significant enhancements to multi-process service (MPS) resource scheduling, locality domain partitioning, and deeper integration with SIMT libraries via CUDA Tile.
Dharma-AI has introduced a 2-billion-parameter model specialized in extracting structured JSON fields from various documents. It supports both open extraction and schema-directed modes, consistently outperforming frontier LLMs on field-level F1 benchmarks while significantly reducing operational costs.
Moonshot AI has introduced Kimi-K3.1-Pro, an open-weight, natively multimodal model with 2.8 trillion parameters. It features a 1-million-token context window, uses a Mixture-of-Experts (MoE) architecture, and is specifically optimized for agentic workflows and long-horizon tasks.
Cohere has integrated its state-of-the-art Embed 5 and Rerank 5 retrieval models into the OpenRouter API. This update allows developers to build RAG pipelines using a single API key and billing source without needing additional SDKs.
xAI has discontinued the grok-imagine-image-quality and grok-imagine-image-pro models. Requests are now automatically routed to the new grok-imagine-image-2.0-low model, which offers a lower price per generated image.
Google reports that per-token pricing is no longer the best metric for production economics; instead, teams should focus on cost per successful task. By using a lightweight 'noul' classifier, agents can route simple queries to high-speed models like Flash-Lite and only escalate complex logic to more advanced configurations, achieving significant savings without sacrificing accuracy.
Researchers have introduced MEMENTO, a specialized agentic framework built on Qwen3-8B designed to manage long context by compacting history into concise notes. By utilizing fine-tuning on synthetic trajectories followed by reinforcement learning, it achieves high accuracy on book-level tasks while strictly limiting context usage to 20K tokens, even for inputs as large as 2.5 million tokens.
The new message threads feature in beta allows developers to keep conversation state on the server. By sending only incremental updates instead of the full history, you can achieve faster response times in complex agentic loops.
NVIDIA has introduced Cosmos, a platform offering world foundation models and development tools specifically designed for physical AI applications, such as robotics and autonomous vehicles. The framework includes modular training recipes and NIM microservices for GPU-accelerated inference, enabling the generation of synchronized video and LiDAR observations.
Amazon has published a workflow for using Sequence-Level Knowledge Distillation (SeqKD) to fine-tune smaller models on trajectories generated by frontier models. By using a 'teacher' model to generate successful tool-use trajectories and filtering them with a programmatic scorer, teams can train compact 'student' models that perform complex reasoning at a fraction of the cost.
Anthropic has announced the deprecation of the fast mode for the Claude Opus 4.8 model. Support for this mode will be completely removed on November 30, 2026, after which requests will result in an error.
NVIDIA has released a new command-line interface for the TensorRT Edge-LLM runtime, allowing developers to quickly prototype and test AI models on the DGX Spark 64GB workstation. The tool chain facilitates local model serving and supports DSpark speculative decoding to boost generation performance on edge-constrained hardware.
The first-party Claude API now supports larger data submissions through its Messages and Token Counting endpoints. Developers can now send requests up to 128 MB, a substantial upgrade from the previous 32 MB cap.
NVIDIA has introduced Nemotron 3.5 Super VL, a 120B-parameter multimodal model featuring a 1M token context window. The model utilizes a hybrid Mamba-2 and MoE architecture to balance reasoning capabilities with efficient inference, and is now available for deployment on Amazon EKS and SageMaker HyperPod.