Amazon has released a reference architecture that integrates the NVIDIA NeMo Switchyard library with LiteLLM to dynamically route coding agent requests between different models on Bedrock. By using stage or random routing, you can shift traffic between high-capability and high-efficiency models to balance performance and cost.
Amazon has added OpenFold3-preview to SageMaker JumpStart, allowing users to deploy models for predicting 3D structures of proteins, DNA, RNA, and ligands. The implementation utilizes asynchronous inference endpoints to handle long-running predictions while supporting cost-efficient autoscaling and scale-to-zero capabilities.
NVIDIA has released a technical workflow for serving the 753B parameter GLM-5.3 MoE model across two GB300-equipped DGX Stations. By utilizing tensor parallelism (TP=2) over RDMA connections and vLLM, you can overcome single-GPU memory constraints (252 GB HBM3e) for massive frontier-scale models.
The llama.cpp project has officially reached its 1.0.0 milestone, three and a half years after its inception. The release introduces strict semantic versioning to ensure better predictability for developers relying on its C/C++ libraries, libllama and libggml.
DeepSeek has moved beyond basic model inference by exposing its full application-level toolkit to API users. Developers can now enable parameters for web search, URL reading, file parsing, and safety filtering directly in chat completions, or utilize standalone ASR, TTS, and OCR endpoints.
Amazon has released SGLang-Neuron, a plugin allowing developers to run large-scale AI models on AWS Trainium hardware using the standard SGLang interface. This integration enables native PyTorch execution and supports advanced features like PD disaggregation over EFA for optimized serving.
Google has introduced Gemini 4 Hydrogen, a new model optimized for rapid, cost-effective execution in agentic and coding environments. It features a 1-million-token context window and variable 'thinking' levels, allowing developers to balance reasoning depth, latency, and cost.
Amazon now offers a direct Web Search API for Bedrock AgentCore, enabling developers to perform web searches via standard AWS SDKs and CLI. This bypasses the need for the AgentCore Gateway, simplifying the process for custom agent loops and non-agent applications that require real-time information.
Google has introduced the Gemini Decisions API, powered by the new gemini-decision-1 model. Unlike standard generative models, this tool performs single-pass classification and scoring across text, audio, image, video, and PDF inputs, returning confidence scores instead of text.
Tether AI Research has introduced BotPsy, a 0.8B-parameter language model optimized for agentic workflows and function calling. Built on Qwen3.5-0.8B, the model is designed for on-device deployment, offering superior tool-use reliability and instruction following while maintaining data privacy.
Moonshot AI has introduced Kimi K3.1 Pro Highspeed, a new model on Amazon Bedrock optimized for long-horizon agentic tasks and coding. The model delivers 2–3 times faster output than the standard version and includes configurable reasoning, tool calling, and support for explicit prompt caching to optimize costs.
Amazon introduced Mitra-v2, a tabular foundation model trained entirely on synthetic data. This version improves upon its predecessor by scaling the pretraining data size and introducing a hybrid structural causal model prior to better reflect real-world data relationships.
Anthropic has updated its specialized LLM lineup with version 5.2. Claude Fable 5.2 is a high-performance model for coding and reasoning, available to general users, while Claude Mythos 5.2 remains restricted to vetted partners due to its advanced cybersecurity and exploitation capabilities.
Google has released Gemini 4 Carbon, a new frontier model built for complex, multi-step reasoning, software engineering, and high-stakes cybersecurity tasks. Available now via API and in Google Antigravity, it features improved performance in agentic loops and production economics.
Amazon has expanded the capabilities of the AgenticRetrieveStream API, allowing developers to specify the iteration level for knowledge base requests. You can now choose between zero, one, or multiple retrieval steps to balance speed, cost, and complexity per request.
Anthropic has launched Claude Fable 5.2 and Claude Mythos 5.2, models designed for long-horizon agentic tasks and advanced reasoning. The update features a price decrease and an optional 'fast mode' to boost throughput. Developers must note new prefix checks, computer tool updates, and specific advisor model constraints.
NVIDIA introduced four 16B parameter checkpoints within its Cosmos 3 Nano family, designed for interactive world simulation. These models enable developers to generate synthetic multi-sensor driving data, simulate robotic movements, and convert simulator controls into photorealistic video.
OpenAI has introduced GPT-6-Cyber, a new model variant tailored for identifying, reproducing, and patching security vulnerabilities. The release requires configuration of the Daybreak environment prior to implementation.
Google has launched Gemini Omni 1.2 Flash, a model update focused on video production. It extends native video generation to 15 seconds, improves object and character consistency, and introduces multi-turn conversational editing.
OpenAI has introduced two new models, GPT-Image-2.6 Sunburst and Flare, designed for advanced image generation and editing. These models add support for complex tasks including SVG rendering and animated GIF creation.
NVIDIA has launched CUDA 13.5, reaching general availability for its new Vera Rubin GPU architecture. This update introduces significant enhancements to multi-process service (MPS) resource scheduling, locality domain partitioning, and deeper integration with SIMT libraries via CUDA Tile.
Dharma-AI has introduced a 2-billion-parameter model specialized in extracting structured JSON fields from various documents. It supports both open extraction and schema-directed modes, consistently outperforming frontier LLMs on field-level F1 benchmarks while significantly reducing operational costs.
Moonshot AI has introduced Kimi-K3.1-Pro, an open-weight, natively multimodal model with 2.8 trillion parameters. It features a 1-million-token context window, uses a Mixture-of-Experts (MoE) architecture, and is specifically optimized for agentic workflows and long-horizon tasks.
Cohere has integrated its state-of-the-art Embed 5 and Rerank 5 retrieval models into the OpenRouter API. This update allows developers to build RAG pipelines using a single API key and billing source without needing additional SDKs.