Amazon has released a reference architecture that integrates the NVIDIA NeMo Switchyard library with LiteLLM to dynamically route coding agent requests between different models on Bedrock. By using stage or random routing, you can shift traffic between high-capability and high-efficiency models to balance performance and cost.
Amazon has added OpenFold3-preview to SageMaker JumpStart, allowing users to deploy models for predicting 3D structures of proteins, DNA, RNA, and ligands. The implementation utilizes asynchronous inference endpoints to handle long-running predictions while supporting cost-efficient autoscaling and scale-to-zero capabilities.
NVIDIA has released the cuda.bindings.cudla module, enabling direct Python-based management of the Deep Learning Accelerator (DLA) on Jetson AGX Orin. Developers can now orchestrate hybrid workflows where GPU preprocessing and DLA inference share a single CUDA stream.
NVIDIA has launched v0.2 of the SOMA Retargeter, an open-source tool designed to adapt human motion data for humanoid robot platforms. It processes motion sources—such as mocap, video reconstruction, or generative models—and aligns them with specific robot anatomy using inverse kinematics.
NVIDIA has released a technical workflow for serving the 753B parameter GLM-5.3 MoE model across two GB300-equipped DGX Stations. By utilizing tensor parallelism (TP=2) over RDMA connections and vLLM, you can overcome single-GPU memory constraints (252 GB HBM3e) for massive frontier-scale models.
The llama.cpp project has officially reached its 1.0.0 milestone, three and a half years after its inception. The release introduces strict semantic versioning to ensure better predictability for developers relying on its C/C++ libraries, libllama and libggml.
DeepSeek has moved beyond basic model inference by exposing its full application-level toolkit to API users. Developers can now enable parameters for web search, URL reading, file parsing, and safety filtering directly in chat completions, or utilize standalone ASR, TTS, and OCR endpoints.
Amazon has released SGLang-Neuron, a plugin allowing developers to run large-scale AI models on AWS Trainium hardware using the standard SGLang interface. This integration enables native PyTorch execution and supports advanced features like PD disaggregation over EFA for optimized serving.
Google has demonstrated a workflow where Gemini 4 Argon analyzes Go assembly to generate Z3 constraint solver rules. This approach catches runtime panic bugs that standard fuzzing tests often miss due to the Go runtime's handling of slice capacity.
IBM has introduced LLMON (LLM Object Notation), an XML-like markup language that uses reserved special tokens to explicitly label components like instructions, data, and constraints. Two experimental models, Granite 4.1 3B and 8B LLMON-preview, are now available, demonstrating near-zero success rates for indirect prompt injection attacks.
Google has introduced Gemini 4 Hydrogen, a new model optimized for rapid, cost-effective execution in agentic and coding environments. It features a 1-million-token context window and variable 'thinking' levels, allowing developers to balance reasoning depth, latency, and cost.
Amazon now offers a direct Web Search API for Bedrock AgentCore, enabling developers to perform web searches via standard AWS SDKs and CLI. This bypasses the need for the AgentCore Gateway, simplifying the process for custom agent loops and non-agent applications that require real-time information.
Google has introduced the Gemini Decisions API, powered by the new gemini-decision-1 model. Unlike standard generative models, this tool performs single-pass classification and scoring across text, audio, image, video, and PDF inputs, returning confidence scores instead of text.
Tether AI Research has introduced BotPsy, a 0.8B-parameter language model optimized for agentic workflows and function calling. Built on Qwen3.5-0.8B, the model is designed for on-device deployment, offering superior tool-use reliability and instruction following while maintaining data privacy.
Moonshot AI has introduced Kimi K3.1 Pro Highspeed, a new model on Amazon Bedrock optimized for long-horizon agentic tasks and coding. The model delivers 2–3 times faster output than the standard version and includes configurable reasoning, tool calling, and support for explicit prompt caching to optimize costs.
Amazon introduced Mitra-v2, a tabular foundation model trained entirely on synthetic data. This version improves upon its predecessor by scaling the pretraining data size and introducing a hybrid structural causal model prior to better reflect real-world data relationships.
MiniMax has launched MiniMax-H3-Image-PE, a fine-tuned version of the Qwen3.8-27B model designed to transform brief text prompts into highly detailed descriptions for image generation. The release includes specific workflows for text-to-image expansion and early-stage support for image editing prompts.
Anthropic has updated its specialized LLM lineup with version 5.2. Claude Fable 5.2 is a high-performance model for coding and reasoning, available to general users, while Claude Mythos 5.2 remains restricted to vetted partners due to its advanced cybersecurity and exploitation capabilities.
n8n has integrated Google's latest model, Gemini 4 Carbon, designed specifically for complex automation, cybersecurity tasks, and enhanced agent reliability. The model introduces significant improvements in handling long-running multi-step workflows and demonstrates robust defense against prompt injection attacks.
Google has released Gemini 4 Carbon, a new frontier model built for complex, multi-step reasoning, software engineering, and high-stakes cybersecurity tasks. Available now via API and in Google Antigravity, it features improved performance in agentic loops and production economics.
Google has updated its open-source JAX training framework, MaxText, to support training LLMs at extreme sequence lengths on Cloud TPU hardware. By introducing four distinct context-parallelism strategies, the update enables efficient training of models with up to 14 million tokens, overcoming memory and compute bottlenecks.
Amazon has expanded the capabilities of the AgenticRetrieveStream API, allowing developers to specify the iteration level for knowledge base requests. You can now choose between zero, one, or multiple retrieval steps to balance speed, cost, and complexity per request.
Anthropic has launched Claude Fable 5.2 and Claude Mythos 5.2, models designed for long-horizon agentic tasks and advanced reasoning. The update features a price decrease and an optional 'fast mode' to boost throughput. Developers must note new prefix checks, computer tool updates, and specific advisor model constraints.