Google has announced Gemini 4 Carbon, a new high-performance model designed for complex engineering and cybersecurity. The model excels in vulnerability detection, secure patching, and long-horizon reasoning, while introducing improved alignment and prompt-injection resistance.
Developers can now enforce specific content safety guidelines directly within API requests to the Grok models. By adding a guidelines array to Chat Completions or Responses requests, you can control the handling of NSFW, violence, and profanity categories.
NVIDIA released CUDA 13.4, adding hardware-transparent memory boundary enforcement for GPU sharing. Paired with the new open-source GPU Fractioning Operator and KAI Scheduler v0.18.0, teams can now define specific memory requests, burst limits, and compute modes directly in Kubernetes Pod annotations.
LiquidAI has launched LFM3, a new generation of small foundation models built on a shared 2B-parameter backbone. The series includes text, vision, audio, and omni models designed for high-efficiency on-device deployment.
NVIDIA has released 'Nemotron-Personas' datasets for France and Belgium, designed to improve LLM accuracy regarding regional procedures, demographics, and cultural nuances. The update provides a complete post-training workflow—including data generation, LoRA fine-tuning via NVIDIA NeMo, and evaluation—to help developers transition from generic models to domain-specific agents.
Google DeepMind introduced Genie 4, a multimodal world model that enables real-time interactive simulations. It natively generates video, ambient audio, and responsive dialogue, utilizing Gemini 3.8 Flash to maintain physical consistency and handle multi-step reasoning.
Google has updated its A2UI generative UI protocol to include swappable inference formats, addressing latency and reliability issues found in the previous Direct JSON approach. A new format, A2UI Express, reduces token usage by up to 3x and latency by up to 3x by using a concise Python-like syntax.
Google has launched Gemini Robotics Embodied Reasoning 2 (ER 2) in public preview on the Gemini platform. This model acts as a high-level cognitive layer for robotics, capable of planning, self-correcting tasks, and managing multi-robot systems via natural language instructions.
Researchers have introduced the Boa Compressor, an online tool utilizing a Mamba state-space model to compress long-form context into shorter representations in linear time. By distilling knowledge from full-context LLM interactions, this method allows for efficient per-query inference without the massive latency overhead of transformer-based compression.
OpenAI has officially released GPT-6.1 Terra, a new model specifically engineered to excel in visual reasoning, precise computer navigation, and natural language generation.
Amazon Bedrock now supports explicit and implicit prompt caching for OpenAI models, allowing you to store and reuse static prompt prefixes like tools, instructions, and conversation history. By avoiding the re-processing of identical tokens across turns, you can significantly lower input costs and improve responsiveness in complex agent workflows.
Google has updated the Gemini API to automatically store requests (store=true) for all new projects on the paid tier. This change aligns standard content generation methods with the Interactions API, requiring developers to manually opt out if they prefer not to store request data.
Amazon has released TorchNeuron, an open-source backend that lets existing PyTorch code run on AWS Trainium accelerators without major rewrites. The release introduces a new execution mode plus layered caching to reduce recompilation, and its reliability was validated through an AI-agent-driven testing pipeline that distilled hundreds of thousands of Hugging Face models down to a manageable benchmark set. Internal large-model tests reported roughly a 33% reduction in the delay before the first training step begins.
Z.ai's GLM 5.3 Flash, a multimodal 320B-parameter Mixture-of-Experts model with 18B active parameters, is now available through Mistral's platform. It offers a 1M-token context window and is built for developer agent workflows, visual coding, and complex tool-use tasks. Pricing is set at $0.15 per million input tokens, $0.03 per million cached input tokens, and $0.50 per million output tokens.
Cohere launched Rerank 5, its newest enterprise reranking models, in Pro and Fast tiers. Rerank 5 Pro leads major public benchmarks including BRIGHT, ViDoRe V3, BEIR and nanoMTEB, while Rerank 5 Fast offers near-leading quality at lower cost and higher throughput. The release introduces Context Focus, which returns the most relevant text spans within documents rather than whole documents, and calibrated relevance scores that read as probabilities across models and domains.
NVIDIA has added three new open, commercially licensed components to its Nemotron Retriever lineup: Embed models (8B and 1B, in BF16 and NVFP4) for searching text and images, a Rerank model (8B) that reorders retrieved evidence by relevance, and a compact 631M Parse model that converts document images into structured text. The goal is to feed AI agents with better, more relevant evidence so they need fewer search rounds and fewer inference tokens to answer a question. NVIDIA reports the new Embed and Rerank models top the ViDoRe v3.1 leaderboards for dense retrieval and reranking respectively.
AI research company i14 partnered with AWS to port its Laplace 3B model, a 24-layer architecture built on Gated Linear Attention (GLA) instead of standard transformer attention, onto AWS Trainium2 using native PyTorch (TorchNeuron Native). Rather than a KV cache that expands with every token, the model keeps a constant 29.5 MB recurrent state per sequence. On a single trn2.48xlarge instance, the team reached about 120,000 training tokens per second and served 11,544 output tokens per second across 1,280 simultaneous sequences through an unmodified vLLM engine.