Effective automation depends on how your workflows handle API constraints. This guide distinguishes between rate limiting (hard caps leading to 429 errors) and throttling (delaying requests), providing strategies like exponential backoff, jitter, and proactive batching to maintain reliability.
NVIDIA introduced NemoClaw, an open blueprint framework designed to combine agent harnesses with optimized Nemotron models and secure runtimes. It enables developers to deploy agents that are governed by strict security policies while maintaining high performance on owned infrastructure.
Researchers have proposed 'Artifact Distillation,' a method where frontier models externalize their reasoning into an 'artifact bank.' Smaller models query this bank at inference time to improve performance without requiring expensive model retraining or gradient updates.
Google has transitioned its Computer Use tool to general availability within the Gemini API ecosystem. This feature allows models to interact with computer interfaces to perform tasks, now supported for production use across Interactions and GenerateContent APIs.
Recent research demonstrates that current security monitors often fail by confusing injection exposure with an agent's actual commitment to perform an unsafe action. The author proposes a double-stratified evaluation method that separates exposure from behavior, significantly improving the ability to predict unsafe tool calls up to two steps in advance.
The first-party Claude API now supports larger data submissions through its Messages and Token Counting endpoints. Developers can now send requests up to 128 MB, a substantial upgrade from the previous 32 MB cap.
Anthropic has launched a beta Usage and Cost Analytics API, allowing organizations to track token usage and expenditure with greater precision. The new tool provides filtering and grouping capabilities across models, workspaces, API keys, and individual service accounts.
MoEngage successfully integrated over 400 internal REST APIs as agent tools using Amazon Bedrock AgentCore Gateway. This approach eliminated the need for manual MCP server maintenance, complex networking, and security risks associated with public internet exposure.
NVIDIA has introduced Nemotron 3.5 Super VL, a 120B-parameter multimodal model featuring a 1M token context window. The model utilizes a hybrid Mamba-2 and MoE architecture to balance reasoning capabilities with efficient inference, and is now available for deployment on Amazon EKS and SageMaker HyperPod.
IBM has released Granite Switch 4.1.1, a patch update for its modular language model architecture. The update introduces an improved multilingual speech-to-text model and a refined Decision adapter, all achieved without retraining the base model.
Microsoft reports a 15-fold growth in AI agents within the M365 ecosystem over the past year, prompting new requirements for CISO-led security frameworks. The focus is shifting toward implementing granular identity controls and deep observability to prevent risks from unmanaged AI autonomy.
Google released a new Agents CLI evaluation namespace designed to help developers perform 'hill-climbing'—an iterative process of improving agent performance through testing, grading, and analysis. The tool enables regression tracking by comparing agent traces across model swaps or prompt changes, surfacing issues like tool-use regressions that standard unit tests miss.
Google has announced Gemini 4 Carbon, a new high-performance model designed for complex engineering and cybersecurity. The model excels in vulnerability detection, secure patching, and long-horizon reasoning, while introducing improved alignment and prompt-injection resistance.
AssemblyAI has released AssemblyAI-TTS-1, a text-to-speech model built for voice agents. It features sub-100ms latency, 4,000+ available voices, and instant voice cloning, priced at $15 per 1M characters without concurrency limits.
Researchers have proposed LOTUS, a framework for hallucination detection that uses multilinear low-rank decomposition to extract signals from hidden LLM layers. By analyzing peak activations and cross-layer patterns, the method identifies incorrect responses more effectively than existing pooling-based techniques.
Developers can now enforce specific content safety guidelines directly within API requests to the Grok models. By adding a guidelines array to Chat Completions or Responses requests, you can control the handling of NSFW, violence, and profanity categories.
NVIDIA released CUDA 13.4, adding hardware-transparent memory boundary enforcement for GPU sharing. Paired with the new open-source GPU Fractioning Operator and KAI Scheduler v0.18.0, teams can now define specific memory requests, burst limits, and compute modes directly in Kubernetes Pod annotations.
Google Project Zero analyzed how LLM-based systems (BigSleep) compare to traditional generative fuzzers (Fuzzilli) in finding V8 JavaScript engine vulnerabilities. Over six months, both methods independently discovered unique bugs, with an estimated overlap of approximately 25-60%.
LiquidAI has launched LFM3, a new generation of small foundation models built on a shared 2B-parameter backbone. The series includes text, vision, audio, and omni models designed for high-efficiency on-device deployment.
NVIDIA has released 'Nemotron-Personas' datasets for France and Belgium, designed to improve LLM accuracy regarding regional procedures, demographics, and cultural nuances. The update provides a complete post-training workflow—including data generation, LoRA fine-tuning via NVIDIA NeMo, and evaluation—to help developers transition from generic models to domain-specific agents.
Google DeepMind introduced Genie 4, a multimodal world model that enables real-time interactive simulations. It natively generates video, ambient audio, and responsive dialogue, utilizing Gemini 3.8 Flash to maintain physical consistency and handle multi-step reasoning.
Google has updated its A2UI generative UI protocol to include swappable inference formats, addressing latency and reliability issues found in the previous Direct JSON approach. A new format, A2UI Express, reduces token usage by up to 3x and latency by up to 3x by using a concise Python-like syntax.
Google has launched Gemini Robotics Embodied Reasoning 2 (ER 2) in public preview on the Gemini platform. This model acts as a high-level cognitive layer for robotics, capable of planning, self-correcting tasks, and managing multi-robot systems via natural language instructions.