Effective automation depends on how your workflows handle API constraints. This guide distinguishes between rate limiting (hard caps leading to 429 errors) and throttling (delaying requests), providing strategies like exponential backoff, jitter, and proactive batching to maintain reliability.
Google has transitioned its Computer Use tool to general availability within the Gemini API ecosystem. This feature allows models to interact with computer interfaces to perform tasks, now supported for production use across Interactions and GenerateContent APIs.
AssemblyAI has introduced Universal-3 Pro, a specialized speech-to-text model that allows developers to provide instructions directly to the transcription process. It supports verbatim and clean transcription, custom audio event tagging, and handles code-switching between six languages.
The first-party Claude API now supports larger data submissions through its Messages and Token Counting endpoints. Developers can now send requests up to 128 MB, a substantial upgrade from the previous 32 MB cap.
Anthropic has launched a beta Usage and Cost Analytics API, allowing organizations to track token usage and expenditure with greater precision. The new tool provides filtering and grouping capabilities across models, workspaces, API keys, and individual service accounts.
MoEngage successfully integrated over 400 internal REST APIs as agent tools using Amazon Bedrock AgentCore Gateway. This approach eliminated the need for manual MCP server maintenance, complex networking, and security risks associated with public internet exposure.
Developers can now enforce specific content safety guidelines directly within API requests to the Grok models. By adding a guidelines array to Chat Completions or Responses requests, you can control the handling of NSFW, violence, and profanity categories.
Google has introduced Gemini Omni, a new video-generation model capable of creating and editing clips from text and image prompts. The model is now the default for Google's video workflows, while the previous Veo model has been deprecated in the API.
OpenAI's Responses API now supports a 12-hour prompt cache option, keeping shared instructions, tools and context cached for longer so repeated requests hours apart can still benefit from cheaper cached-input pricing. Writing to this longer cache costs 2.5x the standard input token price. This is an optional setting alongside the existing shorter default cache.
OpenAI has rolled out prompt-to-voice access to all GPT-Live API customers, allowing a spoken voice to be designed simply by describing it in text, either through the API or the voice Playground, and then reused inside live voice sessions. Designing the voice costs nothing, but speaking with it still runs on normal GPT-Live session billing. Alongside this rollout, nine additional built-in voices covering German, French, Hindi, Japanese and Korean were added to the platform.
Anthropic has introduced a beta option on its Claude Platform that allows a Managed Agents agent to construct its own workflow for large, multi-part jobs, such as going through hundreds of documents. Instead of handling everything in one pass, the agent splits the task into phases, delegates pieces across multiple sub-agents, and merges their output into a single result. The job is handed off to the server, which executes it asynchronously and reports progress through a stream of events.
Google has released the Developer Knowledge API, a structured, machine-readable source for Google Cloud, Firebase and Android documentation aimed at AI agents and developer tooling. Instead of scraping web pages or relying on an LLM's training cutoff, agents and CLIs can now query fresh, Markdown-formatted docs through several interfaces: a gcloud CLI surface, an installable agent skill, client libraries, and a browser-based API explorer. The underlying index is refreshed frequently so retrieved answers stay close to the latest published documentation.
Anthropic has launched Claude Haiku 5.5 (claude-haiku-5-5), positioned as its most capable Haiku model for high-volume, latency-sensitive work. It supports a 1 million token context window, up to 128k max output tokens, and adaptive thinking controlled via a new effort parameter. The model is available on the Claude API, Amazon Bedrock, Claude Platform on AWS, Google Cloud, and Microsoft Foundry. Anthropic warns that code written for the previous Haiku 4.5 model may break on the new version.