OpenAI has launched a public beta for the Responses API that allows you to select specific background processing windows. By opting for a two-hour or eight-hour completion window, your company can achieve substantial cost savings on token usage.
Amazon has released a reference architecture that integrates the NVIDIA NeMo Switchyard library with LiteLLM to dynamically route coding agent requests between different models on Bedrock. By using stage or random routing, you can shift traffic between high-capability and high-efficiency models to balance performance and cost.
DeepSeek has moved beyond basic model inference by exposing its full application-level toolkit to API users. Developers can now enable parameters for web search, URL reading, file parsing, and safety filtering directly in chat completions, or utilize standalone ASR, TTS, and OCR endpoints.
Google has introduced Gemini 4 Hydrogen, a new model optimized for rapid, cost-effective execution in agentic and coding environments. It features a 1-million-token context window and variable 'thinking' levels, allowing developers to balance reasoning depth, latency, and cost.
Amazon now offers a direct Web Search API for Bedrock AgentCore, enabling developers to perform web searches via standard AWS SDKs and CLI. This bypasses the need for the AgentCore Gateway, simplifying the process for custom agent loops and non-agent applications that require real-time information.
Tether AI Research has introduced BotPsy, a 0.8B-parameter language model optimized for agentic workflows and function calling. Built on Qwen3.5-0.8B, the model is designed for on-device deployment, offering superior tool-use reliability and instruction following while maintaining data privacy.
Moonshot AI has introduced Kimi K3.1 Pro Highspeed, a new model on Amazon Bedrock optimized for long-horizon agentic tasks and coding. The model delivers 2–3 times faster output than the standard version and includes configurable reasoning, tool calling, and support for explicit prompt caching to optimize costs.