AWS introduced the Social Messaging Agent Runtime Toolkit (SMART), an open-source SDK and Terraform stack designed to manage the complexities of WhatsApp integrations for AI agents built on Amazon Bedrock AgentCore. It handles authentication, media processing, conversation memory, and 24-hour message window constraints automatically.
Google has launched 'Tasks in Gemini,' a new capability allowing the assistant to perform background, multi-step actions. The update includes features for automated purchasing via virtual Google Pay cards, task management via SMS, email-based workflow automation, and 'Agentic Calling' for making phone inquiries and bookings.
AssemblyAI has introduced AssemblyAI-STT-3.7-Realtime-Agent, a speech-to-text model specifically designed for voice agent interaction. It aims to solve common issues in live telephony, such as distinguishing user speech from background noise and capturing critical data points like numbers at the end of a sentence.
AssemblyAI has launched the STT-3.7 model family, featuring dedicated versions for pre-recorded audio, live conversations, and voice agents. Additionally, the company introduced its first text-to-speech engine, AssemblyAI-TTS-1, optimized for high-speed, natural-sounding interactions.
Researchers have developed a method to adapt general-purpose, frozen LLMs into full-duplex voice systems using only 97 million trainable parameters and 30 GPU-hours of training. The system functions as a thinker-talker cascade with an 80 ms frame clock, allowing for realistic turn-taking, interruptions, and backchanneling without massive speech-data pretraining.
ElevenLabs introduced a major update to its platform at the NYC Summit, focusing on domain-specific model fine-tuning, an 'Interaction Engine' for intelligent model routing, and persistent agent memory. The company also launched 'Routines' for workflow automation and a new 'ElevenAI' app for enterprise meeting productivity.
Amazon has enabled usage-based software metering for bidirectional streaming models on SageMaker AI. Previously, software charges for long-running streaming sessions were difficult to capture, as they could not be reconciled with simple HTTP response headers. Model providers can now report usage incrementally via a dedicated metadata WebSocket connection.
Google has expanded its AI Edge Gallery with new on-device speech capabilities, enabling offline, low-latency transcription and synthesis. Developers can now integrate these high-performance models via Android's ML Kit or cross-platform MediaPipe Tasks, supporting over 100 languages with significant energy efficiency.
Cartesia has introduced two models for voice applications: Sonic (text-to-speech) and Ink (speech-to-text). Built on State Space Model (SSM) architecture, these models are designed for ultra-low-latency, real-time performance suitable for production voice agents.
AssemblyAI has introduced Universal-3 Pro, a specialized speech-to-text model that allows developers to provide instructions directly to the transcription process. It supports verbatim and clean transcription, custom audio event tagging, and handles code-switching between six languages.
AssemblyAI has released AssemblyAI-TTS-1, a text-to-speech model built for voice agents. It features sub-100ms latency, 4,000+ available voices, and instant voice cloning, priced at $15 per 1M characters without concurrency limits.
Audible has developed a controllable text-to-speech pipeline that uses LLMs to profile characters and attribute dialogue with up to 97% accuracy. By providing 'stage directions' as natural-language captions, the system ensures distinct, consistent character voices over long-form content.
Mistral AI released Voxtral 3, a set of speech recognition and speech synthesis models paired with an SDK that lets a single real-time pipeline listen, reason, call tools and speak back. The recognition models (Small, Mini and Realtime Transcribe 3) cover 50+ languages with speaker diarization, keyword-biasing for technical vocabulary, and transcription latency under 500ms, which Mistral claims beats Whisper, Scribe v2 and Gemini 3.5 Transcribe on its benchmarks. The speech synthesis model, Mini TTS 3, handles 35+ languages and 50+ dialects with emotion, pacing and emphasis that adapt to context, priced at $13 per million characters, and a separate Pro Voice feature can reproduce a person's voice and emotional range from just 30 minutes of recorded audio. All components can run through Mistral's EU-hosted API or be deployed on a customer's own servers.
OpenAI has rolled out prompt-to-voice access to all GPT-Live API customers, allowing a spoken voice to be designed simply by describing it in text, either through the API or the voice Playground, and then reused inside live voice sessions. Designing the voice costs nothing, but speaking with it still runs on normal GPT-Live session billing. Alongside this rollout, nine additional built-in voices covering German, French, Hindi, Japanese and Korean were added to the platform.
Anam, which builds photorealistic interactive avatars, switched to Deepgram's Flux speech-to-text model to solve turn-taking problems in unscripted, real-time conversation. In A/B testing against a self-hosted open-source STT option, Flux cut unwanted avatar barge-ins by roughly 50% with no added latency penalty, and complaints about turn-taking on English sessions dropped to near zero. Anam deployed Flux self-hosted on its own Kubernetes/H100 infrastructure, rolling it out to 100% of turnkey users after a two-week self-hosted deployment (versus days for Deepgram's hosted option).
Researchers describe a system called FlowSpec that converts a creditor's legal call procedure into machine-readable instructions, tool restrictions, training signals and test cases for a voice agent. A 9-billion-parameter model was trained on calls covering nearly 300 randomly generated procedures, then tested on four procedures it had never encountered, including one entirely held-out family of scripts, to see whether compliance behavior transfers.
xAI has rolled out Grok Voice 3.0, its latest speech-to-speech voice model, without changing pricing from the prior Grok Voice 2.0. Developers who reference the grok-voice-latest alias get the new model automatically, with no code changes needed. The API itself remains the same as before.
AssemblyAI launched a hosted deployment of the open-source Qwen3.5 4B model on its LLM Gateway, optimized specifically for rewriting raw speech-to-text output into clean, formatted text. On voice rewrite tasks like dictation cleanup and transcript formatting, the model averaged 612ms response time—1.9x faster than GPT-4.1—at 94% lower cost per hour of audio processed. The model is priced at $0.10/$0.50 per million tokens (prompt/completion) and supports only max_tokens, temperature, and stream parameters, with no tool calling.