Amazon has introduced new AI-driven data preparation capabilities within SageMaker to streamline the creation and maintenance of high-quality training and evaluation datasets. These features include auto-labeling, synthetic data generation, and automated data quality checks, controllable via Python SDK or AI-ML coding agents.
ElevenLabs introduced a major update to its platform at the NYC Summit, focusing on domain-specific model fine-tuning, an 'Interaction Engine' for intelligent model routing, and persistent agent memory. The company also launched 'Routines' for workflow automation and a new 'ElevenAI' app for enterprise meeting productivity.
Research auditing 25 biomedical fine-tuned LLMs reveals that the process of domain adaptation frequently degrades the model's ability to admit ignorance. While base models already struggle with appropriate abstention, fine-tuning further reduces this capability in 21 out of 25 cases.
Researchers have introduced MEMENTO, a specialized agentic framework built on Qwen3-8B designed to manage long context by compacting history into concise notes. By utilizing fine-tuning on synthetic trajectories followed by reinforcement learning, it achieves high accuracy on book-level tasks while strictly limiting context usage to 20K tokens, even for inputs as large as 2.5 million tokens.
Amazon has published a workflow for using Sequence-Level Knowledge Distillation (SeqKD) to fine-tune smaller models on trajectories generated by frontier models. By using a 'teacher' model to generate successful tool-use trajectories and filtering them with a programmatic scorer, teams can train compact 'student' models that perform complex reasoning at a fraction of the cost.
NVIDIA has released 'Nemotron-Personas' datasets for France and Belgium, designed to improve LLM accuracy regarding regional procedures, demographics, and cultural nuances. The update provides a complete post-training workflow—including data generation, LoRA fine-tuning via NVIDIA NeMo, and evaluation—to help developers transition from generic models to domain-specific agents.
Researchers introduced Recursive Semantic Divergence (RSD), an unsupervised metric that measures and penalizes inconsistency in LLM agent trajectories. By applying RSD as a reward signal during fine-tuning, models exhibit significantly more stable behavior and higher success rates across tool-use benchmarks.
AWS announced general availability of training sessions within Amazon SageMaker AI serverless model customization. Teams can write their own post-training loops — including custom loss functions and reward signals for reinforcement learning — while SageMaker AI handles GPU allocation, distributed execution, fault recovery, and checkpoint storage. Supported techniques include SFT, DPO, RLVR, RLAIF, and multi-turn RL, and users can choose LoRA or full fine-tuning. The feature supports models including gpt-oss-20b, gemma-4-31B-it, Qwen3.6-27B, and Qwen3.8-27B, and billing is based on tokens processed, pausing while a user's reward function scores responses.
Google DeepMind and Singapore's GovTech have launched an on-device scam detection model built on a fine-tuned Gemma model, aimed at catching social-engineering scams that now account for up to 80% of scam losses in Singapore. The model runs locally on smartphones, analyzing conversation patterns without sending data to the cloud, so it works even on end-to-end encrypted messaging platforms. It uses a two-stage pipeline: a lightweight classifier screens messages first, and a fine-tuned Gemma model confirms real threats before warning the user in real time.
NVIDIA released a detailed workflow for fine-tuning its Nemotron 3.5 ASR multilingual streaming model on Saudi Arabic dialects (Najdi and Hijazi). Using minimal data curation, replay mixing with FLEURS data, duration-based bucketing, and partial encoder unfreezing, they reduced word error rate on the target dialects from 55.05% to 29.96% while also slightly improving English and other Arabic performance. The post also covers decoding tweaks and speaker diarization extensions for multi-speaker transcription.