Skip to content
Thursday, 19 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

#Fine-tuning — 10 articles ✕

Automation· Important· 🧪 Worth Testing

Amazon launches integrated AI data preparation tools for SageMaker

Amazon has introduced new AI-driven data preparation capabilities within SageMaker to streamline the creation and maintenance of high-quality training and evaluation datasets. These features include auto-labeling, synthetic data generation, and automated data quality checks, controllable via Python SDK or AI-ML coding agents.

AWS Machine Learning
Research· Important· 🧪 Worth Testing

Fine-tuning erodes model capability to abstain from answering

Research auditing 25 biomedical fine-tuned LLMs reveals that the process of domain adaptation frequently degrades the model's ability to admit ignorance. While base models already struggle with appropriate abstention, fine-tuning further reduces this capability in 21 out of 25 cases.

arXiv cs.CL
Models· Important· 🧪 Worth Testing

MEMENTO Enhances LLM Agent Long-Context Performance via Context Compaction

Researchers have introduced MEMENTO, a specialized agentic framework built on Qwen3-8B designed to manage long context by compacting history into concise notes. By utilizing fine-tuning on synthetic trajectories followed by reinforcement learning, it achieves high accuracy on book-level tasks while strictly limiting context usage to 20K tokens, even for inputs as large as 2.5 million tokens.

arXiv cs.CL
Models· Important· 🧪 Worth Testing

Cost-Efficient Agent Scaling via Knowledge Distillation on Amazon SageMaker

Amazon has published a workflow for using Sequence-Level Knowledge Distillation (SeqKD) to fine-tune smaller models on trajectories generated by frontier models. By using a 'teacher' model to generate successful tool-use trajectories and filtering them with a programmatic scorer, teams can train compact 'student' models that perform complex reasoning at a fraction of the cost.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

NVIDIA Introduces Persona-Based Fine-Tuning Workflow for Localized LLMs

NVIDIA has released 'Nemotron-Personas' datasets for France and Belgium, designed to improve LLM accuracy regarding regional procedures, demographics, and cultural nuances. The update provides a complete post-training workflow—including data generation, LoRA fine-tuning via NVIDIA NeMo, and evaluation—to help developers transition from generic models to domain-specific agents.

NVIDIA Developer
Research· Important· 🧪 Worth Testing

New Metric Improves Reliability of LLM Agents via Consistency Training

Researchers introduced Recursive Semantic Divergence (RSD), an unsupervised metric that measures and penalizes inconsistency in LLM agent trajectories. By applying RSD as a reward signal during fine-tuning, models exhibit significantly more stable behavior and higher success rates across tool-use benchmarks.

arXiv cs.CL
Agents· Important· 🧪 Worth Testing

AWS launches general availability of SageMaker AI training sessions for custom model fine-tuning

AWS announced general availability of training sessions within Amazon SageMaker AI serverless model customization. Teams can write their own post-training loops — including custom loss functions and reward signals for reinforcement learning — while SageMaker AI handles GPU allocation, distributed execution, fault recovery, and checkpoint storage. Supported techniques include SFT, DPO, RLVR, RLAIF, and multi-turn RL, and users can choose LoRA or full fine-tuning. The feature supports models including gpt-oss-20b, gemma-4-31B-it, Qwen3.6-27B, and Qwen3.8-27B, and billing is based on tokens processed, pausing while a user's reward function scores responses.

AWS Machine Learning
Cyber Security· Important· 🧪 Worth Testing

Google DeepMind and Singapore Deploy On-Device AI to Detect Social-Engineering Scams

Google DeepMind and Singapore's GovTech have launched an on-device scam detection model built on a fine-tuned Gemma model, aimed at catching social-engineering scams that now account for up to 80% of scam losses in Singapore. The model runs locally on smartphones, analyzing conversation patterns without sending data to the cloud, so it works even on end-to-end encrypted messaging platforms. It uses a two-stage pipeline: a lightweight classifier screens messages first, and a fine-tuned Gemma model confirms real threats before warning the user in real time.

Google DeepMind
Voice AI· Important· 🧪 Worth Testing

NVIDIA Publishes Fine-Tuning Recipe for Dialect-Specific Speech Recognition with Nemotron

NVIDIA released a detailed workflow for fine-tuning its Nemotron 3.5 ASR multilingual streaming model on Saudi Arabic dialects (Najdi and Hijazi). Using minimal data curation, replay mixing with FLEURS data, duration-based bucketing, and partial encoder unfreezing, they reduced word error rate on the target dialects from 55.05% to 29.96% while also slightly improving English and other Arabic performance. The post also covers decoding tweaks and speaker diarization extensions for multi-speaker transcription.

NVIDIA Developer