Apple researchers propose self-deciding context compaction for long-running AI agents
In short: Apple ML researchers published a NeurIPS paper introducing SELFCOMPACT, a scaffold that lets language model agents decide for themselves when and how to compact their own accumulated context, rather than relying on fixed-interval summarization triggered by a token count. It combines a compaction tool the model can call with a lightweight rubric telling it when to fire (a sub-task is resolved) and when to hold off (mid-derivation or stuck). Tested on six benchmarks and seven models, it matched or beat fixed-interval summarization while using far fewer tokens.
This summary was generated automatically by AI from Apple Machine Learning's publication. It is our own text, not a copy of the original — facts, figures and quotes belong to the source, linked above and below.
What changed?
- 1Introduces a model-invoked compaction tool plus a rubric for when to summarize vs. hold off
- 2Tested on six benchmarks (competitive math and agentic search) across seven models
- 3No fine-tuning or external supervision required
- 4Up to 18.1 points improvement over no-summarization baseline on math, 5-9 points on agentic search
- 530-70% lower per-question cost than fixed-interval compaction
Why it matters
Agents that do long chains of tool calls and reasoning (search, multi-step workflows, call analysis) regularly hit context-window limits and burn tokens on stale history; a smarter, trajectory-aware compaction strategy can cut cost while preserving accuracy, which matters for anyone running agentic pipelines at scale.
What it means for AI agents and contact centers
For teams building voice AI agents and contact-center automation with tool/function calling and MCP, context bloat during long multi-turn calls or multi-step workflows is a real cost and latency issue; this rubric-based compaction approach is worth evaluating against current fixed-interval summarization to see if it reduces token cost and preserves task accuracy in long call-handling or analytics agents.
🧪 Worth Testing
The technique directly targets long-running tool-calling agents, a core building block for voice AI and automation pipelines, and reports meaningful cost reductions without retraining, making it low-risk to trial on existing agent scaffolds.
Sources
- Apple Machine LearningOfficialPrimary sourceOriginal article →„Self-Compacting Language Model Agents“12 Oct 2026, 03:00
- Published by source
- 12 Oct 2026, 03:00
- Found by our system
- 13 Oct 2026, 02:11
- Summary generated
- 13 Oct 2026, 02:12
This article was written by AI from the original source. Facts, numbers and prices come from the source; missing values are marked “Not specified”. Legal notice, copyright and privacy