Skip to content
Tuesday, 13 October 2026
Tenesys AI News
Subscribe
Research· 🧪 Worth Testing

Apple researchers propose self-deciding context compaction for long-running AI agents

In short: Apple ML researchers published a NeurIPS paper introducing SELFCOMPACT, a scaffold that lets language model agents decide for themselves when and how to compact their own accumulated context, rather than relying on fixed-interval summarization triggered by a token count. It combines a compaction tool the model can call with a lightweight rubric telling it when to fire (a sub-task is resolved) and when to hold off (mid-derivation or stuck). Tested on six benchmarks and seven models, it matched or beat fixed-interval summarization while using far fewer tokens.

Source: Apple Machine LearningAppleOriginal article ↗

This summary was generated automatically by AI from Apple Machine Learning's publication. It is our own text, not a copy of the original — facts, figures and quotes belong to the source, linked above and below.

What changed?

  • 1Introduces a model-invoked compaction tool plus a rubric for when to summarize vs. hold off
  • 2Tested on six benchmarks (competitive math and agentic search) across seven models
  • 3No fine-tuning or external supervision required
  • 4Up to 18.1 points improvement over no-summarization baseline on math, 5-9 points on agentic search
  • 530-70% lower per-question cost than fixed-interval compaction

Why it matters

Agents that do long chains of tool calls and reasoning (search, multi-step workflows, call analysis) regularly hit context-window limits and burn tokens on stale history; a smarter, trajectory-aware compaction strategy can cut cost while preserving accuracy, which matters for anyone running agentic pipelines at scale.

What it means for AI agents and contact centers

For teams building voice AI agents and contact-center automation with tool/function calling and MCP, context bloat during long multi-turn calls or multi-step workflows is a real cost and latency issue; this rubric-based compaction approach is worth evaluating against current fixed-interval summarization to see if it reduces token cost and preserves task accuracy in long call-handling or analytics agents.

🧪 Worth Testing

The technique directly targets long-running tool-calling agents, a core building block for voice AI and automation pipelines, and reports meaningful cost reductions without retraining, making it low-risk to trial on existing agent scaffolds.

SELFCOMPACT· New

Sources

  • Apple Machine LearningOfficialPrimary source
    „Self-Compacting Language Model Agents“
    12 Oct 2026, 03:00
    Original article →
Published by source
12 Oct 2026, 03:00
Found by our system
13 Oct 2026, 02:11
Summary generated
13 Oct 2026, 02:12

This article was written by AI from the original source. Facts, numbers and prices come from the source; missing values are marked “Not specified”. Legal notice, copyright and privacy

Apple researchers propose self-deciding context compaction for long-running AI agents · TENESYS AI NEWS