← 返回时间线

paper

Why Pay for Long Reasoning When Rewrite Do Trick? Causal Effects of Reasoning History Compaction on Future Generation and Agent Cost

arXiv ↗
ID
2611.03852
分类
—
首次捕获
2026-11-06
状态
unread
作者
Anton Hristov
信号
🔥 5

信号历史

  • 2026-11-06HF Daily Papers · 🔥4
  • 2026-11-07HF Daily Papers · 🔥5
暂无信号数据

摘要

Reasoning substantially improves language models' ability to solve difficult problems, but long reasoning traces make these gains expensive. Efficient reasoning should express useful analysis in fewer tokens by reducing repetition and text that adds little value to solving the problem. Progress in proprietary models motivates this goal, yet their hidden scratchpads limit direct study of how it is achieved. We investigate whether open-weight models can generate less verbose reasoning by changing the form of their own earlier thoughts, without retraining. Our intervention rewrites prior reasoning into compact state records before pending tool results are revealed, then compares continuations from original and compact histories. Across the tested models, accepted compact histories usually shorten future reasoning; a coding case study also shows less repeated verification after a shared candidate solution. In software-agent deployments, compaction can reduce total spending, although task quality and rewrite-inclusive time depend on the target and compressor. These findings identify reasoning history as one way to reduce future reasoning-token use and motivate model-specific compaction policies evaluated for both efficiency and retained capability.

我的笔记

还没有笔记。

在 GitHub 上写笔记 ↗(新建 content/notes/2611.03852.md,PR 合并后本页自动更新)