← 返回时间线

paper

Inherited, Not Invented: Tracing the Provenance of Wait in Reasoning Models

arXiv ↗
ID
2610.30882
分类
—
首次捕获
2026-10-23
状态
unread
作者
Zhizhuo Kou, Sizai Hou, Long Chen, Jian Yang, Junyu Luo, Jingshu Peng, Wenkai Zhang, Sirui Han, Yike Guo
信号
🔥 13

信号历史

  • 2026-10-23HF Daily Papers · 🔥5
  • 2026-10-24HF Daily Papers · 🔥7
  • 2026-10-25HF Daily Papers · 🔥13
暂无信号数据

摘要

Reinforcement learning (RL) is credited with teaching reasoning models to write {wait} before reconsidering a step, yet large RL accuracy gains do not require the word. This view can confuse what RL discovers with what a model inherits from its training data. We trace the word through open models' training histories, reading it with label-free indices of frequency, position, form and usage and an injected-error test, all computed from sampled outputs. We find that zero-RL almost never coins the marker: on bases that lack the word, RL raises MATH-500 accuracy substantially while {wait} stays near absent. It arrives with training data: mid-training in OLMo-3, and fine-tuning on reasoning traces installs it in most models whose base lacks it. Where the base already uses it, both released RL-Zero recipes (OLMo-3, MiMo) multiply it, whereas KL-free GRPO from the same base does not; OLMo-3's recipe wears down its form and makes it a more sensitive but more liberal alarm; RL after supervised fine-tuning barely changes it, and our GRPO recipe erases a marker seeded by fine-tuning. Finally, we show that marker frequency alone does not indicate RL-induced reasoning and caution against LLM-as-a-judge revision metrics, as automated judges can reverse human-labelled trends.

我的笔记

还没有笔记。

在 GitHub 上写笔记 ↗(新建 content/notes/2610.30882.md,PR 合并后本页自动更新)