← 返回时间线

paper

Acting Through Registers

arXiv ↗
ID
2610.17638
分类
—
首次捕获
2026-10-15
状态
unread
作者
Yiwei Zhang, Yantai Yang, Jin Gao, Jin Lou, Andong Chen, Yufei Liu, Boyang Xing, Yuchen Zhu, Weiming Hu, Zhipeng Zhang
信号
🔥 2

信号历史

  • 2026-10-15HF Daily Papers · 🔥2
暂无信号数据

摘要

World Action Models (WAMs) use generative visual representations to condition robot actions, yet how these representations organize action-relevant information remains poorly understood. We identify persistent high-norm spatial outliers in WAM representations and find that their action relevance persists even after normalization and K/V projection attenuate their extreme magnitude. Motivated by this observation, we introduce RegisterWAM, which adds learnable non-spatial registers to the world model and uses them directly for action conditioning. Registers alone do not fully eliminate spatial outliers; pairing them with observation flow-matching (FM) loss supervision suppresses spatial outliers while concentrating high-norm responses in registers. Beyond this reorganization, observation FM loss supervision also improves action learning without registers, motivating an additional noised-observation FM objective that learns current-scene recovery from corrupted inputs. The resulting model achieves 81.64\% success on LIBERO-Plus without additional embodied pretraining data or foundation models, reaches 93.0\% average success on RoboTwin 2.0, and improves real-world manipulation performance.

我的笔记

还没有笔记。

在 GitHub 上写笔记 ↗(新建 content/notes/2610.17638.md,PR 合并后本页自动更新)