AI & ML
Beyond Reconstruction: What Matters in Action Tokenization for Robot Policies?
arXiv cs.RO0 views
arXiv:2610.09170v1 Announce Type: new Abstract: Autoregressive action-token policies such as vision-language-action models require action tokenizers to translate discrete token sequences into precise control actions in continuous space. Many action tokenizers learn the mapping between tokens and actions via a reconstruction objective. However, as we show through extensive analysis, sufficiently accurate action reconstruction is only one part of what makes a downstream robot policy successful. It is also critical that the policy is able to predict the right tokens for new observations, and that unseen policy token predictions still decode into reasonable actions. These properties are downstream of tokenizer training and are not directly incentivized by a reconstruction objective alone. In this work, we introduce Predictable and Robust Action Tokenization (ProAct), a tokenizer training method that strategically augments reconstruction with the goal of improving downstream predictability and robustness. ProAct is policy-agnostic and uses only action datasets for training. Across the Robomimic, LIBERO, and RoboTwin benchmarks and a diverse set of tokenizer architectures, ProAct improves rollout success by an average of 11.3 percentage points. These improvements also translate to vision-language-action policies and real-world robotic manipulation, yielding average gains of 21.8 and 36.7 percentage points, respectively. These results suggest that effective action tokenization should be designed as a policy interface that balances fidelity, predictability, and robustness, rather than as a reconstruction problem alone.
Source:https://arxiv.org/abs/2610.09170Previousgeodex: A Library for Motion Planning on Riemannian ManifoldsNextCAP: Codebook-Aligned Prediction for Tokenized Robot Policies
Related posts

Use it, or lose it 🧠
0dev.to AI

AI Daily Digest November 3, 2026: OpenAI Wires Agents into ServiceNow, Australia Books a 40,000-GPU AI Factory
0dev.to AI
How Publishers Can Test Engagement Signals to Improve On-Site Discovery
0dev.to AI
What Meta's Muse actually reads: first data from 3 tiny businesses
0dev.to WebDev
Your AI apps should answer to you, not to their lab
0dev.to Security

Warp's Breach Reached Agent Decision Logs. What One Agent Trace Actually Contains
0dev.to Security