AI & ML
ReAT: Residual Action Tokenization for Autoregressive Robot Policies
arXiv cs.RO0 views
arXiv:2610.13093v1 Announce Type: new Abstract: Autoregressive robot policies rely on action tokenizers to convert continuous action chunks into compact sequences of discrete prediction targets. Existing tokenizers can reconstruct action chunks from discrete codes, but often leave implicit what each individual token contributes to the reconstructed action. We introduce Residual Action Tokenization (ReAT), which gives each token an explicit role in refining the current action reconstruction. It uses the decoded reconstruction as feedback to construct the next token from the remaining action error. This closes the loop between encoding and decoding, making each new token responsive to the errors left by the actual decoded prefix. Across 19 manipulation tasks spanning three simulation benchmarks and real-world settings, 8-token ReAT policies outperform the evaluated baselines in task success; on LIBERO, even 4-token ReAT surpasses the evaluated 8-token action-tokenization baselines at half the token budget. These results suggest a path toward action tokenization that supports self-corrective policy learning, helping autoregressive policies learn to progressively refine their own action plans.
Source:https://arxiv.org/abs/2610.13093PreviousBelief-Overlap Partial Inversion: Object-Centric Flow Replanning for Humanoid Loco-ManipulationNextForward Dynamics Models
Related posts
LifeVal
0OpenAI Blog
Claude’s new rules against game cloning won’t stop the AI copying boom
0Ars Technica

OpenAI pitches data center power plants as a way to protect nearby areas
0The Verge

Anthropic clamps down on Claude’s AI video game clones
0The Verge
Readwise takes on Amazon’s Kindle and Goodreads with its new app for book lovers
0TechCrunch
Five regression tests for channel-aware AI reply drafts
0dev.to