Backend
Relational Geometry Forcing for World Action Models
arXiv cs.RO0 views
arXiv:2610.29282v1 Announce Type: new Abstract: World Action Models (WAMs) have shown strong potential for robot manipulation by jointly learning visual dynamics and executable actions. However, their video and action objectives do not explicitly constrain the 3D geometry that is crucial for precise manipulation. Recently, geometry-aware WAMs introduce depth or 4D prediction branches, whereas representation alignment methods supervise intermediate WAM features with pretrained 3D foundation models. Yet we find that such pointwise alignment benefits the video features but degrades action learning, since dense geometric feature targets overly restrict compact action features. To address this limitation, we propose Relational Geometry Forcing (RGF), which transfers geometric priors from a frozen 3D foundation model by aligning pairwise feature relations instead of pointwise features. Specifically, RGF applies three complementary relational objectives, where intra-frame and cross-view relations transfer scene geometry and multi-view correspondence to the video features, while action-temporal relations couple action dynamics to geometric scene evolution. Applied only during training, RGF requires no explicit geometry branch or extra inference module. Extensive experiments in simulation and the real world demonstrate the effectiveness of Relational Geometry Forcing, showing consistent gains across diverse manipulation scenarios and WAM paradigms.
Source:https://arxiv.org/abs/2610.29282PreviousTraining in Deployment: Human-in-the-loop Online Post-Training for Robot ManipulationNextCompressing Onboard Language Models for Space Robots under a Behavioral-Fidelity Requirement
Related posts
03/04/2026: Why Date Formats Put Calendar Events in the Wrong Week
0dev.to UX

Export WooCommerce Products to CSV in 2026: Real Data From 4 Stores, No Plugin
0dev.to Data
AI models now find, exploit and patch bugs: what Gemini 4 Carbon means for defenders
0dev.to News
Goldman Walls Off AI for Its Own Dealers
0dev.to News
Which UK Bookshop Is Supplying Sally Rooney Novels After Faber Stopped Distribution?
0dev.to News
Before Hiring a Landscape Designer: 12 Things Every Homeowner Should Know
0dev.to Design