Backend
Sampling-based Kinodynamic Planning with World Models
arXiv cs.RO0 views
arXiv:2610.12910v1 Announce Type: new Abstract: Visual world models predict the consequences of actions from images, but planning with them is typically done by optimizers such as CEM and MPPI. However, these optimizers stall on long-horizon tasks where progress requires motion the objective does not reward, such as moving around a block before pushing it. This paper revisits kinodynamic sampling-based motion planning for world models, using the learned model as the propagator of a tree search in latent space. Our key insight is that the sampling strategies devised for high-dimensional search in configuration space apply directly to the latent space of a world model, where they rapidly expand through intermediate states that myopic optimizers never sample. We present two exploration strategies for the high-dimensional latent space, nearest-neighbor-guided RRT and projection-based KPIECE, with GPU-native batched expansion for efficient device utilization. We evaluate with an off-the-shelf DINO-WM on four simulated domains and a real-world block-pushing task. Our approaches match or exceed the success rate of CEM and MPPI at up to 13.8x lower planning time in simulation, and improve the success rate by 20% on the real robot.
Source:https://arxiv.org/abs/2610.12910PreviousLeapBot-JAC: Joint Action Chains for World Action ModelsNextEvo-World: A Lightweight Vision-Language-Action Model with Future Motion Prediction via Optical-Flow Supervision
Related posts
03/04/2026: Why Date Formats Put Calendar Events in the Wrong Week
0dev.to UX

Export WooCommerce Products to CSV in 2026: Real Data From 4 Stores, No Plugin
0dev.to Data
AI models now find, exploit and patch bugs: what Gemini 4 Carbon means for defenders
0dev.to News
Goldman Walls Off AI for Its Own Dealers
0dev.to News
Which UK Bookshop Is Supplying Sally Rooney Novels After Faber Stopped Distribution?
0dev.to News
Before Hiring a Landscape Designer: 12 Things Every Homeowner Should Know
0dev.to Design