Open Source
Predicted Futures Are Not Enough: Learning Executable Goals for Robot Manipulation
arXiv cs.RO0 views
arXiv:2610.09309v1 Announce Type: new Abstract: Generative world models provide rich predictions of how manipulation scenes may evolve toward task objectives, yet those futures do not directly expose the compact task variables required by control. When training supervises future prediction alone, terminal goal accuracy is not an explicit learning objective, even when geometric recovery is available. We present Entity-Level Goal Readout, a learned prediction-to-execution interface that makes the executable terminal goal an explicit output of a 3D trace world model. It combines object-centric pose prediction with translation grounded in observed depth to produce a compact goal in SE(3). A shared Pose-Native Executor consumes this fixed goal with online object-pose feedback for closed-loop control without rerunning the world model. Across five manipulation tasks, the pipeline achieves a mean success rate of 79.69%. Goal diagnostics directly measure terminal goal accuracy, while controlled translation perturbations characterize how execution degrades under goal error. Zero-shot deployment on a Franka arm achieves 73.33% success on nominal StackCube, 66.67% with distractors, and 75.00% on PickPlate with a target unseen during policy training. These results support treating the prediction-to-execution interface as an explicit learned component of world-model planning rather than incidental post-processing in the control pipeline itself. Project page: https://claire0730.github.io/executable-goals/
Source:https://arxiv.org/abs/2610.09309PreviousAdaptive Risk-Certified Event-Triggered Replanning for Dynamic NavigationNextClimbLab: MATLAB Simulation Platform for Legged Climbing Robotics
Related posts
ZeroBench: An Impossible Visual Benchmark
0Hacker News New
Leaflet 2.0 Beta
0Hacker News New
Repobs – A local dashboard to manage agent worktrees and branches
0Hacker News New
Show HN: One Roof – mission control for many coding agents. You stay in charge
0Hacker News Show
Show HN: A 20-line kernel that fixes float32 variance under XLA
0Hacker News Show

Introducing queue consumption mode for Apache Kafka in AWS Lambda
0AWS Compute Blog