AI & ML
Learning Object-Centric Spatial Reasoning for Sequential Manipulation in Cluttered Environments
arXiv cs.RO0 views
arXiv:2603.02511v2 Announce Type: replace Abstract: Sequential manipulation in clutter requires selecting which objects to remove and determining how to manipulate them. Learning both decisions jointly can complicate training and make failures difficult to diagnose. We present Unveiler, a modular framework that separates scene reasoning and object selection from action execution through a discrete object-index interface. Its Spatial Relationship Encoder (SRE) selects the best object to grasp, while a separate Action Decoder generates orientation-discretized push-grasp actions. The SRE is trained in two stages: imitation learning from heuristic demonstrations, followed by search-based policy improvement using simulated object removals. This training procedure requires no real-robot training data and allows the SRE to be paired with a different execution policy. We evaluate Unveiler in PyBullet simulation and on a physical Dofbot-Pro. In real-robot experiments, it retrieves two occluded targets in the prescribed order in 90\% of scenes, compared with 20-30\% for the heuristic, GPT-4o, and the imitation-only variant. In PyBullet, Unveiler achieves the highest task-completion rate across all six clutter-density and occlusion conditions, reaching 90.0\% under full occlusion with 6-9 objects, compared with 67.5\% for the heuristic and 60.0\% for ThinkGrasp. These results demonstrate the potential of modular, object-centric spatial reasoning for sequential manipulation in clutter.
Source:https://arxiv.org/abs/2603.02511PreviousAn Autonomous Sea Turtle Robot that Follows Marine AnimalsNextRoboForge: Cross-space Motion Refinement for Physically Executable Humanoid Whole-body Tracking
Related posts
ChatGPT Helped Me Complain About ChatGPT. The Irony Wasn't Lost on Me.
0HackerNoon
Inside North Korea’s Crypto Theft Machine: Hackers, Launderers, and Billions in Stolen Funds
0HackerNoon
EC-Council Releases ADG 2.0 and Offers Free AI Governance Crosswalks to Governments Worldwide
0HackerNoon
The Boutique PR Firm Is Having Its Moment
0HackerNoon
Blockchain Was Raised in the 2008 Financial Crisis. Now It’s Respawning It
0HackerNoon
Why Anthropic's Claude Turned to Blackmail in AI Safety Tests
0HackerNoon