Open Source
MolmoSpaces-CommonSense: Evaluating Commonsense in Robotic Manipulation Policies
arXiv cs.RO0 views
arXiv:2610.41377v1 Announce Type: new Abstract: Real-world robotic manipulation requires reasoning about cluttered scenes, partially observable or hidden objects, and semantically appropriate actions, in addition to low-level execution within those scenes. However, existing simulation benchmarks primarily test the latter and remain dominated by comparatively clean environments with limited clutter and narrowly scoped task structure, leaving many forms of commonsense reasoning untested. We address this by introducing a taxonomy of reasoning processes for robotic manipulation grounded in developmental cognitive science. We operationalize this taxonomy through a new benchmark of robot tasks, MolmoSpaces-CommonSense, that requires reasoning about occlusion, containment, support relations, semantically correct grasp points, spatial affordances, and hidden objects. These evaluations require policies not only to recognize relevant scene structure but also to execute correct actions in them. We evaluate several zero-shot generalist manipulation policies. Across model types and architectures, we observe consistent failures in commonsense reasoning: success rates in cluttered scenes drop by over 50% as distractors increase, policies act on incorrect objects in cluttered settings 30% of the time, and affordance-sensitive grasping remains unreliable even with highly specific language prompts, with correct object part selection happening only about 50% of the time. Further, VLM-based success estimation struggles to reliably evaluate rollouts in these settings, suggesting that the challenge extends beyond control to the broader perception-reasoning-action stack. Our results suggest that existing benchmarks may substantially overestimate zero-shot real-world readiness. Code and policy leaderboard link at https://github.com/allenai/molmospaces.
Source:https://arxiv.org/abs/2610.41377PreviousDiffWBC: Unlocking Steerable General Humanoid Motion Tracking via One-Step Diffusion Whole-Body ControlNextBioAgent: Self-Directed Skill Acquisition and Capability Growth for Long-Horizon Laboratory Protocols
Related posts
Distillation didn't help our small model until we took the labels away
0dev.to Machine Learning

462. Minimum Moves to Equal Array Elements II
0dev.to PHP
MUSBRIC: LEGO-Compatible Pneumatic Muscle Bricks for Reconfigurable Musculoskeletal Robots
0arXiv cs.RO
OpenFlyV2: An onboard vision-language-action model for aerial perception and navigation
0arXiv cs.RO
Show HN: Open Bot Avatars – a spec and renderer for interactive bot avatars
0Hacker News New
Show HN: Elections Archive: every election in the US, citable and open source
0Hacker News New