Frontend
Reflex: Visually Grounded Reactive Humanoid Control
arXiv cs.RO0 views
arXiv:2610.12772v1 Announce Type: new Abstract: Humans effortlessly react to the world; they adeptly return a tennis shot, catch a falling cup, step aside from a passing cart, or pass a box tossed during truck unloading. These everyday actions require anticipating a moving target and reflexively responding with the whole body within about a second. Such visual reactive whole-body control remains challenging for humanoids, which must (1) coordinate whole-body control, (2) react to object dynamics in real time, and (3) ground perception in egocentric vision. We study catching thrown boxes as a representative task that demands all three capabilities; existing systems cover only part of it, relying on end-effectors, motion capture, or marked objects. We present Reflex, a three-stage framework that learns these capabilities stage by stage while connecting them through a compact representation of object dynamics. First, a state-based policy learns whole-body catching with reinforcement learning. Second, the policy learns to infer the dynamics of a moving box from delayed and incomplete observations. Third, an egocentric RGB-D encoder learns to recover this dynamics representation directly from visual observations while keeping the whole-body controller fixed. This decomposition provides each capability with a direct training signal and makes visual learning substantially more scalable. In simulation, Reflex achieves 85.7% catch success from egocentric RGB-D, compared with 87.9% when given privileged box observations. Temporal visual history is critical: removing it reduces success by 35.6 and 39.8 points on centered and laterally offset throws. On a real Unitree G1, Reflex catches human-thrown boxes with 65% and 40% success at 2.5 and 5 m, reaching 76% and 59% of human catchers' success at the same distances.
Source:https://arxiv.org/abs/2610.12772PreviousVerifier-Mediated Multi-LLM Coordination for Multi-Robot Path PlanningNextMultimodal Image-based Robotic Assistance and Guidance Environment (MIRAGE): A Novel Unified Framework for Surgical Navigation and Visualization
Related posts
Personalized Welcome Emails with Reports (and Fewer Glue Layers)
0dev.to
Your Next.js Site Has Four Copies of Every Page. Here Is How to Tell Google Which One Counts
0dev.to
Your age gate shouldn't compare the estimate to 18
0dev.to
I audited 100 public-sector websites in the EU and the US. The regional ranking is noise.
0dev.to
From sitemap.xml to a full audit report
0dev.to
CLAUDE.md best practices: what to include and skip, with a template
0dev.to