Frontend
ExtremControl: Low-Latency Humanoid Teleoperation with Scaled Velocity Feedforward
arXiv cs.RO0 views
arXiv:2602.11321v4 Announce Type: replace Abstract: Building a low-latency humanoid teleoperation system is essential for collecting diverse reactive and dynamic demonstrations. However, end-to-end latencies in existing approaches consistently hover around 200ms, roughly equal to human reaction time, that severely limits responsiveness and prevents tasks requiring rapid feedback. We identify position-only PD control as the root cause of this latency floor and propose ExtremControl, a low-latency whole-body control framework that: (1) incorporates scaled velocity feedforward in low-level control, reducing tracking delay by approximately 70ms with a provably optimal feedforward ratio; (2) operates directly on SE(3) poses of selected rigid links, primarily humanoid extremities, to avoid joint-space retargeting in the control loop. To minimize retargeting time, we derive a closed-form Cartesian-space mapping that uses a single anthropomorphic calibration step to translate human motion into humanoid link targets, accommodating operators with varying body proportions. Furthermore, we provide a theoretical framework for selecting control hyperparameters, and validate the effectiveness of velocity feedforward control in the reinforcement learning for locomotion setting through experiments in both simulation and the real world. Building on ExtremControl, we implement a teleoperation system supporting both optical motion capture and VR-based tracking, achieving end-to-end latency as low as 50ms --- well beneath the threshold at which system delay adds a full human reaction cycle to the control loop. This enables a qualitatively new class of reactive behaviors, including ping-pong ball balancing, juggling, and real-time return, that are beyond the capability of existing teleoperation systems.
Source:https://arxiv.org/abs/2602.11321PreviousOnboard UAV State Estimation for Fast Flights Without External Localization Systems: A2RL Drone Racing Finalist ApproachNextSafe-Night VLA: Seeing the Unseen via Thermal-Perceptive Vision-Language-Action Models for Safety-Critical Manipulation
Related posts
Trailing slashes in a static Astro site on Vercel: five layers and a check that never failed
0dev.to
Try four admin templates before you install one
0dev.to
I scanned the GitHub Actions setup of 139 popular JS/TS repos. Only 1 passed 3 basic checks.
0dev.to GitHub
Power BI for Beginners: 5 Essential Concepts You Should Know
0dev.to Data
Per-Author Comment Macros for Co-Authors in LaTeX
0dev.to Productivity
How Singers Use iPhone Notes to Track Vocal Development and Performance Insights
0dev.to Productivity