AI & ML
Residual Reinforcement Learning for Visual Servo Control with Zero-Shot Sim-to-Real Transfer
arXiv cs.RO0 views
arXiv:2611.19318v1 Announce Type: new Abstract: We address tracking a moving object on a conveyor with a Franka Emika Panda robot arm, despite an imprecise digital twin, measurement errors, and noise. Our novel approach augments a loop-shaped inverse-Jacobian PI controller with a residual policy learned via Soft Actor-Critic in the digital twin. A delay-compensated Kalman filter fuses out-of-sequence camera measurements to provide latency-aware moving target position estimates. We compare the achieved performance to a performance bound for a class of model-based controllers derived from a frequency-domain sensitivity analysis, quantifying the minimum achievable error imposed by uncertain kinematic model mismatch. Simulation and hardware experiments indicate that our residual policy drives tracking error below the bound. Across conveyor speeds (27.9-41.8 mm/s), our method reduces mean tracking errors from 1.1-1.4 mm (baseline inverse-Jacobian PI) to 0.3-0.7 mm. These results show that learning residual corrections in a limited-fidelity simulator, combined with delay compensation, can substantially improve model-based control under modeling and measurement uncertainties while maintaining reliable sim-to-real transfer.
Source:https://arxiv.org/abs/2611.19318PreviousVLN-Flash: Parallel Action Decoding with Adaptive Execution for Vision-and-Language NavigationNextMARS: Dynamic Routing of Reinforcement-Learned Atomic Skills for Multi-Stage Robotic Manipulation
Related posts
The AI Token Casino: How the Regenerate Button Drains Your Budget
0dev.to AI
The Teacher in the Age of AI: Will the Machine Take Their Place, or Give Them Back Their Time?
0dev.to AI

Skillware v0.6.2: Section-Chunked Tax PDFs, RPC Health Gates & Strict Core Typing
0dev.to AI

GPT-6.2 Astra vs GPT-6 Astra: What Changes in Cost per Accepted Task?
0dev.to AI
Jobs That Fade, Jobs That Emerge: What the Labour Market Looks Like Up to 2030
0dev.to AI
Can an AI agent read your pricing page and submit your demo form? A dev checklist for agent-ready sites
0dev.to WebDev