Frontend
MAIA: Anticipating Interaction Anomalies in Contact-Rich Manipulation via Multimodal World Models
arXiv cs.RO0 views
arXiv:2610.21686v1 Announce Type: new Abstract: Reliable contact-rich manipulation requires detecting execution deviations early enough for corrective action. Yet most monitoring methods are reactive, identifying anomalies only after they become observable. Anticipating such anomalies is challenging because visual observations only partially reveal physical interaction, while planned actions describe intended motion rather than their actual physical consequences. We address this problem with MAIA, a multimodal framework for anomaly anticipation. Its vision-action-force world model learns nominal interaction dynamics and predicts the visual and force responses of planned actions, while a lightweight anomaly head predicts impending interaction anomalies. To enable systematic evaluation, we introduce CRIA, a real-world multimodal dataset of 2,852 trajectories spanning 18 contact-rich manipulation tasks, with frame-level annotations of anomaly onset and evolution. Experiments on both seen and novel tasks show that MAIA achieves more accurate anomaly discrimination than representative baselines while providing earlier warnings, with bACC scores of 0.765 and 0.710 and median anticipation lead times of 28.0 and 25.1 steps, respectively. Moreover, using these predictions for anomaly-aware action selection improves end-to-end task success from 52.6% to 61.5% without retraining the underlying manipulation policy. These results highlight the value of modeling future physical consequences for proactive anomaly anticipation.
Source:https://arxiv.org/abs/2610.21686PreviousDiffeomorphic Hidden-State Steering: Improving Imitation Learning Policy Robustness through Expert Hidden-State GeometryNextUni-PNP: Unified Prehensile and Non-prehensile Policy Learning for Generalizable Object Pose Reaching
Related posts
Pray for Chaos
0Hacker News
Trailing slashes in a static Astro site on Vercel: five layers and a check that never failed
0dev.to
Try four admin templates before you install one
0dev.to
I scanned the GitHub Actions setup of 139 popular JS/TS repos. Only 1 passed 3 basic checks.
0dev.to GitHub
Power BI for Beginners: 5 Essential Concepts You Should Know
0dev.to Data
Per-Author Comment Macros for Co-Authors in LaTeX
0dev.to Productivity