AI & ML
Improving Imitation Learning Efficiency for Manipulation through Geometric Prior Pretraining
arXiv cs.RO0 views
arXiv:2609.12721v2 Announce Type: replace Abstract: Applying an imitation learning policy to a new manipulation task usually requires collecting new demonstrations and retraining the model, which makes sample efficiency a practical concern. Pretraining on large-scale robot datasets is effective in this respect, but such datasets are costly to collect and train on, while data augmentation techniques typically require a new round of data generation and retraining for each task. A complementary question is what useful prior can be provided to a policy at negligible cost before any task-specific data are collected. In this study, we construct a geometric visual pretraining dataset in which each scene contains only a plane, an object, and a hand, and trajectories are generated automatically. The scenes contain neither textures nor backgrounds; pretraining primarily exposes the policy to the geometric relationship between the hand and the object. Furthermore, representing the hand as a cube avoids tailoring the dataset to a specific robot morphology. We evaluate this geometric prior using ACT on three simulated robots across five manipulation tasks each, as well as on three real-world robot tasks. Across many of these robot--task combinations, fine-tuning from the geometric prior achieves higher success rates in the early stages of training than training from scratch while using only a small number of task demonstrations. These results suggest that even highly simplified geometric scenes can provide a useful initialization that transfers across robots and to real-world tasks when task data are limited.
Source:https://arxiv.org/abs/2609.12721PreviousMulti-bounce Drum Roll with Optimized Active Tricks to Leverage Soft EmbodimentNextCompVLA: A Variable Compliance Vision-Language-Action Model for Contact-rich Manipulation
Related posts
P1.95 or P2.6: the pitch your camera picks before your client does
0dev.to
Building a Production AI Chatbot in Next.js: Architecture and Pitfalls
0dev.to
Home Assistant vs construir tu propia domótica en la nube: lo que aprendí haciendo la segunda
0dev.to
Hours of YouTube and 85 handtyped pages of notes on LLM Inference – Start here
0Hacker News
Humans will never again create a project like Wikipedia
0Hacker News
A Straight Line Is Not a Camera Pose: Auditing Short-Clip Pose Benchmarks
0arXiv cs.RO