AI & ML
SURE:Spatiotemporal Uncertainty Representation for Efficient Vision-Language-Action Learning
arXiv cs.RO0 views
arXiv:2611.09684v1 Announce Type: new Abstract: Vision-language-action (VLA) policies have become a promising paradigm for end-to-end robot control, but their effectiveness still depends heavily on large volumes of demonstration data. In manipulation tasks, this dependence is compounded by structured spatiotemporal uncertainty in the action space: multiple nearby actions or trajectories may successfully solve the same task, while semantically equivalent demonstrations often unfold at different speeds. Standard pointwise supervision treats each demonstrated action as an exact target, imposing an unnecessary learning burden under such uncertainty. We present SURE, a data-efficient VLA training framework that explicitly models both spatial and temporal uncertainty. SURE augments a VLA backbone with a lightweight transposed-convolutional probabilistic action decoder that captures spatial uncertainty through local correlations among neighboring action bins. It further introduces Soft-DTW alignment supervision to accommodate local timing variations between predicted and demonstrated action chunks. Together, these two components reduce sensitivity to demonstrator-specific poses and execution timing, enabling more data-efficient action learning. We evaluate SURE on LIBERO, RoboTwin 2.0, and real-world manipulation tasks. Even with only 10% of the demonstration data or 20% of the training steps, SURE achieves manipulation success rates that match or surpass baseline VLAs.
Source:https://arxiv.org/abs/2611.09684PreviousAutonomous Particle Image Velocimetry Using Zero-Shot Sim-to-Real Reinforcement LearningNextA wearable input/output interface learns personalized models of haptic perception
Related posts
Scientists May Have Discovered a Massive Starless Galaxy
0Wired
Why my dataclass test failed when the values matched
0dev.to
A pre-launch mobile app testing checklist for small teams
0dev.to
How to Check a PDF’s Metadata: Acrobat, Windows, macOS and the Command Line
0dev.to
![AMR AI and Embodied Intelligence — Ch.20: Multi Agent Robotics [KR]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fzd2oflt3xqsm741q8o02.png)
AMR AI and Embodied Intelligence — Ch.20: Multi Agent Robotics [KR]
0dev.to
![AMR AI and Embodied Intelligence — Ch.21: AI Safety for Robotics [KR]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F9sq8mphrqy5pbxzp0qga.png)
AMR AI and Embodied Intelligence — Ch.21: AI Safety for Robotics [KR]
0dev.to