AI & ML
Rollout then Recycle: 3,718 Labelled Real-Robot Episodes from Benchmarking 7 Policies on 12 Tasks
arXiv cs.RO0 views
arXiv:2611.03168v2 Announce Type: replace Abstract: We release all 3,718 episodes from the ArmnetBench v0.1 evaluation (arXiv:2607.24481), which contains 600 teleoperated demonstrations and 3,118 rollouts of seven imitation-learning and vision-language-action policies on 12 tabletop tasks, recorded on low-cost SO-101 arms; 73% of the rollouts are failures. Every policy for a task was trained or fine-tuned on the same 50 demonstrations and rolled out on the same cell, so the corpus contains many policies' failures on shared tasks. An operator labelled every rollout successful, suboptimal or failure. Each episode has three camera views, joint states and actions and is available on the Hugging Face Hub in LeRobot v3.0 and a reward-model format. This note documents how the episodes were collected and the limitations that could affect their use.
Source:https://arxiv.org/abs/2611.03168PreviousPILOT: Guiding Long-Horizon World-Model Planning for Robot Manipulation with Imagined Subgoals and Policy PriorsNextDailyBrick: Language-Guided Synthesis of Brick Assembly Instructions
Related posts
One Leaked Prefix Can Take Down Three Clouds: Route Filtering for Multi-Cloud Estates
0dev.to
Global stock markets slump as Anthropic's record IPO fails to stem AI sell-off
0Hacker News

The Download: inside the quest to make our minds immortal
0MIT Technology Review
The Birdfy Gifts I’d Buy for Backyard Birders
0Wired

Rocket Report: A weekend of ups and downs; Stoke celebrates engine milestone
0Ars Technica
California AG subpoenas Nvidia over worries about Huang’s ties with China
0TechCrunch