AI & ML
Rollout then Recycle: 3,718 Labelled Real-Robot Episodes from Benchmarking 7 Policies on 12 Tasks
arXiv cs.RO0 views
arXiv:2611.03168v2 Announce Type: replace Abstract: We release all 3,718 episodes from the ArmnetBench v0.1 evaluation (arXiv:2607.24481), which contains 600 teleoperated demonstrations and 3,118 rollouts of seven imitation-learning and vision-language-action policies on 12 tabletop tasks, recorded on low-cost SO-101 arms; 73% of the rollouts are failures. Every policy for a task was trained or fine-tuned on the same 50 demonstrations and rolled out on the same cell, so the corpus contains many policies' failures on shared tasks. An operator labelled every rollout successful, suboptimal or failure. Each episode has three camera views, joint states and actions and is available on the Hugging Face Hub in LeRobot v3.0 and a reward-model format. This note documents how the episodes were collected and the limitations that could affect their use.
Source:https://arxiv.org/abs/2611.03168PreviousPILOT: Guiding Long-Horizon World-Model Planning for Robot Manipulation with Imagined Subgoals and Policy PriorsNextDailyBrick: Language-Guided Synthesis of Brick Assembly Instructions
Related posts
Mixing Regularization for Average-Reward $Q$-Learning and $Q$-Planning
0arXiv stat.ML
Pragmatic DML with AI-Learned Representations
0arXiv stat.ML
Arbitrary-Accuracy Neural Approximation with Optimal Neuron Count and Optimal Bit Complexity
0arXiv stat.ML
Prior-Amortized In-Context Bayesian Inference for Generalized Linear Mixed-Effects Models
0arXiv stat.ML
Agent Meltdowns: The Road to Hell Is Paved with Helpful Agents
0arXiv cs.CR
Composable Driving Style for End-to-End Autonomous Driving
0arXiv cs.RO