Open Source
How Much of Your VLA Is kNN
arXiv cs.RO0 views
arXiv:2611.13160v1 Announce Type: new Abstract: Vision-language-action (VLA) models now exceed 95% success on the LIBERO simulation benchmark, yet it remains unclear how much of this performance requires generalization beyond the training demonstrations. In this work, we show that retrieving nearby demonstrations and reusing their action chunks achieves a success rate of 91.7 % on LIBERO without policy training. Under LIBERO-Plus perturbations, retrieval shows the smallest drop of all evaluated policies. Across nine publicly available VLAs, fine-tuning mostly makes the vision-language backbone a better retrieval key, and the actions of the VLAs remain close to the demonstrations. In addition, we introduce Local Action Consistency (LAC), an offline metric that measures whether nearby observations in representation space are also associated with similar future actions. We show that LAC tracks the success rate of retrieval and can guide the training of a retrieval key. Our evaluation and source code are available at https://github.com/sereact/lerobot_knn.
Source:https://arxiv.org/abs/2611.13160PreviousDOBB: Dynamic Oriented Bounding Boxes for Multi-Agent Collision Avoidance under State Uncertainty and Heterogeneous DynamicsNextGround Reaction Force-Aware Model Predictive Control for Underactuated Upright Physical Assistance
Related posts
Convert all Google photos to AVIF
0Hacker News New
Panorea, a chiptune note player working on Pascal and aplay
0Hacker News New
Show HN: BtR an open-source isometric ARPG in Python/Raylib
0Hacker News New
Show HN: Overdeck 0.74 – MCP tools for coding agents, plus phone apps
0Hacker News Show
The Rise of Low Precision Floating Point
0arXiv cs.NA
A Projection Anderson Acceleration Algorithm for Non-quasi-monotone Variational Inequalities with H\"older Continuous Terms
0arXiv cs.NA