AI & ML
Predictive Long-Horizon Progress Modeling with Action-Aware Quantification
arXiv cs.RO0 views
arXiv:2610.32776v1 Announce Type: new Abstract: Quantitative and dense task progress feedback is essential for robotic manipulation across data curation, policy evaluation, and reinforcement learning. Existing progress annotations often rely on sparse keyframe markings derived from subjective manual judgments, limiting their scalability and cross-task consistency, particularly in long-horizon manipulation. To overcome these challenges, we propose action-aware quantification, a unified progress specification that decomposes long-horizon trajectories into object-level subtasks via a vision-language model (VLM) and assigns weighted action credits to capture fine-grained execution dynamics. Using VLM auto-labeling and human calibration, we construct an 800+ hour training video dataset and LOOM, a long-horizon progress benchmark containing 19,618 human-calibrated evaluation frames. To model these dense progress dynamics, we introduce NimCritic, a predictive progress critic trained via Joint Video-Progress Learning. We further incorporate Historical Progress Perturbation to mitigate sequential drift, and design a contrastive Video-Progress Alignment objective that bridges asymmetric expert streams by mutually grounding intermediate visual dynamics and denoised progress trajectories. NimCritic matches or outperforms state-of-the-art process reward models (PRMs) on the established Video Progress Benchmark (VPB) and LOOM, surpassing GVL (GPT-6-Sol) on VPB by about 65% in terminal success accuracy (TSA). On the large-scale RoboArena policy evaluation benchmark, it also retrieves human-selected successful rollouts with about 97% overall recall. These results establish action-aware quantification as a scalable foundation for dense progress feedback in robotic manipulation.
Source:https://arxiv.org/abs/2610.32776PreviousSemantic Representation for Agentic Self-Play in Automated LaboratoriesNextWhen Human Corrections Travel: Safety in Federated VLA Adaptation
Related posts
BeeTalk 群主必备:AI 群管机器人 AIGB 免费解决垃圾信息问题
0dev.to AI
I Open-Sourced a Free YouTube Shorts Factory. The Money Isn't in the Shorts.
0dev.to AI
Priced per TB/s, the H200 beats the H100 at 6 of 7 providers
0dev.to Python
Daily Dose of DevOps — Telemetry design: for platform operations teams
0dev.to DevOps

Israeli startup 42AI, which is developing a "behavioral world model" that tries to predict human behavior, emerges from stealth with a $62.5M seed (Ram Iyer/TechCrunch)
0Techmeme

Anthropic confirms new Claude Code limits "to steer it away from recreating someone else's specific game", saying IP infringement violates its usage policy (Bruno Ferreira/Tom's Hardware)
0Techmeme