AI & ML
Beyond Appearance Shifts: Task-Semantic Action Calibration for VLA Models
arXiv cs.RO0 views
arXiv:2609.23650v2 Announce Type: replace Abstract: Vision-language-action (VLA) models have achieved strong performance in embodied manipulation, but still struggle to distinguish between changes that should preserve behavior and those that require different actions. We identify two complementary failure modes. Under task-preserving changes, where task semantics remain unchanged but scene appearance varies (e.g., style, illumination, clutter, or paraphrasing), policies often exhibit unnecessary action drift. Conversely, under semantic-breaking changes, where key task semantics such as the target object or constraint are altered, policies frequently continue following the original trajectory instead of adapting to the new task. To address these failures, we propose BAS-VLA, a task-semantic action calibration framework built on top of a frozen base VLA. BAS-VLA adopts a breaking-centered calibration core as its default path, complemented by a selective evidence-gated preserving auxiliary that corrects appearance-induced drift when task-preserving evidence is strong. Across four target-object swap tasks, BAS-VLA improves changed-task success from 2.3% to 68.5% while maintaining strong clean and semantics-preserving performance and suppressing outdated behavior. On validated style-preserving shifts, it further improves success from 42% to 70% without degrading clean performance. These results demonstrate the importance of calibrating VLA policies to remain stable when task semantics are preserved and adapt when task semantics change.
Source:https://arxiv.org/abs/2609.23650PreviousGenAI Changed the Cost of Coding. Why Are We Still Organizing Work the Same Way?NextHarnessPAI: An Evolving Harness for Physical AI
Related posts
Launch a Business for Under $500: Real Odds, 4 Founders
0dev.to AI
Google, Microsoft, OpenAI and Anthropic Back a Shared AI Training Opt-Out Signal
0dev.to AI
Did AI Decode the Voynich Manuscript? Claims Tested
0dev.to AI
AIGB 解决 Teletype.in 群组管理痛点
0dev.to AI

Qual a melhor arquitetura de dados para a sua aplicação de IA?
0dev.to AI
Connect a Stateless Streamable HTTP MCP Server to Claude, ChatGPT, and Gemini for Tour Route Research
0dev.to WebDev