Backend
VLA-Stem: A Lightweight Safety Mechanism for Vision-Language-Action Models via Reinforcement Learning
arXiv cs.RO0 views
arXiv:2610.37378v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models integrate high-level reasoning with low-level action execution for end-to-end robotic control. However, most VLA models target static manipulation in unconstrained environments, overlooking spatial constraints and dynamic obstacles. Fine-tuning VLAs on obstacle-avoidance data is a straightforward solution, but collecting such data is costly, especially for dynamic scenarios, and may degrade their original task capabilities. To address these limitations, we propose VLA-Stem, a lightweight, reinforcement-learning-based safety mechanism for VLA systems. Without fine-tuning the underlying VLA policy, VLA-Stem converts its action chunks into motion references and uses trajectory-level guidance to preserve their spatial intent while allowing flexible motion and timing adjustments. Conditioned on these references, robot proprioception, and local obstacle information, the Stem policy adaptively modifies execution at inference time, preserving the original task intent while enabling responsive adaptation to spatial constraints and dynamic obstacles. For robust and sample-efficient training, we combine teacher-student distillation with curriculum learning. We evaluate VLA-Stem on reference following, static spatial constraints, and dynamic obstacle avoidance. Across six constrained simulation settings, VLA-Stem achieves 52.8% average collision-free task success versus 23.7% for the strongest safety baseline, while preserving base-policy performance in obstacle-free settings; real-world experiments further show consistent collision reductions under static and dynamic obstacles. These results demonstrate that VLA-Stem couples high-level VLA task intent with rapid, reflex-like responses to immediate physical risks, providing a brainstem-inspired mechanism for robust robot execution.
Source:https://arxiv.org/abs/2610.37378PreviousGeneralizable Target-Less Joint Intrinsic-Extrinsic Camera-LiDAR Calibration using Deep Pixel-Point CorrespondencesNextPDRVLA: A Vision-Language-Action Model with Physical Dynamics Representations
Related posts
Is It Safe to Use AI for LinkedIn Messages? What to Know
0dev.to Career

Amazon Interview Prep: What Happened After You Lost the Argument?
0dev.to Career
UI tests that stayed green on a broken app, and what it took to make them fail
0dev.to Testing

Part 3: Green Builds, Blind Spots: Testing Compose Accessibility Layer by Layer
0dev.to Testing
How I test local TTS on a Mac before it reads a book
0dev.to Testing

11 Best Vibe Coding Tools Compared, From No-Code Builders to Terminal Agents
0dev.to Programming