AI & ML
SafeDojo: Safe Reinforcement Learning for VLA via Interactive World Model
arXiv cs.RO0 views
arXiv:2606.20698v2 Announce Type: replace Abstract: Safe control is a prerequisite for real-world embodied intelligence, for which safe reinforcement learning has emerged as a promising paradigm. However, existing safe reinforcement learning methods either require costly real-world exploration or depend on hand-crafted safety functions. Neither scales to vision-language-action models deployed in open-world physical environments. We propose SafeDojo, a model-based safe reinforcement learning framework that improves vision-language-action policies through world-model imagination. SafeDojo performs online reinforcement learning on top of an interactive video world model. A ResNet success classifier scores predicted future frames, while a lightweight safety head predicts per-step contact probabilities from the current latent context and proposed action chunk, jointly assessing task execution and trajectory safety. These decoupled signals are balanced through Lagrangian-constrained GRPO. On SafeLIBERO Level I, SafeDojo improves average safe-success rate by 8.25 percentage points over the strongest baseline; on the zero-shot Level II setting, it is competitive with the strongest model-free baseline. Real-world Franka deployment further shows the best average task and safe-success rates across five tasks. These results support world-model-based safe reinforcement learning as a promising path toward safer embodied intelligence.
Source:https://arxiv.org/abs/2606.20698Previous$\mu_0$: A Scalable 3D Interaction-Trace World ModelNextInference-Time Robot Behavior Steering through Physically-Aware Reconfiguration of Task-Structure
Related posts
Ask HN: What hardware are you using to run local LLMs?
0Hacker News Ask
Codeberg Is Unusable
0Hacker News Ask
Ask HN: Are you using AI for company messaging?
0Hacker News Ask
Ask HN: Will Copilot Code replace developers building custom internal tools?
0Hacker News Ask
Ask HN: Who wants to be hired? (November 2026)
0Hacker News Ask
Heated mirror reveals hidden 3D patterns in rising air near a wall
0Phys.org Tech