Backend
Prompt Re-Specification and Target-Mask Availability in Mask-Conditioned Visual Reinforcement Learning for Moving-Platform Landing
arXiv cs.RO0 views
arXiv:2611.20075v1 Announce Type: new Abstract: Visual reinforcement learning (RL) policies that land a drone on a moving platform can fail when the landing pad looks different from the one used in training. Using binary target masks as the visual input removes most pixel-level appearance information while preserving the spatial representation of the target, and lets a text prompt specify the target. In simulation, we test whether a frozen (fixed-weight) mask-based DrQ-v2 policy can handle a new pad when only the prompt of its fine-tuned SAM 3 detector changes. A banana-themed pad lowered landing success from 75.6% to 12.0%, and SAM 3 rarely detected it under the original prompt. A revised prompt, chosen after testing several candidates, restored success to 68.4% with no weight updates. In a separate experiment with a policy trained on ground-truth masks, filling in masks that were missing while the pad was visible helped landing far more than the tested mask-centroid and area corrections. Tracking the pad over time supplied masks more often and also kept producing them after the pad was confirmed absent from the rendered image, but it did not establish a reliable improvement in landing success. Whether a usable mask reaches the policy at all thus appears to be an important limiting factor for this approach.
Source:https://arxiv.org/abs/2611.20075PreviousPlanDiv: Test-Time Scaling with Latent Plans for Vision-Language-Action ModelsNextEgoSwarm: Learning Decentralized Robot Swarm Intelligence from Human Swarm Demonstrations
Related posts
Our Guard Checked That We Still Talked About the Fix, Not That We Still Did It
0dev.to

How to Build an Invoice App with Next.js and Firebase Using Claude (With Prompts Included)
0dev.to
One calendar URL, five subscribe links, and the Outlook one Microsoft has never documented
0dev.to
The Hidden Engineering Challenge Behind Smart Construction Sites
0dev.to
WooCommerce Orders Stuck on Pending Payment: How to Fix
0dev.to
WordPress Staging Site: How to Test Changes Safely
0dev.to