Open Source
MOSU2: Long-range Navigation System with Multi-modal Scene Understanding
arXiv cs.RO0 views
arXiv:2611.11148v2 Announce Type: replace Abstract: Robots that travel long distances through public outdoor spaces must do more than avoid obstacles: they must remain on terrain suited to their mobility and decide when to proceed, yield, or detour around pedestrians, cyclists, vehicles, traffic signals, and temporary restrictions. These decisions are difficult because their correctness often depends on how a scene evolves, such as whether an approaching car is slowing or a cyclist will cross the robot's path. Vision-language models (VLMs) can interpret such cues, but they reason over images that lack metric geometry and motion. Supplying this evidence at every step is too slow for real-time navigation, and hand-crafted triggers cannot anticipate the open-ended variety of outdoor situations. We present MOSU2, a long-range navigation system with two-stage trajectory selection, in which first-stage contextual reasoning determines when additional evidence is needed and what to retrieve. Only when an interaction remains unresolved does the first stage trigger the second stage to retrieve geometric and dynamic information and align it with scene context to make navigation decisions. Building on MOSU, MOSU2 follows routes from GPS-based route planning and filters candidate trajectories through multi-modal traversability analysis before selecting a trajectory to move the robot. In real-world experiments spanning stop gestures, construction sites, crosswalks, and roads shared with vehicles, cyclists, and pedestrians, MOSU2 raises mean navigation success from 61.8% to 94.2% and condition-detection accuracy from 72.2% to 91.4% over its single-image predecessor, at about 2.2 times its mean decision latency. Project website: https://jinggm.github.io/mosu2/
Source:https://arxiv.org/abs/2611.11148PreviousData-Driven Configuration of Protective Separation Zones in Collaborative Robot Cells from Operator OccupancyNextFast Inference-Time Policy Refinement via Action-Affine World Models
Related posts
ObservabilityCON on the Road: New sessions coming to you in 2027
0Grafana Blog
How to get a software engineering internship
0dev.to Career

Got a new MacBook for college? 9 apps I'd install before the first assignment (2026)
0dev.to Beginners
Four order books, one clock: what a six-second probe says about Hyperliquid's latency claims
0dev.to OpenSource
App licences: MIT, GPL, proprietary — where projects actually break
0dev.to Programming
regex-engine: a regex engine from scratch in Rust, with no backtracking
0dev.to Rust