Backend
Persistent Metric-Semantic Maritime Scene Memory from Open-Vocabulary 3D Scene Graphs
arXiv cs.RO0 views
arXiv:2611.13903v1 Announce Type: cross Abstract: Three-dimensional scene graphs (3DSGs) can provide robots with persistent metric-semantic representations for spatial reasoning, but the existing methods have primarily been developed for indoor and terrestrial environments. In this paper we investigate how a representative outdoor open-vocabulary method transfers to maritime environments and which adaptations are needed. Our experiments show that zero-shot representative outdoor 3DSG descriptions agree with our labeled ground truth for a majority of geometry-supported objects on our data, but the resulting map exhibits considerable physical-entity fragmentation, and its terrestrial higher-level assumptions don't capture maritime spatial organization needs. We therefore keep the underlying mapping method and post-process its accumulated evidence. We show a metric-semantic consolidation method followed by geometry-grounded multi-view vision-language model (VLM) reasoning that reconciles remaining fragments into physical entities and groups entities through observations into local places. In parallel, we construct maritime macro regions using map priors and onboard water and structure observations, and associate them with the local places. The resulting representation reduces physical-entity fragmentation beyond both the baseline and our geometry-semantic consolidation component alone, supports correspondence of fixed local places across repeated maritime traversals, and improves contextual retrieval on our reviewed queries over tested baselines. These results show how an outdoor open-vocabulary map can be adapted into persistent maritime scene memory with our methods for object/place identity and spatial abstractions.
Source:https://arxiv.org/abs/2611.13903PreviousTaxonomy-Agnostic Neurosymbolic Grounding of Robot KinematicsNextTransGHOST: Real-Time, Synthesis-Free Reconstruction of Instrument-Occluded Regions in Ophthalmic Microsurgery
Related posts
Cross-Spectral Analysis of Bivariate Graph Signals
0arXiv eess.SP
Embodiment-aware control by inference over the operator: a simulation study
0arXiv cs.HC
Shape optimisation of nonlinear Naghdi shells on discrete geometries
0arXiv cs.NA
Decentralized Ranking Aggregation via Gossip: Convergence and Robustness
0arXiv stat.ML
A Distribution Mapping Approach to Counterfactually Fair Reinforcement Learning
0arXiv stat.ML
Minimax Rates and Spectral Distillation for Tree Ensembles
0arXiv stat.ML