Backend
Transport along Local Annealing Paths: Wasserstein Geometry and Multimodal Sampling
arXiv stat.ML0 views
arXiv:2611.05605v1 Announce Type: cross Abstract: Variational approaches to learning transport maps for multimodal sampling can suffer from mode collapse. One way to mitigate this problem is to learn transport along a prescribed path of intermediate distributions defined by geometric annealing. We show that annealing can take a substantial detour in Wasserstein space: when mass moves between modes, the path can be much longer than the distance between its endpoints. We further link path geometry to transport learning, showing that long annealing paths can slow population optimization, while sufficiently regular paths permit rapid convergence. Motivated by these findings, we propose componentwise annealed transport (CAT) to reduce the need for mass transfer between modes. Starting from a mode-informed mixture reference, CAT constructs an exact mixture decomposition of the target and learns separate transport maps along componentwise annealing paths. We estimate the component weights separately and show that these estimates remain consistent even when the learned flows are inexact. We also develop adaptive annealing schedules guided by transport effort. Experiments on multimodal synthetic distributions and Bayesian inference problems demonstrate improvements in transport learning and sampling efficiency.
Source:https://arxiv.org/abs/2611.05605PreviousSupport Vector Machines Directly Minimise KL DivergenceNextExact signal recovery from generative priors with sigmoid output activation
Related posts
Leveraging Soft Prompts for Privacy Attacks in Federated Prompt Tuning
0arXiv cs.CR
When Relationships Break: Interpreting Network Traffic Anomalies via Dependency Violations
0arXiv cs.CR
GhostTac: Manipulating Tactile Sensors without Physical Contact
0arXiv cs.CR
ToxiEval-ZKP: A Structure-Private Verification Framework for Molecular Toxicity Repair Tasks
0arXiv cs.CR
SUPER - Sensitivity-based Uncertainty-aware Performance and Risk Assessment in Visual Inertial Odometry
0arXiv cs.RO
Rethinking Self-Repair in Code-as-Policy Agents: What Drives Retry Success?
0arXiv cs.RO