Backend
Learning a Mixture of GFlowNets
arXiv stat.ML0 views
arXiv:2610.07562v1 Announce Type: cross Abstract: Learning an ensemble of GFlowNets to sample from a discrete target distribution has become a common approach for achieving better state space exploration and convergence than that of a monolithic sampler. However, these methods often add a substantial runtime overhead to the base model, and their conceptual connection remains elusive. To address this, we first propose a general-purpose theoretical framework for describing a mixture of GFlowNets, which we specialize into continuously (CI) and discretely indexed (DI) collections. On the one hand, we show CI GFlowNets can be interpreted through the lens of a random features expansion, provably boosting the sampler's expressivity in graph-structured tasks and reducing learning instability via spectral shifting. On the other hand, we demonstrate DI GFlowNets encompass prior approaches for GFlowNet training and provide the foundation for the newly proposed Stratum-Conditioned (SC) GFlowNets. This method, which is inspired by the Doob's h-transform of Markov chains, decomposes the state space according to a prescribed modular function and restricts each component to sample from a distinct subset of it. Importantly, SC GFlowNets support centralized and component-wise embarrassingly parallel training, and we show both of them significantly speed up learning convergence and mode coverage without introducing any non-negligible extra computation.
Source:https://arxiv.org/abs/2610.07562PreviousDoes Muon Need Fine-Grained Spectral Shaping?NextAdversarially Trained Linear Transformers Are Optimal Robust In-Context Learners for Gaussian Mixtures
Related posts
find -size -1M Matched Only the Empty File: Size Units in a Camera Clip Cleanup Script
0dev.to
Mastering Background Tasks in Flutter: Efficient Data Sync & UI Updates
0dev.to
Remove a Photo Background in the Browser: An On-Device Model, No Upload
0dev.to
My morning terminal: zoxide jumps, mise runs the project, starship shows context, fzf picks the file
0dev.to

A stale translation passes every check and still tells a different story
0dev.to
NYT and publishers sue Brave over AI content scraping
0dev.to