General
Bregman geometry in regular exponential families: dual representations and relative smoothness
arXiv stat.ML0 views
arXiv:2611.18480v1 Announce Type: new Abstract: Regular exponential-family distributions are ubiquitous in statistics due to their appealing and convenient properties. Notably, they can be expressed in terms of Bregman divergences, revealing fundamental connections between statistics, convex analysis, and information geometry. However, this geometric structure has not been systematically exploited to characterize these distributions with respect to their expectation parametrization. Building on a projective characterization, we establish a general construction of equivalent dual Bregman representations, together with normalization and uniqueness results. These representations express log-densities as ordinary Bregman divergences in dual coordinate systems, providing geometric characterizations of the parameter space. So-called $\beta$- and $\alpha$-scaled dual representations emerge as particular instances of this framework. We further derive dual Bregman representations of conjugate priors and establish that they preserve conjugacy. Applications to classical distributions illustrate the geometric structures underlying seemingly different statistical models. Moreover, we show that these representations provide natural reference geometries for establishing relative smoothness of the primal Bregman representation of the distribution, with explicit bounds that are sharp in the scalar and separable settings. An illustrative application to the Poisson distribution sheds new light on several works in the literature, providing complementary geometric justifications for reference geometries while deriving existing algorithms.
Source:https://arxiv.org/abs/2611.18480PreviousContrastive latent representation learning with denoising score matchingNextElliptic Sampling: Optimal Interpolant Schedules for Gaussians and Beyond
Related posts
Blokjutsu: A macOS image generator/editor
0Hacker News New
Heat-storing gels regulate building temp to slash energy bills
0Hacker News New
The Law Partner Who Travels the Globe for Work–Without Setting Foot on a Plane
0Hacker News New
Bought a Tesla? One simple step in the first 30 days could protect your rights
0Hacker News New
C-like bit flags in Ruby
0Hacker News New
DMARC Report Analyzer
0Hacker News New