AI & ML
On the asymptotic behaviour of $\alpha$-divergence generalized posteriors
arXiv stat.ML0 views
arXiv:2610.35330v1 Announce Type: cross Abstract: We study the asymptotic behaviour of the solutions to the unconstrained generalized variational inference problem regularized by an $\alpha$-divergence. Under mild conditions, the minimizer is explicit up to a scalar normalizing constant, and we show that it admits a rescaling under which it converges in $L^1$ to a fixed non-Gaussian law, at a concentration scale around the empirical loss minimizer that departs from the typical $n^{-1/2}$ in the classical Bernstein--von Mises theorem. For $\alpha\in(0,1)$ and $d<2/(1-\alpha)$ the limit is a Student-$t$ distribution and the posterior width shrinks faster than the sampling error of the empirical minimizer. Conversely, for $\alpha>1$ the limiting distribution is a compactly supported Pearson type-II distribution, and the posterior width shrinks more slowly than the sampling error. The KL divergence ($\alpha=1$) is the unique member of the $\alpha$-divergence family whose posterior width matches the sampling scale and whose limit is Gaussian. We discuss the implications of these qualitatively different regimes for the frequentist coverage of credible regions, and a toy example on intercept-only logistic regression illustrates the theoretical claims.
Source:https://arxiv.org/abs/2610.35330PreviousAutoEnergyDesign: An LLM-Driven Agent for Automatic Energy System Design OptimizationNextPrior Predictive Matching for Bayesian LoRA
Related posts

What Arconatese 3-4 Pontedera tells us about Serie D - Girone D
0dev.to Watercooler
Your AI agent got an HTTP error. Should it retry?
0dev.to Discuss
Is AI dangerous, or just misunderstood?
0dev.to Discuss
Why we price a developer tool per fix instead of per seat
0dev.to Productivity
My LLM-Powered Sidekick for Painless PR Descriptions
0dev.to Productivity
Reward-Adaptive Backtracking GFlowNet: A Technique Worth Understanding
0dev.to Productivity