AI & ML
Central limit theorem in R\'enyi divergence for lattice random variables
arXiv math.IT0 views
arXiv:2608.16144v2 Announce Type: replace-cross Abstract: Let $\{X_i\}_{i=1}^n$ be independent, identically distributed lattice random variables with zero mean, unit variance, and maximal span $h>0$. Let $S_n=(X_1+\cdots+X_n)/\sqrt n$. Let $Z_n$ denote the quantization of a standard Gaussian random variable on the support lattice of $S_n$. We show that the R\'enyi divergence $D_\alpha(S_n\|Z_n)$ of order $1<\alpha<\infty$ tends to 0 as $n\to\infty$ if and only if $D_\alpha(S_{n_0}\| Z_{n_0})<\infty$ for some integer $n_0$ and a sub-Gaussian condition holds. Furthermore, we derive an Edgeworth-type asymptotic expansion of the divergence to arbitrary order. We also show that the R\'enyi divergence $D_\infty(S_n\|Z_n)$ of infinite order tends to 0 as $n\to\infty$ if and only if a sub-Gaussian condition, a curvature condition, and a uniform separation condition hold. These results constitute lattice counterparts of R\'enyi entropic central limit theorems for continuous random variables obtained by Bobkov, Chistyakov and G\"{o}tze (\emph{Ann. Probab.} \textbf{47} (2019), 270--323) and Bobkov and G\"{o}tze (\emph{Ann. Probab.} \textbf{53} (2025), 453--477). Uniform separation is an additional assumption beyond the sub-Gaussian and curvature conditions used in the continuous setting. The failure of uniform separation may cause an exponentially tilted version of $X_1$ to concentrate on a sublattice of max span $kh$ for some integer $k>1$, which yields the lower bound $D_\infty(S_n\|Z_n)\ge\log k$, and hence a failure of the entropic central limit theorem.
Source:https://arxiv.org/abs/2608.16144PreviousOptimal Average Success Probabilities of Binary $(n,n-1)$ and $(n,n-2)$ Quantum Random Access CodesNextAlmost every Boolean function has central threshold degree
Related posts

LLM weak random number generator detection test
0dev.to Security

Filings: Oracle is selling $10B in common stock and $10B in bonds, as it rushes to get financing for its data center buildout and chip purchases; ORCL falls 5%+ (Kelly Cloonan/Wall Street Journal)
0Techmeme

Sources detail Anthropic's compute deal spree: 3.5GW+ of expected capacity in 2026, diversifying beyond Nvidia's AI chips to Amazon, Google, and AMD, and more (New York Times)
0Techmeme

A profile of OpenAI VP Charles Porch, an ex-Instagram executive who is rehabilitating AI's image across Hollywood and the media, including via celebrity dinners (Charlotte Klein/New York Magazine)
0Techmeme

Putin orders owners of non-state data centers to reserve 10% of capacity for Russia's IT infrastructure after Ukrainian drone attacks on Russian facilities (Reuters)
0Techmeme
Supermarket Freezers Across Europe Hit By Second Suspected Cyberattack
0Slashdot