General
Simple and Sharp Generalization Bounds via Lifting
arXiv stat.TH0 views
arXiv:2508.18682v5 Announce Type: replace Abstract: We bound the supremum of stochastic processes using a rate-distortion functional analogous to classical entropy integrals. A lifting argument embeds the process into a higher-dimensional space with permutation symmetry, reducing the analysis to a stationary process. This gives a two-sided characterization of the supremum of Gaussian processes, including cases where Dudley's entropy integral is not sharp. Combining the sharpness of Dudley's integral for stationary processes with information-theoretic arguments gives a proof of the majorizing measure theorem. The method also yields localized generalization bounds without a slicing argument. As an application, we derive risk bounds for empirical risk minimization over Lipschitz images of Sobolev ellipsoids. Our proof does not use the majorizing measure theorem.
Source:https://arxiv.org/abs/2508.18682PreviousInstance-dependent sequential limits as an exact information ledgerNextGeneral-purpose post-sampling reweighting method for multimodal target measures
Related posts
Man completes 28-year, 31,000-mile walk around world, returns to mother's house
0Hacker News New
Johnstown, PA will be your best place to live if you make under 100K
0Hacker News New
Cryosphere faces permanent damage when world overshoots 1.5C, scientists warn
0Hacker News New
Nanoparticles for delivering personalized cancer vaccines
0Hacker News New
WTF Ubuntu?
0Hacker News New
Napping Characteristics and Incident Dementia
0Hacker News New