Backend
Posterior Frequencies and the Cost of Not Fitting: A Correction to a Memorization Lower Bound
arXiv stat.ML0 views
arXiv:2610.20402v1 Announce Type: new Abstract: Feldman's memorization lower bound assigns a frequency coefficient based on how often a point appears in the training sample. We give an exact three-point counterexample to its conditional and averaged forms, using independent fair labels and a permutation-equivariant learner. A sequence of sampling priors makes the ratio of the proposed penalty to actual excess risk grow exponentially, ruling out a universal positive constant-factor repair. The priors vary with sample size, the offending profiles become rare, and both quantities vanish. Retaining the original model, we obtain an exact replacement using full-sample posterior probabilities. Under exchangeability, these depend on multiplicity and the complete frequency profile. We characterize the largest multiplicity-only coefficients valid for unrestricted learners. The original coefficient has the posterior-mean form of Good's exact frequency formula and is an occupancy-weighted average of the corrected coefficients.
Source:https://arxiv.org/abs/2610.20402PreviousThe minimal width of neural networks and immersions of real projective spaceNextTarget-Constrained Pooling for Trajectory Extrapolation
Related posts

Google Cloud Spend Caps Reach General Availability With an API and Live Costs
0dev.to
I built a Tinder-style Website for finding coding project ideas
0dev.to
GSAP ScrollTrigger image sequence in WordPress without code: when DIY isn't worth it
0dev.to
Surviving AWS Spot Interruptions With Real Checkpointing
0dev.to
Forward Watch
0dev.to
How to Choose 3 Healthtech Email API Paths: Retention Rules That Survive Audits
0dev.to