AI & ML
A Function-Space Stability Boundary for Generalization in Interpolating Learning Systems
arXiv stat.ML0 views
arXiv:2602.03514v3 Announce Type: replace-cross Abstract: Modern learning systems often interpolate training data while still generalizing well, yet it remains unclear when algorithmic stability explains this behavior. We model training as a function-space trajectory and measure sensitivity to single-sample perturbations along this trajectory. We propose a contractive propagation condition and a stability certificate obtained by unrolling the resulting recursion. A small certificate implies stability-based generalization, while we also prove that there exist interpolating regimes with small risk where such contractive sensitivity cannot hold, showing that stability is not a universal explanation. Experiments confirm that certificate growth predicts generalization differences across optimizers, step sizes, and dataset perturbations. The framework therefore identifies regimes where stability explains generalization and where alternative mechanisms must account for success.
Source:https://arxiv.org/abs/2602.03514PreviousWho Gets Watched? Allocating Scarce Escalation Resources on Pediatric Wards with Neural Index PoliciesNextSpectral Condition for $\mu$P under Width-Depth Scaling
Related posts

Apple recently notified users in 99 countries of potential mercenary spyware attacks
09to5Mac
The model that wouldn't be forced
0dev.to

Kimi K3.1 Pro: 5,315 multilingual test results
0dev.to
Apple may try to increase revenue by doing…something with third-party AI apps
0TechCrunch
ChatGPT sent 116 people to one of our pages last week. The week before, it sent 7.
0dev.to
Wabi's features, in plain language: threads, mini-apps, widgets and shared chats
0dev.to