AI & ML
Training-point consistency of kernel ridge regression with varying correlation scales
arXiv stat.ML0 views
arXiv:2611.18095v1 Announce Type: new Abstract: The scale parameter in kernel ridge regression plays a pivotal role in modeling the correlation structure of data. In modern applications, sampling density and the underlying correlation range often change simultaneously, making a fixed-scale assumption highly restrictive. However, establishing asymptotic theories under varying scale parameters is fundamentally challenging. To address this gap, this paper develops a unified theoretical framework for kernel ridge regression under varying scale parameters. We establish that, on uniform tensor grids with product exponential kernels, the consistency of the training-point risk holds if and only if the effective local sample size diverges to infinity. This sharp criterion universally covers all regimes along arbitrary deterministic scale sequences, seamlessly unifying the long-range, fixed-scale, and short-range. Furthermore, we provide an explicit, signal-independent construction of a deterministic regularization penalty that guarantees this consistency. Numerical experiments illustrate the criterion and the corresponding penalty across all the three regimes.
Source:https://arxiv.org/abs/2611.18095PreviousEfficient and Practical Clustering of Variables in Causal GraphsNextDetection and Classification in Latent Spaces: High-Dimensional Analysis and Validation
Related posts

Replacing workers with AI could prove incredibly costly if the technology doesn't work out
0TechRadar

Campaign to reinstate Huang as Nvidia CEO now has 175,000 signatures
0TechRadar

Apple provides a safe way to ask an AI questions about your health
09to5Mac
The King’s Trust and OpenAI launch £1m partnership
0OpenAI Blog

AI Skills and the Gender Gap: Who Gets Ahead in the Changing Job Market?
0HackerNoon

AI in Leadership: Managing People, Not Just Work
0HackerNoon