AI & ML
Detection and Classification in Latent Spaces: High-Dimensional Analysis and Validation
arXiv stat.ML0 views
arXiv:2611.18164v1 Announce Type: new Abstract: Foundation models produce high-dimensional latent representations in which suitably designed statistical decision rules can be effective yet analytically tractable. We study such detectors in the high-dimensional regime, where latent dimension and training sample size grow proportionally. For linear and quadratic statistics, we derive explicit large-deviation characterizations of false-alarm and miss-detection performance under the Neyman-Pearson paradigm, and show how the binary analysis extends to multi-class classification. The resulting error probabilities and corresponding decay rates exhibit non-monotonic dependence on the shape parameter, including double-descent and, in some regimes, multiple-descent. Experiments on vision, text, and audio datasets using modern foundation models show close agreement between theoretical predictions and empirical performance. In particular, the proposed framework allows us to set a prescribed false-alarm level and accurately predict the corresponding miss-detection probability. Overall, our results provide a theoretically grounded and interpretable framework with competitive empirical performance across different modalities.
Source:https://arxiv.org/abs/2611.18164PreviousTraining-point consistency of kernel ridge regression with varying correlation scalesNextLaMe: a Joint Latent Mediation Framework for High-Dimensional Systems
Related posts
Making infrastructure inspections safer and more reliable
0Phys.org Tech

Replacing workers with AI could prove incredibly costly if the technology doesn't work out
0TechRadar

Campaign to reinstate Huang as Nvidia CEO now has 175,000 signatures
0TechRadar

Apple provides a safe way to ask an AI questions about your health
09to5Mac
The King’s Trust and OpenAI launch £1m partnership
0OpenAI Blog

AI Skills and the Gender Gap: Who Gets Ahead in the Changing Job Market?
0HackerNoon