AI & ML
Spectral Thresholds in Correlated Spiked Models and Fundamental Limits of Partial Least Squares
arXiv stat.TH0 views
arXiv:2510.17561v2 Announce Type: replace Abstract: We provide a rigorous random matrix theory analysis of spiked cross-covariance models where the signals across two high-dimensional data channels are partially aligned. These models are motivated by multi-modal learning and form the standard generative setting underlying Partial Least Squares (PLS), a widely used yet theoretically underdeveloped method. We show that the leading singular values of the sample cross-covariance matrix undergo a Baik-Ben Arous-Peche (BBP)-type phase transition, and we characterize the precise thresholds for the emergence of informative components. Our results yield the first sharp asymptotic description of the signal recovery capabilities of PLS in this setting, revealing a fundamental performance gap between PLS and the Bayes-optimal estimator. In particular, we identify the SNR and correlation regimes where PLS fails to recover any signal, despite detectability being possible in principle. These findings clarify the theoretical limits of PLS and provide guidance for the design of reliable multi-modal inference methods in high dimensions.
Source:https://arxiv.org/abs/2510.17561PreviousValidity of the Behrens--Fisher solutionNextNonparametric Bandits with Single-Index Rewards: Optimality and Adaptivity
Related posts
Speed limits for information acquisition in stochastic learning dynamics
0arXiv stat.ML
Deep Barycentric Regression for Optimal Transport Map Estimation and Its Statistical Optimality
0arXiv stat.ML
Geometry-Constrained Kolmogorov-Arnold Networks: Learning Edge Geometry via Banach Duality
0arXiv stat.ML
Designing Reinforcement Learning for Diffusion Models: A Unified Path-Space View
0arXiv stat.ML
Empirical Bayes Rebiasing
0arXiv stat.ML
Almost Sure Convergence Rates of Stochastic Approximation and Reinforcement Learning via a Poisson-Moreau Drift
0arXiv stat.ML