AI & ML
Spectral Thresholds in Correlated Spiked Models and Fundamental Limits of Partial Least Squares
arXiv stat.TH0 views
arXiv:2510.17561v2 Announce Type: replace Abstract: We provide a rigorous random matrix theory analysis of spiked cross-covariance models where the signals across two high-dimensional data channels are partially aligned. These models are motivated by multi-modal learning and form the standard generative setting underlying Partial Least Squares (PLS), a widely used yet theoretically underdeveloped method. We show that the leading singular values of the sample cross-covariance matrix undergo a Baik-Ben Arous-Peche (BBP)-type phase transition, and we characterize the precise thresholds for the emergence of informative components. Our results yield the first sharp asymptotic description of the signal recovery capabilities of PLS in this setting, revealing a fundamental performance gap between PLS and the Bayes-optimal estimator. In particular, we identify the SNR and correlation regimes where PLS fails to recover any signal, despite detectability being possible in principle. These findings clarify the theoretical limits of PLS and provide guidance for the design of reliable multi-modal inference methods in high dimensions.
Source:https://arxiv.org/abs/2510.17561PreviousValidity of the Behrens--Fisher solutionNextNonparametric Bandits with Single-Index Rewards: Optimality and Adaptivity
Related posts
KeHoSu: Keyed Homoglyph Substitution for Authenticated Text Provenance over Copy-Paste Channels
0arXiv cs.CR
CANMentor: A Large-Small Model Collaboration Framework for CAN Bus Intrusion Detection
0arXiv cs.CR
Beyond Instruction Override: Benchmarking Indirect Prompt Injection with Task-Tampering Attacks
0arXiv cs.CR
A Gingerbread House for LLM Agents: Source-Planned Honeypots That Lure Autonomous Attackers into an Isolated Shadow
0arXiv cs.CR
JailBound: FOL-Guided Jailbreak Evaluation for Exploring LLM Behavioral Boundaries
0arXiv cs.CR
Breaking $\mathsf{TraintoDefend}$ via Adaptive Neuron Clustering in Cryptanalytic Model Extraction
0arXiv cs.CR