Frontend
Information-Theoretic Limits for Rectangular Spiked Matrix Models with Rotationally Invariant Noise
arXiv stat.TH0 views
arXiv:2610.16797v1 Announce Type: cross Abstract: We study the information-theoretic limits of inference in rectangular rank-one spiked matrix models with additive rotationally invariant noise, thereby going beyond the standard assumption of independent noise entries. Using the replica method from statistical physics, we derive a variational formula for the mutual information between the signal and the data, together with a system of saddle point equations predicting the minimum mean squared error in estimating the rank-one spike. We further show that, in the Bayes-optimal setting, these saddle point equations coincide with the fixed point equations of the state evolution of a recently proposed orthogonal approximate message passing algorithm with Bayes-optimal denoisers. This equivalence provides an algorithmic interpretation of the replica prediction and supports the Bayes-optimality of orthogonal approximate message passing whenever the relevant fixed point is unique. Numerical evaluations of the saddle point equations for several rotationally invariant noise ensembles and signal priors, together with finite-size simulations of the algorithm, confirm the asymptotic predictions. They illustrate both regimes with a unique informative fixed point, where orthogonal approximate message passing is predicted to attain the minimum mean squared error, and regimes with multiple fixed points, where a statistical-to-computational gap exists.
Source:https://arxiv.org/abs/2610.16797PreviousEstimators from Convex Geometries of the SimplexNextPathwise Shrinkage and Probabilistic Calibration of the Multiplicative Half-Cauchy Process
Related posts
How to Audit 1,000 Pages for Accessibility and SEO in One Run
0dev.to

Another way to say ensure in code reviews, docs and PR descriptions
0dev.to
A marketplace comparison should explain what its price includes
0dev.to Data
Filtering Clients Is the Hidden Time-Killer for Freelancers
0dev.to Discuss
Mastering INP: How We Achieved Sub-10ms Input Latency Across 30 Reactive Web Tools
0dev.to JavaScript
![Why Object.keys(user) Returns string[], Not (keyof User)[]: TypeScript Means It](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F2q4w48b9bzs43tynyhsf.png)
Why Object.keys(user) Returns string[], Not (keyof User)[]: TypeScript Means It
0dev.to JavaScript