AI & ML
Sample complexity of weak-signal latent-variable models
arXiv stat.TH0 views
arXiv:2610.24770v1 Announce Type: new Abstract: We study parametric estimation in latent-variable models in the weak-signal regime, where a small signal-strength parameter $\beta$ controls the dependence of the observations on the unknown parameter. At $\beta=0$, this dependence disappears, so all parameter values induce the same observed distribution, which we call the null law. We develop a unified framework for analyzing sample complexity in the weak-signal regime by expanding the likelihood ratio around this shared null law in powers of $\beta$. We prove that if the unknown parameter is first globally identifiable at order $r$ in this expansion, then estimation to fixed accuracy requires at least on the order of $\beta^{-2r}$ samples. We further identify a likelihood-separation stability condition that is necessary for any estimator to attain this rate and, under mild regularity conditions, sufficient for both maximum likelihood and method-of-moments estimators to attain it. We also study the regime in which the target accuracy vanishes together with the signal strength, and show that global localization and local refinement may be governed by different likelihood orders, leading to distinct statistical scales. Finally, we apply our framework to broad classes of algebraically structured latent-variable models, including additive-noise channels and exponential-family models.
Source:https://arxiv.org/abs/2610.24770PreviousMinimax Slope Estimation and Support Recovery under Weak Gaussian SelectionNextDimension-free comparison inequalities between $f$-divergences for Gaussian location mixtures
Related posts
Introducing the Grid Protectors Program
0OpenAI Blog
The world has a new plan to save nature, but it still needs the money
0Ars Technica

Could data center backlash flip Florida?
0The Verge

Vivo’s first Pro Max phone proves its Ultra is still in a league of its own
0The Verge

Why Peacock is making a huge bet on YouTube
0The Verge
Ninja’s first-ever microwave just replaced two of my kitchen appliances at once
0TechCrunch