AI & ML
Detection Is Harder Than Estimation in Certain Regimes: Inference for Moment and Cumulant Tensors
arXiv stat.TH0 views
arXiv:2603.26029v3 Announce Type: replace Abstract: We study estimation and detection of high-order cumulant tensors from $n$ i.i.d. observations of a $p$-dimensional random vector, with performance measured in the tensor spectral norm. Under sub-Gaussianity, we show that the minimax rate for estimating the order-$d$ cumulant tensor is $\sqrt{p/n}\wedge 1$. In contrast to covariance estimation, the natural plug-in estimator obtained by replacing population moments in the moment--cumulant formula with sample moments, which we call the sample cumulant tensor, is generally not rate-optimal for $d\ge 3$, and we construct an estimator that attains the minimax rate. On the computational side, we study testing whether the $d$-th order cumulant tensor vanishes after whitening. We provide evidence, under a model-specific low-degree conjecture, that detection is computationally hard when $n\ll p^{d/2}$. At the same time, we identify a regime in which an efficiently computable estimator achieves error smaller than the separation at which polynomial-time tests can reliably distinguish the null from the alternative under the same conjecture. This reveals an unusual reverse detection--estimation gap: computationally efficient detection can be harder than computationally efficient estimation. The underlying reason is that the relevant loss, tensor spectral norm, is itself NP-hard to compute, creating a new form of computational--statistical gap.
Source:https://arxiv.org/abs/2603.26029PreviousTesting for genetic interactions in complex disease with distance correlationNextDebiased parametric inference for regime-switching jump diffusions with infinite variation jumps
Related posts
LifeVal
0OpenAI Blog
Claude’s new rules against game cloning won’t stop the AI copying boom
0Ars Technica

OpenAI pitches data center power plants as a way to protect nearby areas
0The Verge

Anthropic clamps down on Claude’s AI video game clones
0The Verge
Readwise takes on Amazon’s Kindle and Goodreads with its new app for book lovers
0TechCrunch
Five regression tests for channel-aware AI reply drafts
0dev.to