General
Low-degree polynomials lower bounds for clustering in small dimension
arXiv stat.ML0 views
arXiv:2610.37272v1 Announce Type: new Abstract: We study the computational limits of clustering $n$ observations drawn from a mixture of $K$ isotropic distributions in $\mathbb R^d$, in the regime where the number $K$ of groups is much larger than the dimension $d$. In this regime, tensor-based procedures recover the partition with a polylogarithmic separation between the centers, but they require a sample size that is a large and non-explicit polynomial of $dK$, whereas the existing low-degree lower bounds only show that $n$ must be larger than $dK^2$. We introduce a mixture of $2K$ product Bernoulli distributions on $\{0,1\}^d$, with $K=(d+1)^m$, whose centers are built from a dual BCH code. This construction ensures that the moment tensors of the observations coincide with those of the uniform distribution on $\{-1,1\}^d$ up to the order $2m+1$. For any fixed $m$, we establish a low-degree polynomial lower bound showing that clustering is hard as long as the separation $\Delta$ satisfies $\Delta^2\ll(K^2d^{3/2}/n)^{1/(2m+2)}\wedge\sqrt d$, up to polylogarithmic factors. In particular, with a polylogarithmic separation, low-degree polynomials require $n\gtrsim K^2d^{3/2}$ observations, up to polylogarithmic factors. Through a Gaussianization argument, this hardness carries over, in the sense of reductions, to isotropic Gaussian mixtures. Our proof relies on a family of polynomials of the observations, indexed by bipartite graphs, which is almost orthonormal. The moments of these polynomials are governed by the number of solutions of polynomial systems over the finite field $\mathbb F\_{d+1}$ that are induced by the BCH code, and the crux of our analysis is to connect the combinatorial structure of the bipartite graphs with the structure of the solution sets of these systems.
Source:https://arxiv.org/abs/2610.37272PreviousDoubly Robust Deep Kernel Tests for Structured OutcomesNextAn end-to-end framework for uncertainty-aware validation of generative models
Related posts

Creality K3 Review: It’s a Tool Changer, not a game changer
0Tom's Hardware

72 Blog Posts To Learn About Minio
0HackerNoon
Asus ROG Rapture GT-BN98 Pro Review: Welcome to Wi-Fi 8
0Wired

Squarespace is laying off 19 percent of employees
0The Verge
Moving our warehouse off DuckDB
0Hacker News
Show HN: VHS Camera – Run your camera or videos through a simulated VHS signal
0Hacker News