AI & ML
Minimaxity in Robust Nonparametric Regression: from Heavy-Tailed to Sub-Gaussian Assumptions
arXiv stat.TH0 views
arXiv:2611.17744v1 Announce Type: new Abstract: We study nonparametric regression over star-shaped function classes under strong adversarial contamination. The clean (original) observations $(\tilde{X} _{i},\tilde{Y} _{i})_{i=1} ^{n}$ are i.i.d. and satisfy $\tilde{Y} _{i}=f ^{*}(\tilde{X} _{i})+\xi _{i}$, where $f ^{*}\in \mathcal{F}$, $\tilde{X}$ is distributed as $\mathbb{P} _{X}$, and the noise is conditionally centered. An adversary may inspect the clean sample and replace at most $\lfloor \epsilon n\rfloor$ observation pairs. We assume that $\mathcal{F}\subset L _{2}(\mathbb{P} _{X})$ is star-shaped with finite diameter $d$. Under a Bernstein-type moment condition on function increments and a bounded conditional second moment for the noise, we establish the matching lower and upper bounds of order $\left((\eta ^{*}) ^{2} \vee \epsilon \right)\wedge d ^{2}$, uniformly over admissible star-shaped function classes, therefore characterizing the minimax rate of estimation error, where \begin{equation*} \eta ^{*}:=\sup\left\{\eta >0: n\eta^2\leq\log \mathcal M _{\mathcal{F}}^{\text{loc}}(\eta,c)\right\}. \end{equation*} Here $\log \mathcal{M} _{\mathcal{F}} ^{\text{loc}}(\eta,c)$ denotes the local metric entropy of $\mathcal{F}$ in $L _2(\mathbb{P} _{X})$, and $c$ is a sufficiently large constant. Under a uniform relative sub-Gaussian condition on function increments and noise, the lower bound is adjusted to $\left((\eta ^{*})^{2}\vee \epsilon ^{2}\right)\wedge d ^{2}$ while the upper bound improves to $\left((\eta ^{*})^{2}\vee \epsilon ^{2}\log ^{2}\left(\frac{e}{\epsilon }\right)\right)\wedge d ^{2}$, yielding minimax optimality up to logarithmic factors.
Source:https://arxiv.org/abs/2611.17744PreviousFederated Vector Retrieval across Heterogeneous VectorDBsNextHigh-Dimensional Gaussian and Bootstrap Approximation: Near $1/\sqrt{n}$ Rates with General Covariance
Related posts
In which John becomes a Machine Learning researcher
0Hacker News New
Can We Fix AI?
0Hacker News New
I'm Glad That Literary Awards Are Going to AI
0Hacker News New
Show HN: TalentRadar – 3D geospatial tech compensation and role radar
0Hacker News Show
Show HN: Brief2mp4 – ClaudeCode/Codex skill that checks videos against the brief
0Hacker News Show
Show HN: Figma Like AI Landing Page Builder
0Hacker News Show