AI & ML
Minimaxity in Robust Nonparametric Regression: from Heavy-Tailed to Sub-Gaussian Assumptions
arXiv stat.TH0 views
arXiv:2611.17744v1 Announce Type: new Abstract: We study nonparametric regression over star-shaped function classes under strong adversarial contamination. The clean (original) observations $(\tilde{X} _{i},\tilde{Y} _{i})_{i=1} ^{n}$ are i.i.d. and satisfy $\tilde{Y} _{i}=f ^{*}(\tilde{X} _{i})+\xi _{i}$, where $f ^{*}\in \mathcal{F}$, $\tilde{X}$ is distributed as $\mathbb{P} _{X}$, and the noise is conditionally centered. An adversary may inspect the clean sample and replace at most $\lfloor \epsilon n\rfloor$ observation pairs. We assume that $\mathcal{F}\subset L _{2}(\mathbb{P} _{X})$ is star-shaped with finite diameter $d$. Under a Bernstein-type moment condition on function increments and a bounded conditional second moment for the noise, we establish the matching lower and upper bounds of order $\left((\eta ^{*}) ^{2} \vee \epsilon \right)\wedge d ^{2}$, uniformly over admissible star-shaped function classes, therefore characterizing the minimax rate of estimation error, where \begin{equation*} \eta ^{*}:=\sup\left\{\eta >0: n\eta^2\leq\log \mathcal M _{\mathcal{F}}^{\text{loc}}(\eta,c)\right\}. \end{equation*} Here $\log \mathcal{M} _{\mathcal{F}} ^{\text{loc}}(\eta,c)$ denotes the local metric entropy of $\mathcal{F}$ in $L _2(\mathbb{P} _{X})$, and $c$ is a sufficiently large constant. Under a uniform relative sub-Gaussian condition on function increments and noise, the lower bound is adjusted to $\left((\eta ^{*})^{2}\vee \epsilon ^{2}\right)\wedge d ^{2}$ while the upper bound improves to $\left((\eta ^{*})^{2}\vee \epsilon ^{2}\log ^{2}\left(\frac{e}{\epsilon }\right)\right)\wedge d ^{2}$, yielding minimax optimality up to logarithmic factors.
Source:https://arxiv.org/abs/2611.17744PreviousFederated Vector Retrieval across Heterogeneous VectorDBsNextHigh-Dimensional Gaussian and Bootstrap Approximation: Near $1/\sqrt{n}$ Rates with General Covariance
Related posts

94% of Singapore Small Business Owners Surveyed Say More AI Guidance Is Needed
0Meta Newsroom
Nashville, Tennessee Real Estate Dataset: 7,436 Listings, Excel File (Nov 10, 2026)
0dev.to Data
A Hundred and Eighty Six Thousand Pounds of Stock Had Left One Branch and Never Arrived at Another
0dev.to Data
Đánh giá thông số 20 tiền đạo xuất sắc nhất bóng đá châu Âu thế kỷ 21 từ BBC Sport
0dev.to Data
Thống Kê SHB Đà Nẵng: Bài Toán Phòng Ngự Chờ HLV Lee Young-jin Hóa Giải
0dev.to Data
Alibaba's Qwen4-Max Is Here — and It's Gunning for Claude's Coding Crown
0dev.to News