AI & ML
Nonparametric Bandits with Single-Index Rewards: Optimality and Adaptivity
arXiv stat.TH0 views
arXiv:2512.24669v2 Announce Type: replace Abstract: Contextual bandits are a central framework for sequential decision-making, with applications ranging from recommendation systems to clinical trials. While nonparametric methods can flexibly model complex reward structures, they suffer from the curse of dimensionality. We address this challenge using a single-index model, which projects high-dimensional covariates onto a one-dimensional subspace while preserving nonparametric flexibility. We first develop a nonasymptotic theory for offline single-index regression for each arm, combining maximum rank correlation for index estimation with local polynomial regression. Building on this foundation, we propose a single-index bandit algorithm and establish its convergence rate. We further derive a matching lower bound, showing that the algorithm achieves minimax-optimal regret independent of the ambient dimension $d$, thereby overcoming the curse of dimensionality. We also establish an impossibility result for adaptation: without additional assumptions, no policy can adapt to unknown smoothness levels. Under a standard self-similarity condition, however, we construct a policy that remains minimax-optimal while automatically adapting to the unknown smoothness. Finally, as the dimension $d$ increases, our algorithm continues to achieve minimax-optimal regret, revealing a phase transition that characterizes the fundamental limits of single-index bandit learning.
Source:https://arxiv.org/abs/2512.24669PreviousSpectral Thresholds in Correlated Spiked Models and Fundamental Limits of Partial Least SquaresNextSecond-order PACF asymptotics and discrimination between fractional Gaussian noise and $\FARIMA(0,d,0)$
Related posts
Why can't my AI agent use mobile apps?
0dev.to AI
24 KI-Agenten für einen Film – und was das über das Sehenlernen verrät
0dev.to AI
How AI Agent Memory Architectures Split Working Memory from Episodic Storage
0dev.to AI
Your Page Listened for Messages From the Checkout Frame and Took Them From Any Window
0dev.to Security
Field report: 20359 real pull requests scanned, 6.5% flagged, 46 of our own mistakes fixed in public
0dev.to DevOps
Evaluating API Portals for Autonomous Agents: Schemas, Perks, and Registry Data
0dev.to DevOps