AI & ML
Linear Bandits on Ellipsoids: Minimax Optimal Algorithms
arXiv stat.ML0 views
arXiv:2502.17175v2 Announce Type: replace Abstract: We consider linear stochastic bandits where the set of actions is an ellipsoid. We provide the first known minimax optimal algorithm for this problem. We first derive a novel information-theoretic lower bound on the regret of any algorithm, which must be at least $\Omega(\min(d \sigma \sqrt{T} + d \|\theta\|_{A}, \|\theta\|_{A} T))$ where $d$ is the dimension, $T$ the time horizon, $\sigma^2$ the noise variance, $A$ a matrix defining the set of actions and $\theta$ the vector of unknown parameters. We then provide an algorithm whose regret matches this bound to a multiplicative universal constant. The algorithm is non-classical in the sense that it is not optimistic, and it is not a sampling algorithm. The main idea is to combine a novel sequential procedure to estimate $\|\theta\|$, followed by an explore-and-commit strategy informed by this estimate. The algorithm is highly computationally efficient, and a run requires only time $O(dT + d^2 \log(T/d) + d^3)$ and memory $O(d^2)$, in contrast with known optimistic algorithms, which are not implementable in polynomial time. We go beyond minimax optimality and show that our algorithm is locally asymptotically minimax optimal, a much stronger notion of optimality. We further provide numerical experiments to illustrate our theoretical findings.
Source:https://arxiv.org/abs/2502.17175PreviousIdentifying Drift, Diffusion, and Causal Structure from Temporal SnapshotsNextRobust Multimodal Learning via Entropy-Gated Contrastive Fusion
Related posts
W-2 vs 1099 Calculator: A Worked Offer Comparison for 2026
0dev.to

I tested ChatGPT's PDF Content Credentials: what survives a re-save, a print and an edit
0dev.to
I Built ResearchLens AI to Make Data Exploration and ML Benchmarking Easier
0dev.to
Fold Epic Paper Airplanes
0Hacker News
The Midterms Were a Pretty Good Sign for the Right-to-Repair Movement
0Wired
New Hulu Doc ‘Get Huge’ Shows the Deadly Toll of Looksmaxxing
0Wired