Backend
Oracle-Efficient and Parameter-Free Agnostic Smoothed Online Learning
arXiv stat.ML0 views
arXiv:2610.10499v1 Announce Type: cross Abstract: Online learning is an attractive framework in many domains because it permits well-defined learning even when data are dependent or chosen adversarially. This generality, however, comes at a steep price, introducing significant statistical and computational barriers. Recently, smoothed online learning has emerged as a promising framework that interpolates between the fully adversarial and fully stochastic settings by assuming that the conditional law of each covariate has density at most $1/\sigma$ with respect to some fixed base measure $\mu$, and it is known to match the statistical and computational guarantees of classical learning while still allowing for much of the flexibility of online learning. However, existing oracle-efficient algorithms require either (i) sampling access to the base measure $\mu$ or (ii) labels that are perfectly predicted by a fixed hypothesis. Both assumptions limit the applicability of these algorithms, in contrast to statistical learning, where empirical risk minimization (ERM) learns efficiently in the agnostic setting without any knowledge of the data distribution. We show that neither assumption is necessary, giving the first oracle-efficient algorithm that achieves sublinear regret in the agnostic setting without knowledge of $\mu$. Our algorithm, based on Gaussian Follow-The-Perturbed-Leader, is parameter-free: it requires no knowledge of $\mu$, the smoothing parameter $\sigma$, or the horizon $T$, and it achieves regret $\widetilde O(d\sqrt{T/\sigma})$ for binary classes of VC dimension $d$ with a single call to an ERM oracle per round, which is optimal up to a $\sqrt{d}$ factor. En route to establishing the regret bound, we introduce several new techniques that may be of independent interest.
Source:https://arxiv.org/abs/2610.10499PreviousTraining Parallel Speculative Draft Models by Directly Minimizing Expected Decoding RoundsNextMultiparameter Uncertainty Mapping in Quantitative Molecular MRI using a Physics-Structured Variational Autoencoder (PS-VAE)
Related posts

Dr Amr Eloufy: How to Save Our Hair in This Fast-Moving World
0dev.to Watercooler
Only 6 of 45 Odds APIs Cover All 8 Big US Sportsbooks
0dev.to Data
Hadoop Ecosystem Overview
0dev.to Data
From One Chargeback to a Fraud Ring: Building Link Analysis That Works
0dev.to Data

Choosing the right AI web scraper depends on your needs, budget, and technical skills. This guide makes comparing the top tools easier and helps you find the right fit for your next project.
0dev.to Discuss

Choosing the right AI web scraper depends on your needs, budget, and technical skills. This comparison makes it easier to understand which tools are worth trying, from no-code options to developer-foc
0dev.to Discuss