AI & ML
Online Budget Allocation with Censored Semi-Bandit Feedback
arXiv stat.ML0 views
arXiv:2508.05844v3 Announce Type: replace-cross Abstract: We study a stochastic budget-allocation problem over $K$ tasks. At each round $t$, the learner chooses an allocation $X_t \in \Delta_K$. Task $k$ succeeds with probability $F_k(X_{t,k})$, where $F_1,\dots,F_K$ are nondecreasing budget-to-success curves, and upon success yields a random reward with unknown mean $\mu_k$. The learner observes which tasks succeed, and observes a task's reward only upon success (censored semi-bandit feedback). This model captures, for instance, splitting payments across crowdsourcing workers or distributing bids across simultaneous auctions, and subsumes stochastic multi-armed bandits and semi-bandits. We design an optimism-based algorithm that operates under censored semi-bandit feedback and assumes access to an exact maximization oracle. Our main result is an instance-dependent bound showing that in diminishing-returns regimes, the regret of this algorithm scales polylogarithmically with the horizon $T$ without any ad hoc tuning. For general nondecreasing curves, we prove that the same algorithm (with the same tuning) achieves a worst-case regret upper bound of $\tilde O(K\sqrt{T})$. Finally, we establish a matching worst-case regret lower bound of $\Omega(K\sqrt{T})$ that holds even for full-feedback algorithms, highlighting the intrinsic hardness of our problem outside diminishing returns.
Source:https://arxiv.org/abs/2508.05844PreviousImplicit Regularization via Spectral Neural Networks and Non-linear Matrix SensingNextGreedy Alignment Principle for Optimizer Hyperparameter Selection
Related posts
ASUS Launches New Zenbook 14 in India With Ceraluminum Design and OLED Display
0FOSS Bytes
TOP BEARINGS SRL conduce în Intermedieri produse diverse Argeș
0dev.to Data
How a Daily Silver Benchmark Is Computed (And Why Unit Conversion Is the Hard Part)
0dev.to Data
Lakewood Shooting: One Police Officer Killed, Three Wounded in Colorado
0dev.to News
OpenAI: Images 2.6, GIF e Workspace
0dev.to News
How to Plan a Healthtech Product Video Without Sounding Like a Brochure
0dev.to Design