AI & ML
Cancellation-Free Constrained SquareCB for Safe Controller Selection
arXiv stat.ML0 views
arXiv:2611.21880v1 Announce Type: cross Abstract: We study constrained contextual bandits, in which a learner chooses one of $K$ actions in each round to minimize loss while keeping the expected cost of its play below a budget. Existing reductions to online regression weight the cost by a Lagrange multiplier learned from past constraint residuals, so slack in some rounds can offset violations in others. We instead run SquareCB proposed in \citep{foster2020beyond} with a rectified weight on the cost: it is zero when the estimated cost is within the budget, and otherwise just large enough to bring it back to the budget. Under realizability and Slater's condition with margin $\delta$, the algorithm attains regret $O(\sqrt{KT\,\mathrm{Reg}_{\mathsf{Sq}}(T)}/\delta)$ and cancellation-free violation $\sum_t(V_c^{p_t}-b)^+=O(\sqrt{KT\,\mathrm{Reg}_{\mathsf{Sq}}(T)})$, where $\mathrm{Reg}_{\mathsf{Sq}}$ is the error of the regression oracle. The same bounds hold when the budget must be met in every context, potentially adversarially chosen contexts. In controller selection for a safe-control-gym quadrotor and a BOPTEST building, the violation is 6 to 9 times lower than that of primal-dual and virtual-queue baselines, with a lower or comparable regret.
Source:https://arxiv.org/abs/2611.21880PreviousAdaptive Memory for Online Reinforcement Learning under Sparse Model ChangesNextDEFTS: Data-Efficient, Training-Free Few-Shot Learning for CLIP in the Text Subspace
Related posts

Do cybersecurity certifications raise pay? Postings that name one advertise 13.8% less (Nov 2026)
0dev.to Security
Ninety Days Became Thirty: What the Disclosure Deadline Collapse Actually Teaches
0dev.to Security

Make your voice count in the State of Observability & Reliability report
0dev.to DevOps
config init container for Nsigth Command
0dev.to Docker

Anthropic IPO is set to redraw VC power rankings, with lesser-known firms like Spark Capital poised for outsized returns compared with larger, blue-chip rivals (George Hammond/Financial Times)
0Techmeme

A Gallup survey of 15,925 people aged 15 to 22 across 16 countries finds that more than 33% rely on AI for companionship, rising to 50% among daily AI users (Jason Parham/Wired)
0Techmeme