AI & ML
Optimal Learning in Games with Arbitrary Delays: Best-of-Both-Worlds for Self-Play and Adversarial Opponents
arXiv stat.ML0 views
arXiv:2611.07773v1 Announce Type: cross Abstract: We study learning in zero-sum games with delayed feedback. We introduce Multi-Anchor Optimistic Online Mirror Descent (MAO-OMD), a single algorithm which obtains optimal fast rates in self-play on smooth games, while simultaneously maintaining minimax optimal guarantees against arbitrary opponents. In particular, in smooth zero-sum games with arbitrary and unknown feedback delays, MAO-OMD obtains $O(\sigma_{\max}+1)$ social and individual regrets when used by both players, where $\sigma_{\max}$ denotes the maximum number of outstanding gradients, while also guaranteeing minimax optimal $O(\sqrt{T+d_{\mathrm{tot}}})$ individual regret against arbitrary opponents, where $d_{\mathrm{tot}}$ is the total delay. Moreover, we show that these optimal rates cannot be obtained simultaneously using the standard black-box reduction to the undelayed setting. We also extend our results to multi-player games, and to games with player-dependent delay sequences.
Source:https://arxiv.org/abs/2611.07773PreviousIdentification and Bounding of Joint Expectation over Potential OutcomesNextDoubly-robust causal inference for multi-valued treatment regimes with recurrent neural networks
Related posts
Why Senior Engineers Are Mostly Professional Code Deleters
0dev.to

AWS Puts the Region Inside the AS Path on Direct Connect
0dev.to AWS
How Much Does an OTT Platform Really Cost? Start With Two Budgets
0dev.to WebDev

Real Estate API MCP: One Dubai Property Search Costs an AI Agent 17,000 Tokens
0dev.to Python
Inter-AI Morality: How AI Systems Treat One Another [pdf]
0Hacker News New
Solar plane soars to 47,600 ft, on target to fly 100 hours
0Hacker News New