AI & ML
The Statistical Benefits of Multiple Responses for Learning from Demonstrations
arXiv stat.TH0 views
arXiv:2609.33291v2 Announce Type: replace-cross Abstract: Many generative systems return multiple candidate responses and are evaluated according to the best one. Recent work shows that, when demonstrations are optimal, pass@$k$ can reduce the sample complexity of learning from demonstrations by a logarithmic factor in $k$. We ask what happens when the demonstrator is not assumed to be optimal. We find that multiple responses provide a qualitatively stronger benefit in this setting. In a finite reward-class model with no reward feedback, moving from pass@$1$ to any pass@$k$ with $k\ge2$ changes the worst-case dependence on target accuracy from $1/\varepsilon^2$ to $1/\varepsilon$, uniformly over demonstrator quality. Under standard evaluation, where an unknown reward is fixed before training, increasing $k$ provides an additional and distinct benefit: the optimal dependence on a reward class of size $N$ improves from $\log N$ to $\log N/\log k$. We further show that these two effects can be separated. Under robust evaluation, where one learned policy must compete with the demonstrator simultaneously for every reward in the class, the fast $1/\varepsilon$ dependence persists, while the $1/\log k$ improvement can disappear. We establish matching upper and lower bounds in the corresponding regimes and give a greedy multiplicative-weights learner achieving the upper bounds without any assumption on demonstrator quality.
Source:https://arxiv.org/abs/2609.33291PreviousSimulation Based Inference of a Simple Neural Network StructureNextCLASHarness: Benchmarking Multi-Agent Conflict in Computer Use via a Controllable and Verifiable Generation Pipeline
Related posts
Most voted crypto projects on Coinvote, Oct 26 to Nov 1, 2026
0dev.to Data
Bluesky This Week — trending topics & AI brand mentions (2026-11-02)
0dev.to Data
Gemini 4 Carbon e DeepSeek V4.1 Flash Cyber: a Guerra Cibernética Autônoma e o Topo do Artificial Analysis
0dev.to Machine Learning
What can an AI agent do for you every day?
0dev.to Machine Learning
Mon modèle de paris semblait excellent sur 3 671 prédictions. Il n'a jamais battu le bookmaker.
0dev.to Machine Learning
HR manager LinkedIn About section examples you can adapt
0dev.to Career