AI & ML
Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learning
arXiv cs.MA0 views
arXiv:2610.12593v1 Announce Type: cross Abstract: The continued improvement of large language models increasingly depends on synthetic experience, yet effective data synthesis for interactive agents requires not only executable and verifiable trajectories, but also interactions that provide learning value for the current task agent. Existing methods increasingly incorporate environment feedback, data validation, or learner failures, but still face a feedback-to-decision gap: observed weaknesses do not directly specify how future synthesis should change, or whether they can be represented by the current synthesis space. To address this gap, we propose EvoSyn, a learning-feedback-driven multi-agent framework that organizes synthesis around a revisable state specifying what interaction factors can be deliberately generated and where synthesis effort should be allocated. A role-specialized multi-agent system translates learner feedback into synthesis revisions, while a Designer allocates synthesis directions and a Planner grounds them into executable experience. This process enables within-space adaptation toward weak or under-covered regions and synthesis-space expansion that promotes newly discovered factors into explicit generation controls. Experiments on $\tau^2$-Bench and CAR-Bench show that EvoSyn improves average task success by 13.3 points over the strongest synthesis baseline, while producing higher-quality and structurally broader synthetic experience and discovering controllable factors missed without learner feedback.
Source:https://arxiv.org/abs/2610.12593PreviousAsk Your Advisor: Learning When to Consult Stronger Models in Agentic SystemsNextReward Hacking as a Transmissible Strategy in Multi-Agent Coding Systems
Related posts
SaaS Partner Scout: A Script for Identifying GitHub SaaS Project Contributors
0dev.to GitHub
WARN Act and Retaliation — Can Your Employer Punish You for Asking About a Layoff Notice?
0dev.to Data
WARN Act and Mental Health: What a Layoff Notice Does to Your Wellbeing, and Where to Get Support
0dev.to Data
Dimensionare un pallettizzatore dal lato del progettista: i tre numeri che non stanno nelle brochure
0dev.to Design
How to Choose the Best Stretch Tent Supplier for Your Next Purchase
0dev.to Design
How to spend three slow days in a city you have never visited
0dev.to Productivity