AI & ML
Route-DMD: Distribution Matching Distillation with Task-Routed Mechanism for Speech Foundation Models
arXiv cs.SD0 views
arXiv:2611.08011v1 Announce Type: new Abstract: Speech foundation models built on flow matching handle generation, editing, and processing in one system, but every request costs 20-50 iterative steps, and classifier-free guidance (CFG) doubles each of them. Distribution matching distillation (DMD) trains a student that approaches the teacher's quality in a few steps, yet existing speech distillation work applies it to generation alone. We show that a distribution-matching objective does not serve every task: in separation, the noised states of erroneous student outputs deviate far from the teacher's training distribution, where its prediction is unreliable. Route-DMD therefore makes the objective task-dependent, routing the affected tasks to a regression loss and keeping decoupled distribution matching elsewhere. The student is initialized by consistency distillation, and teacher rollouts use adaptive projected guidance (APG) instead of CFG. Without CFG, the 4-step student matches the 32-step teacher on generation, editing, and processing tasks at a 4.5$\times$ end-to-end speedup.
Source:https://arxiv.org/abs/2611.08011PreviousProCraft: Instruction-Driven Music Production from Free-Form TextNextVoxCanvas-41M: A Large-Scale Bilingual Dataset for Instruction-Based Speech Editing and Its Learning Dynamics
Related posts
Stripe doesn't open accounts in 37 of the 85 countries we checked. Here are the legal ways to get paid anyway
0dev.to
Do AI Models Care About Each Other? Anthropic's Multi-Agent Welfare Study Says Yes — With a Catch
0dev.to
Building VARYN: Why Permission Boundaries Matter More Than Another AI API Call
0dev.to
App Store 2026 in numbers: AI, pricing, abandoned apps
0Hacker News
ASUS Launches New Zenbook 14 in India With Ceraluminum Design and OLED Display
0FOSS Bytes
TOP BEARINGS SRL conduce în Intermedieri produse diverse Argeș
0dev.to Data