AI & ML
Route-DMD: Distribution Matching Distillation with Task-Routed Mechanism for Speech Foundation Models
arXiv cs.SD0 views
arXiv:2611.08011v1 Announce Type: new Abstract: Speech foundation models built on flow matching handle generation, editing, and processing in one system, but every request costs 20-50 iterative steps, and classifier-free guidance (CFG) doubles each of them. Distribution matching distillation (DMD) trains a student that approaches the teacher's quality in a few steps, yet existing speech distillation work applies it to generation alone. We show that a distribution-matching objective does not serve every task: in separation, the noised states of erroneous student outputs deviate far from the teacher's training distribution, where its prediction is unreliable. Route-DMD therefore makes the objective task-dependent, routing the affected tasks to a regression loss and keeping decoupled distribution matching elsewhere. The student is initialized by consistency distillation, and teacher rollouts use adaptive projected guidance (APG) instead of CFG. Without CFG, the 4-step student matches the 32-step teacher on generation, editing, and processing tasks at a 4.5$\times$ end-to-end speedup.
Source:https://arxiv.org/abs/2611.08011PreviousProCraft: Instruction-Driven Music Production from Free-Form TextNextVoxCanvas-41M: A Large-Scale Bilingual Dataset for Instruction-Based Speech Editing and Its Learning Dynamics
Related posts
KapX is a groundbreaking mobility and orientation aid
0Hacker News New
A 3-Line Torus Geometry Proof Wrecked OpenAI's $100B Biotech Venture
0Hacker News New
Show HN: aiport – A self-improving local LLM gateway for the erratic vibe coder
0Hacker News Show
Show HN: Shutdown Watch – App shutdowns, export deadlines, and alternatives
0Hacker News Show
Show HN: Neural Network Formal Verification
0Hacker News Show
Show HN: AIDA – agentic generated user guides
0Hacker News Show