Database
LoCA: Local Credit Assignment for Reinforcement Learning of Autoregressive Flow-Matching TTS
arXiv cs.SD0 views
arXiv:2610.28035v1 Announce Type: new Abstract: Reinforcement learning can improve text-to-speech synthesis through feedback on generated speech. However, sentence-level rewards do not identify local errors, while signed regression updates can lead to excessive fitting or repulsion of sampled outputs. We propose LoCA (Local Credit Assignment) for autoregressive flow-matching text-to-speech. LoCA uses ASR-based text alignment to locate content errors in generated speech and redistribute sentence-level advantages across acoustic frames. To improve training stability, we introduce reference-relative positive and negative thresholds that limit continued fitting and repulsion. Experiments on VoxCPM2 show that LoCA reduces sample-weighted content error on a multilingual CV3 evaluation subset by 20.5% and 14.3% relative to the pretrained backbone and GROW, respectively, while improving speaker similarity. LoCA also improves content accuracy on the Seed-TTS-Eval hard subset. Ablation results support the contributions of local credit and threshold-based regression control.
Source:https://arxiv.org/abs/2610.28035PreviousAPRIL: Ambiguity-Aware Expert Routing for Respiratory Sound Domain-Incremental LearningNextSlots Are Not Speakers: Training-Free Speaker Linking for Frozen Streaming Diarizers
Related posts
7.7x Smaller and Encrypted at Rest: Compressing Symfony Messenger Payloads Without Touching a Handler
0dev.to Security
What does Supabase's Security Advisor not flag?
0dev.to Security
Postgres Major Upgrades Without Fear: A Practical Shadow-Testing Pipeline with pg_upgrade --check, pg_stat_statements and Query Diffing
0dev.to DevOps
Where macOS keeps Contacts, Calendar, Reminders, Safari tabs and Voice Memos, and how to read them from a backup
0dev.to
Build an Incremental ETL Pipeline in Python Using PostgreSQL Watermarks
0dev.to
Your Stripe inbox prevents duplicate updates. What about duplicate emails?
0dev.to C#