AI & ML
Region-Aware Masking for Accent-Robust Cross-Lingual Text-to-Speech
arXiv eess.AS0 views
arXiv:2610.07524v1 Announce Type: new Abstract: Accent leakage remains a critical challenge in cross-lingual zero-shot text-to-speech (TTS), where models inadvertently transfer both the speaker's timbre and source-language accent into the target-language output. In mask-reconstruction TTS this is amplified by a train--inference mismatch: training reconstructs from same-language context, while inference conditions on cross-lingual context. We close this gap by concatenating utterances from two languages and placing the reconstruction mask relative to the language boundary, so training presents the cross-lingual prompting pattern the model encounters at inference. This requires no language IDs, accent labels, parallel same-speaker recordings, or architectural changes---only the mask geometry differs. In a listening study with native speakers, region-aware masking reduces perceived accent from 4.3 to 0.5 on a 0-5 scale against the unadapted baseline, and by 18-51\% in seen regimes and 35-55\% on unseen source languages against bilingual adaptation alone, with no measurable loss in intelligibility or naturalness. Comparing mask geometries shows that placement, not the amount masked, governs the balance between accent suppression and speaker preservation: masks confined to the reconstruction region suppress accent most but retain the reference speaker least reliably, whereas two-region masking achieves both. Mask geometry is thus a simple, effective lever for accent robustness.
Source:https://arxiv.org/abs/2610.07524PreviousTRACE-EVC: Text-Guided Relative Affective Control for Zero-Shot Emotional Voice ConversionNextA Novel Sentence Stress Detection Framework Leveraging Auxiliary Word-Stress Modeling and Loss Optimization
Related posts

Making Local LLMs Usable on 8GB GPUs
0HackerNoon

Educational Byte: What Are Synthetic Tokens in Crypto Networks?
0HackerNoon
Your AI Assistant Is Waiting Around - An AI Agent Goes to Work
0HackerNoon
Your AI Agent's Memory Needs Two Clocks
0HackerNoon
The Online Right’s Closing Campaign Argument: Fascist Anakin Skywalker Memes
0Wired

Apple is ‘not able to predict’ when it’ll have enough iPhone Duos to go around
0The Verge