AI & ML
Unified Shared Encoder in Spoof-Aware Speaker Verification with Hybrid Wavelet Prompt Tuning
arXiv cs.SD0 views
arXiv:2610.08845v1 Announce Type: cross Abstract: Spoofing-aware speaker verification (SASV) must confirm who is speaking and that the speech is genuine, but current systems gain one at the expense of the other. Modular cascades are accurate yet run two large self-supervised encoders, whereas end-to-end models are efficient but lose accuracy when a single embedding has to serve two conflicting objectives. We show that this trade-off between efficiency and specialization is avoidable. A single frozen W2V-BERT~2.0 backbone is adapted per task by deep hybrid Wavelet Prompt Tuning (WPT), so each branch obtains its own view of the shared encoder through dedicated prompts and a task head, and the scores are combined only at inference. Training only about 7M parameters, a small fraction of those a strong two-encoder cascade requires, the system surpasses it on SpoofCeleb evaluation with 0.03% CM-EER and 0.038 min a-DCF against 0.16% and 0.047. Because the backbone is shared and frozen, new branches attach without retraining the heads and prompts already in place. On ASVspoof5, with adversarial attacks and codec distortions, it reaches 0.092 min a-DCF and 3.60% CM-EER using only the provided data, indicating that the design holds under realistic in-the-wild threats.
Source:https://arxiv.org/abs/2610.08845PreviousUZH-CL at ArA-DF 2026: Prompt-Tuned Foundation Models and Track-Adaptive Score Fusion for Arabic Speech Deepfake DetectionNextSteering Follows Geometry, Not Labels: Emotion Directions in a Full-Duplex Speech Model
Related posts
Ask HN: What hardware are you using to run local LLMs?
0Hacker News Ask
Codeberg Is Unusable
0Hacker News Ask
Ask HN: Are you using AI for company messaging?
0Hacker News Ask
Ask HN: Will Copilot Code replace developers building custom internal tools?
0Hacker News Ask
Ask HN: Who wants to be hired? (November 2026)
0Hacker News Ask
Heated mirror reveals hidden 3D patterns in rising air near a wall
0Phys.org Tech