AI & ML
What Do Deepfake Audio Detectors Hear? From Self-Supervised Models to Audio LLMs
arXiv cs.SD0 views
arXiv:2610.17617v1 Announce Type: new Abstract: Real-world audio recordings for deepfake detection rarely consist solely of speech; they often are mixtures of speech and background events that themselves may also be synthetic. When processing these mixtures, it remains unclear whether detectors attend to the speech or the background event, and where their spectral evidence lies. We study this on the CompSpoof V2 database, whose mixtures pair independently real-or-fake speech and event components. Our results show that all systems detect fake events more accurately than fake speech. However, this performance gap is largely driven by poor generalization to an unseen fake speech domain, rather than a true difference in difficulty. Furthermore, sub-band probing reveals that the front-end encoder dictates where a countermeasure focuses its frequency evidence. To enable reliable deployment in real-world scenarios, future countermeasures should address out-of-domain generalization failures and carefully select front-end encoders aligned with their target acoustic evidence. Our source code and checkpoints are released at https://github.com/nii-yamagishilab/AntiDeepfake-AudioLLM.
Source:https://arxiv.org/abs/2610.17617PreviousATTEST: Evidence-Grounded Reinforcement Learning for Long-Audio Temporal UnderstandingNextMultimodal Contrastive Representation Learning Based Voice Conversion for Electrolaryngeal Speech Enhancement
Related posts

Filings: Oracle is selling $10B in common stock and $10B in bonds, as it rushes to get financing for its data center buildout and chip purchases; ORCL falls 5%+ (Kelly Cloonan/Wall Street Journal)
0Techmeme

Sources detail Anthropic's compute deal spree: 3.5GW+ of expected capacity in 2026, diversifying beyond Nvidia's AI chips to Amazon, Google, and AMD, and more (New York Times)
0Techmeme

A profile of OpenAI VP Charles Porch, an ex-Instagram executive who is rehabilitating AI's image across Hollywood and the media, including via celebrity dinners (Charlotte Klein/New York Magazine)
0Techmeme

Putin orders owners of non-state data centers to reserve 10% of capacity for Russia's IT infrastructure after Ukrainian drone attacks on Russian facilities (Reuters)
0Techmeme
Supermarket Freezers Across Europe Hit By Second Suspected Cyberattack
0Slashdot

Apple 'HomeView Ultra' With 9-Inch 360º Screen Detailed in New Report
0MacRumors