AI & ML
End-to-End Multi-Task Learning for Adjustable Joint Noise Reduction and Hearing Loss Compensation
arXiv cs.SD0 views
arXiv:2603.20387v2 Announce Type: replace-cross Abstract: A multi-task learning framework is proposed for optimizing a single deep neural network (DNN) for joint noise reduction (NR) and hearing loss compensation (HLC). A distinct training objective is defined for each task, and the DNN predicts two time-frequency masks. During inference, NR and HLC can be adjusted independently by exponentiating each mask before combining them. In contrast to recent approaches that rely on training an auditory-model emulator to define a differentiable training objective, we propose an auditory model that is inherently differentiable, thus allowing end-to-end optimization. The audiogram is provided as an input to the DNN, thereby enabling listener-specific personalization without the need for retraining. Results show that the proposed approach not only allows adjusting NR and HLC independently, but also improves objective metrics compared with optimizing a single training objective. It also outperforms a cascade of two DNNs separately trained for NR and HLC and shows competitive HLC performance against a traditional hearing-aid prescription on objective metrics. To the best of our knowledge, this is the first study that uses an auditory model to train a single DNN for both NR and HLC across a wide range of flat and high-frequency-sloping hearing-loss profiles.
Source:https://arxiv.org/abs/2603.20387PreviousPractical Assessment of Agentic Systems in AcousticsNextDexAttention: Distributed Sparse Attention through Rapid Online Planning and Persistent GPU Execution
Related posts
How Music LLMs Actually Work: From Tokens to Waves (MusicGen, DiT, and Building Your Own Engine)
0dev.to Machine Learning
蒸馏 Lora RHLF 都是什么意思
0dev.to Machine Learning

Teaching an offline plant doctor to spot rust
0dev.to Machine Learning
Is Your Model Good Enough? Precision vs Recall
0dev.to Machine Learning
How to Trim Audio for a Starlit Night Video — Free, in Your Browser
0dev.to Tutorial
How to Write Numbers in Words on Birth Certificates and Identity Documents
0dev.to Tutorial