AI & ML
STFT Frontend Mismatch in Pretrained Audio Spectrogram Transformers: Analysis and Adaptation
arXiv cs.SD0 views
arXiv:2610.34533v1 Announce Type: new Abstract: Pretrained audio spectrogram transformers are widely used as backbones of machine listening systems for sound event classification. However, they are typically trained using spectrograms with a fixed Short-Time Fourier Transform (STFT) configuration, implicitly binding the model to the time-frequency resolution seen during pretraining. In practice, adapting these systems to new domains or computational constraints often requires different STFT frontend parameters. In this work, we conduct a controlled study of the sensitivity of the foundational Audio Spectrogram Transformer to variations in STFT window and hop size, showing that audio classification performance degrades substantially as frontend parameters deviate from pretraining settings. As a mitigation strategy, we introduce a lightweight conditioning mechanism using FiLM that enables a pretrained model to adapt to variable input configurations using limited additional training data. Our method generalizes well to unseen STFT configurations, improving model robustness without sacrificing performance in the original setting.
Source:https://arxiv.org/abs/2610.34533PreviousSpatial Audio Generation and Editing with Executable Plans and Self-Distilling TransfusionNextAudio-R1: Audio Reasoning through Reinforcement Learning on Self-Supervised Tasks
Related posts
How to Turn a Process Document Into a Working App With AI
0dev.to Machine Learning
Which AI subscription should I buy?
0dev.to Machine Learning
Your Classifier Says 0.97. Six Ways That Number Lies in .NET 10
0dev.to Machine Learning
Which AI song generator fits a lyrics-first workflow?
0dev.to Tutorial
Anima 2.9B in ComfyUI: Six Workflows, From Official T2I to Tiled Redraw and Smart Img2Img
0dev.to Tutorial
How to calculate how many cartons fit on a pallet (with a worked example)
0dev.to Tutorial