AI & ML
Sori: Streamable and Controllable Model for Non-musical Audio to Symbolic Music Transformation
arXiv cs.SD0 views
arXiv:2610.15474v1 Announce Type: new Abstract: We introduce Non-musical Audio to Symbolic Music Transformation (NASMT), a novel task that converts non-musical audio into symbolic music representations. Unlike automatic music transcription, which assumes musical input and a unique correct score, NASMT is inherently one-to-many and requires evaluation along two axes: input correspondence and musicality. We present Sori, an encoder--decoder Transformer that addresses this task through domain adversarial training (DAT), which bridges the gap between musical and non-musical audio in the encoder's feature space, and classifier-free guidance (CFG) with a continuous parameter~$\gamma$ that controls the trade-off between correspondence and musicality at inference time. Across objective metrics and a listening study, Sori provides effective continuous control via $\gamma$ and compares favorably with instrument-agnostic transcription models. Sori supports real-time streaming on a consumer CPU. Audio examples are available at https://soridemo0320.github.io/sori-demo/.
Source:https://arxiv.org/abs/2610.15474PreviousBridgeCodec: Mamba Enhanced Neural Audio Codec with Schr\"odinger Bridge at Low BitrateNextSleep Sound Event Detection Powered by Learnable Multi-Resolution Adaptive Line Enhancer
Related posts
Qodo builds context into AI code review with Codex
0OpenAI Blog

Ford promises not to sell your driving habits to data brokers
0The Verge
Snap settles lawsuit accusing platform of fueling teen depression and eating disorders
0TechCrunch
Scrape LinkedIn job postings without logging in (Python + Google Sheets)
0dev.to
Same model, same defences: 7 document attacks down to 0, chat attacks barely moved
0dev.to
Skill to Create Product Videos
0Hacker News