Frontend
CARES: A Controlled Synthetic Benchmark of Speaker Reactions to Sound
arXiv cs.SD0 views
arXiv:2610.10208v1 Announce Type: new Abstract: Automatic audio scene description turns a recording into a text account of a situation. One difficulty is deciding which elements of the audio should be kept, since a description cannot include them all. Annotators disagree about this, making a ground truth hard to obtain. In this work, we first define the ground truth, then generate the data. We focus on audio events and define sound salience with a simple rule: a sound is salient when a speaker audibly reacts to it. For scale and variety, a controlled set of scenarios fixes the ground truth, and a language model writes the dialogues. The resulting corpus, CARES, contains 10,000 two-speaker scenes. We then benchmark six audio-language models on three tasks: identifying the scene, tagging the sounds present, and classifying reactions. We show that these models hear the sounds but miss how the speakers react to them.
Source:https://arxiv.org/abs/2610.10208PreviousA Study on Improving Multi-class Audio Source Separation Via Decoupled CLAP Query Optimization and an Automated Data EngineNextCrossEdit: Cross-Modal Training Enables Rich Audio-Visual Editing
Related posts

Render Personalized Images from One Editable Template with ModelFold Studio
0dev.to Design

A booking request form for a static Next.js site (no backend, no form service)
0dev.to Design

One treatment plan, three components: sharing state on a static Next.js site
0dev.to Design
Trace-X, image forensics
0dev.to Machine Learning
Building a Fajr alarm that keeps ringing until you're up: AlarmKit, backup rings and an on-device prayer mat check
0dev.to Machine Learning
Is a Salesforce certification enough to hire someone? Five signals I look for instead
0dev.to Career