Backend
CoTTAGE: An Explainable Judge for Text-to-Audio Generation
arXiv cs.SD0 views
arXiv:2611.17644v1 Announce Type: new Abstract: Rapid progress in text-to-audio (TTA) generation demands reliable and explainable automatic evaluation. However, existing metrics fail to simultaneously deliver high correlation with human judgments and meaningful, audio-grounded explanations, forcing reliance on labor-intensive human evaluation that bottlenecks model development iteration. To address this, we propose CoTTAGE, a reasoning-based evaluator for text relevance (REL) and audio quality (OVL). Following a reason-then-predict paradigm, CoTTAGE first generates an audio-grounded rationale to diagnose errors before predicting scores. Supported by over 10K newly collected human OVL annotations, CoTTAGE is first trained via supervised fine-tuning and then refined with reinforcement learning using a Thurstone-based preference objective that converts sampled score distributions into pairwise preference probabilities and rewards agreement with rankings derived from human judgments. Across six benchmarks spanning REL and OVL, CoTTAGE achieves state-of-the-art correlation with human judgments while producing human-preferred explanations to accelerate TTA development.
Source:https://arxiv.org/abs/2611.17644PreviousLazyWeights: Decode-on-Demand Edge LLMsNextAny Channel Count, One Token Stream: Incorporating Spatial Audio Understanding and Reasoning into Large Audio-Language Models
Related posts
DNS_PROBE_FINISHED_NXDOMAIN: What It Means and How to Fix It
0dev.to

Microsoft 365 Was Down 30 Hours. I Timed Every Part of It, and the Chlorine Story Checks Out.
0dev.to
A fast and sound algorithm to simplify summations in interventional queries expressions
0arXiv stat.CO
Does Increasing Government Spending on Tertiary Education Provide a Return on Investment? A Bayesian Causal Inference Analysis
0arXiv stat.CO
Edit one line of an AI agent journal and see what aisync verify says
0dev.to Productivity
Upgrading .NET 8 or 9 to .NET 10: the checklist
0dev.to C#