AI & ML
Preference-Aware Pareto Steering for Multi-Task Speech LLMs
arXiv cs.SD0 views
arXiv:2610.27200v1 Announce Type: cross Abstract: Speech large language models (LLMs) perform multiple tasks, including automatic speech recognition (ASR), timestamp prediction (TS), and speech translation (ST). Joint training of speech LLMs creates task trade-offs, yet standard training with fixed loss weights does not generally control the resulting trade-off according to deployment preferences. To address this, we propose Endpoint-Anchored Preference-Aware Sampling Uniformly along the Pareto Front (EA-SURF), an a priori method that adapts scalarization weights so that the resulting task trade-off reflects the desired preference. EA-SURF retains the standard weighted-loss training pipeline, tracking the current model's performance relative to each task-specific reference and adapting the scalarization weights as training proceeds. We theoretically show that EA-SURF can match a desired preference, with the update becoming stationary at the target under checkable regularity conditions. Across six three-objective speech LLM requests, EA-SURF empirically converges toward the requested targets and increases endpoint-inclusive normalized hypervolume by 17.8% over fixed loss weighting.
Source:https://arxiv.org/abs/2610.27200PreviousPoint2Acoustic: Efficient Room Acoustic Parameter Estimation from 3D Geometry and Material PropertiesNextYou Are the Trigger: Speaker-Activated Backdoors
Related posts

Canva Brings Free All-in-One Affinity App to iPad
0MacRumors
GPT-Rosalind-6 System Card Addendum
0Hacker News New
Mediroute: An open-source AI platform exposing global drug price disparities
0Hacker News New
An intuition for how neural nets can understand text
0Hacker News New
An open LLM read 291 retracted papers: 7.7% of passages mention the retraction
0Hacker News New
Show HN: Maat – AI agents that can diagnose Ubuntu but can't change it
0Hacker News Show