Direct Preference Optimization (DPO) is applied to align models, constructing preference pairs in which chosen responses preserve mixed-language content while rejected responses mimic failure patterns, suggesting DPO can effectively elicit correct code-switching transcription behavior from multilingual Audio LLMs.
T. N. Quang, Won Cheng Yi Lewis, M. Pham et al.· arXiv.org· 2 citations
SEA-SpeechBench is introduced, the first large-scale multitask benchmark that evaluates speech understanding in 11 SEA languages through 97,194 samples across 99 evaluation sets and 597 hours of curated audio data, exposing critical model limitations and underscore the need for inclusive model development.
Jingyi Liao, Wenyu Zhang, Zhuo-Han Liu et al.· 1 citation
Extensive evaluations show that MERaLiON-GR consistently surpasses the state-of-the-art gender recognition model Vox-Profile and a large Audio-LLM, in both full-utterance and segment level evaluation modes.
Qiongqiong Wang, A. Aw, Nancy F. Chen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.