Full-duplex speech models can listen and speak simultaneously, enabling natural interaction, but become increasingly difficult to control as the conversation history grows. When used as user simulators, this lack of control can cause them to deviate from prescribed scenarios and produce unreliable evaluation outcomes....
Hao-Long Zheng, Maike Zufle, Dominik Machácek et al.· 0 citations
SALMONN-duo is proposed, an adaptive dual-system voice agent inspired by dual-process theories of cognition that separates real-time interaction from deliberative computation by pairing an always-on, fast-thinking full-duplex speech LLM with a powerful asynchronous slow-thinking LLM agent.
Wen-Yi Yu, Si-Yin Wang, T. Chiba et al.· 0 citations
This work introduces Few-Shot Aware GRPO (FSA-GRPO), an RL-based post-training recipe that uses a specially designed reward to encourage the model to leverage few-shot demonstrations, thereby strengthening its few-shot adaptation ability.
Haolong Zheng, Siyin Wang, Xulin Fan et al.· arXiv.org· 1 citation
A multi-layer feature fusion (MLF) adapter that aggregates information from all encoder layers before projecting them into the language model is proposed and shows that MICL does not emerge naturally in ALLMs, but can be effectively acquired through targeted contextual biasing training.
Xiaoyu Yang, Xuenan Xu, Wenyi Yu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.