Targeted controls show that tool-invocation scores alone do not establish event grounding and that reminder coverage depends on response history and frequency, and motivate developing and evaluating streaming assistants for timely action, initiative under general user needs, and coverage of entire response sequences.
Yin-Song Yan, Ling Wang, Yuxuan Wang et al.· 0 citations
This work introduces LongAudioSpan, a benchmark that spans both duration and depth: it pairs audio from 10 minutes to over 2 hours with 3,240 questions across three cognitive levels, namely perception, understanding, and reasoning.
Omni Demand Understanding is established as a distinct multimodal contextual inference problem: given an interaction stream, a model must detect whether a user demand is present and infer intent from multimodal and conversational context, and ODU is evaluated along five dimensions, covering both single-turn and multi-t...
Qi Chen, Yun-Fei Chu, Haolin He et al.· 1 citation· ⚡1
This work introduces AudioSpan, a benchmark that spans both duration and depth: it pairs audio from 10 minutes to over 2 hours with 3,240 questions across three cognitive levels, namely perception, understanding, and reasoning.
Wen Huang, Yunfei Chu, Meng Gao et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
