Preprint
Aug 2026
Hear2Act: Benchmarking When Prosody Should Change What an Assistant Does
Hear2Act is introduced, a unified evaluation protocol for text and spoken assistants with 480 persona-grounded scenarios, hidden user concerns, and objectively verifiable outcomes that show that prosody matters when lexical evidence is insufficient, and that audio-capable LLMs can recover information from speech but do not reliably carry it into action without an explicit intermediate representation.
Xinyi Liu, H. Nayyeri, Dilek Hakkani-Tur et al.
· 1 citation