XYBench: Can LLMs Respond Pragmatically to Queries with Misconceptions?
An evaluation paradigm that assesses model responses along three criteria grounded in cooperative response theory is designed, suggesting pragmatic redirection is a fundamentally underdeveloped capability in current LLMs.
Akhila Yerukola, Jena D. Hwang, Ming-Qian Zheng et al.
· 1 citation