XYBench: Can LLMs Respond Pragmatically to Queries with Misconceptions?
An evaluation paradigm that assesses model responses along three criteria grounded in cooperative response theory is designed, suggesting pragmatic redirection is a fundamentally underdeveloped capability in current LLMs.