Neh Majmudar

Load-Bearing Context: The Question Damage Score for Evaluating Context Reliance in Linguistic Reasoning

Evaluating three frontier LLMs under instructions to abstain when information is insufficient, it is found they rarely abstain, often continuing to produce correct answers after load-bearing context is removed, and these findings motivate further investigation into context-based reasoning, prior knowledge, memorization, and linguistic inference.