Diagnosing and Remedying Representation Deficiencies for Deterministic Reasoning in KGQA
The proposed DR 2 identifies and localizes non-deterministic reasoning behaviors, uncovering the underlying semantic representation deficiencies in LLMs, and designs abductive reasoning-based preference learning, which promotes fine-grained semantic discrimination and mitigates non-deterministic reasoning errors.