Sep 2026· ACM Transactions on Knowledge Discovery from Data· 0 citations· 64 references
TL;DR
It is demonstrated that LLMs struggle to handle negation effectively, applying affirmative knowledge inappropriately, leading to hallucinations that contradict the negated input, compromising the logical consistency and factual accuracy of LLM outputs.
Abstract
Large language models (LLMs) have achieved significant advancements in natural language processing tasks, but they remain prone to generating hallucinations—outputs that are logically inconsistent or factually incorrect. While previous research has primarily focused on hallucinations in affirmative contexts, how negated contexts and knowledge lead LLMs into hallucination has received little attention. In this paper, we demonstrate that LLMs struggle to handle negation effectively, applying affirmative knowledge inappropriately, leading to hallucinations that contradict the negated input. Through a comprehensive analysis using probing protocols, we show that negated text induces previously underexplored types of hallucinations, compromising the logical consistency and factual accuracy of LLM outputs. We employ lens observations to trace, layer by layer, how Transformer-based models encode a negated input, revealing that the layer-wise prediction probabilities for pre- and post-negation inputs remain nearly indistinguishable. Additionally, our analysis extends to Korean, a morphologically distinct language, demonstrating that negation-induced hallucinations are not issues specific to English. Our findings suggest that current LLMs, across the evaluated tasks in both English and Korean, exhibit significant areas for improvement when processing negated text, raising concerns about their reliability in real-world applications. We discuss possible ways to mitigate these hallucinations, emphasizing the need for enhanced model architectures to better understand and process negation.
Bounded margins mitigate confident hallucinations during post-training, implemented through an entropy-dependent margin bound in direct preference optimization (DPO) and shown to mitigate confident hallucinations during post-training.
This work introduces MISHAP-Bench, a comprehensive benchmark with 12,000 challenging open-ended question-audio pairs and a rigorous evaluation pipeline covering two hallucination categories, and proposes a groundedness judge that uses reference rubrics and judge prompts guided by human annotations.
A multi-signal detection pipeline combining fine-tuned DeBERTa-v3 classification, Monte Carlo Dropout uncertainty quantification, and temperature-scaled calibration for response-level hallucination detection is presented.
Large language models (LLMs) can generate fluent and confident responses that are factually incorrect, unsupported by evidence, or inconsistent with the source material. These hallucinations reduce the reliability of LLM-based question answering, summariza tion, dialogue, and information retrieval systems, especially w...