Skip to content
Open access

Large Language Models Create Hallucinations in Response to Negated Text

Sep 2026 · ACM Transactions on Knowledge Discovery from Data · 0 citations · 64 references

TL;DR

It is demonstrated that LLMs struggle to handle negation effectively, applying affirmative knowledge inappropriately, leading to hallucinations that contradict the negated input, compromising the logical consistency and factual accuracy of LLM outputs.

Abstract

Large language models (LLMs) have achieved significant advancements in natural language processing tasks, but they remain prone to generating hallucinations—outputs that are logically inconsistent or factually incorrect. While previous research has primarily focused on hallucinations in affirmative contexts, how negated contexts and knowledge lead LLMs into hallucination has received little attention. In this paper, we demonstrate that LLMs struggle to handle negation effectively, applying affirmative knowledge inappropriately, leading to hallucinations that contradict the negated input. Through a comprehensive analysis using probing protocols, we show that negated text induces previously underexplored types of hallucinations, compromising the logical consistency and factual accuracy of LLM outputs. We employ lens observations to trace, layer by layer, how Transformer-based models encode a negated input, revealing that the layer-wise prediction probabilities for pre- and post-negation inputs remain nearly indistinguishable. Additionally, our analysis extends to Korean, a morphologically distinct language, demonstrating that negation-induced hallucinations are not issues specific to English. Our findings suggest that current LLMs, across the evaluated tasks in both English and Korean, exhibit significant areas for improvement when processing negated text, raising concerns about their reliability in real-world applications. We discuss possible ways to mitigate these hallucinations, emphasizing the need for enhanced model architectures to better understand and process negation.

Read PDF

Similar papers

The Alignment Paradox: How Post-Training Amplifies Confident Hallucinations in Language Models

Bounded margins mitigate confident hallucinations during post-training, implemented through an entropy-dependent margin bound in direct preference optimization (DPO) and shown to mitigate confident hallucinations during post-training.

Qing-Jia Huang, Ya-Kai Li, Jian-Guo Wu et al. · 0 citations

MISHAP-Bench: A Hallucination Benchmark for Large Audio-Language Models

This work introduces MISHAP-Bench, a comprehensive benchmark with 12,000 challenging open-ended question-audio pairs and a rigorous evaluation pipeline covering two hallucination categories, and proposes a groundedness judge that uses reference rubrics and judge prompts guided by human annotations.

Wen-Soi Zhi, Giulio Segalini, Jian-Jia Chen et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Domain-Specific Hallucination Detection in Large Language Models

A multi-signal detection pipeline combining fine-tuned DeBERTa-v3 classification, Monte Carlo Dropout uncertainty quantification, and temperature-scaled calibration for response-level hallucination detection is presented.

Varun Teja Chundru, Debasmita Biswas · 0 citations
Conference Open access Sep 2026

Mitigating Hallucinations in Natural Language Generation through Prompt Engineering: A Mechanism- Oriented Narrative Review

Large language models (LLMs) can generate fluent and confident responses that are factually incorrect, unsupported by evidence, or inconsistent with the source material. These hallucinations reduce the reliability of LLM-based question answering, summariza tion, dialogue, and information retrieval systems, especially w...

Jia-Nian Lin · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.