Skip to content

Clarification Is Not Correction: LLMs Fail to Let Go

Sep 2026 · arXiv.org · Vol abs/2609.25337 · 0 citations · 24 references
Computer Science

TL;DR

Research for interactive LLMs from retaining more context toward preserving uncertainty is redirected from retaining more context toward preserving uncertainty, to motivate uncertainty-preserving state management.

Abstract

Dialogue failures in language models are usually framed as memory failures: context too long, summaries lossy, a constraint forgotten. We argue this misses a deeper problem: in many conversations the model does not forget, it commits too early. An ambiguous early turn collapses into a single hidden interpretation, and later clarification is filtered through that commitment. We call this early posterior collapse: unresolved user intent collapsing into a committed task state before ambiguity is resolved. We study it with controlled dialogue tasks in writing, planning, and coding using Gemini-2.5-Pro and Gemini-2.5-Flash. Across thousands of trials, the same information in different orders yields different outcomes, even when the final dialogue contains equivalent task-relevant information. This order effect suggests later clarification is treated as extra context rather than a corrective signal: it refines a stale task state without invalidating it. Coding tasks are especially vulnerable, suggesting early assumptions get embedded in structured artifacts such as interfaces and control flow. Standard prompting and memory strategies do not reliably help: summaries can collapse ambiguity, and chain-of-thought can reduce explicit wrong commitment in reasoning traces without improving final task success. These findings motivate uncertainty-preserving state management. If assistants cannot let go of early interpretations, robustness cannot rely on post hoc correction alone; it must keep ambiguous early turns from hardening into one task state. Assistants should hold tentative hypotheses while ambiguity remains, ask before executing when high-impact ambiguity persists, and rebuild from a revised state when later evidence invalidates an earlier reading. Rather than one prompting fix, we aim to redirect research for interactive LLMs from retaining more context toward preserving uncertainty.

View source

Similar papers

#artificial intelligence Conference Open access Oct 2026

When LLMs Forget What They Believe: Characterizing State Integrity Collapse in Long-Horizon Dialogues

Results show that reliability cannot be inferred from single-turn instruction following alone; evaluation must track whether remembered constraints remain operational as dialogue state grows, and introduces StateTrack-Bench, a controlled suite of conversations covering numerical, format, role/persona, factual-memory, a...

Yan-Cheng Zhu, Yi-Fan Yuan · 0 citations
#artificial intelligence Preprint Oct 2026

You Changed Your Mind, The Model Didn't: Demystifying Intent in Multi-Turn Dialogue

When a large language model handles a multi-turn task and a user proposes a change but ultimately rejects it, the model should continue as if nothing changed. We find a surprising failure: merely mentioning a rejected change can derail task execution, even when the user's final intent remains unchanged. To systematical...

Junle Chen, Wei Chen, Zheng-Jun Huang et al. · 0 citations
#artificial intelligence Preprint Nov 2026

When to Ask, When to Answer: Strategic Clarification for Ambiguous Reference Resolution in Dialogue

For humans, referential disambiguation is a collaborative process involving clarification questions asked when they will meaningfully change the outcome. However, large language models (LLMs) have been shown to be biased toward premature answering, preferring definite single-turn responses over more clarification excha...

Ibrahim Khebour, Nikhil Krishnaswamy · 0 citations
#artificial intelligence Preprint Oct 2026

DialFork: Going Beyond Factuality to Evaluate Procedural Hallucination in Conversational Agents

Large language models (LLMs) deployed as conversational agents are increasingly expected to follow procedural logic. While factual hallucination has received extensive attention, a different failure mode has been overlooked: procedural hallucination, in which an agent produces individually fluent and factually plausibl...

Sergio Gastón Burdisso, Esaú Villatoro-Tello, Dairazalia Sánchez-Cortés et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.