Skip to content
Preprint

From Relevant Memories to Sufficient Evidence: Rethinking Memory Utilization in LLM Agents

Oct 2026 · 0 citations · 73 references
Computer Science

TL;DR

QEMem, a framework that reformulates memory utilization as the construction of query-specific evidence sets, shifting the focus from individual retrieval relevance to collective evidential support, achieves improved evidence coverage and strong performance on questions requiring cross-session evidence integration.

Abstract

Long-term memory enables LLM agents to reuse past experiences, yet retrieving relevant memories does not necessarily provide sufficient evidence for answering a query. Essential information may remain fragmented across memory records, obscured by abstraction, or disconnected from the relations required for reasoning. We identify this relevance-sufficiency gap and propose QEMem, a framework that reformulates memory utilization as the construction of query-specific evidence sets, shifting the focus from individual retrieval relevance to collective evidential support. QEMem integrates three complementary mechanisms: query-guided discovery retrieves evidence across multiple memory granularities; source-grounded reification organizes it into structured ViewCards with explicit evidential roles and source references; and sufficiency-guided refinement selectively recovers missing information. Operating on existing memory stores without modifying memory formation, QEMem achieves 91.43% LLM-judge accuracy on LoCoMo with Claude Opus 4.5, outperforming the strongest evaluated baseline, MemR$^3$, by 7.6 percentage points and NEMORI by 10.7 points under a shared memory store. Further analyses demonstrate improved evidence coverage and strong performance on questions requiring cross-session evidence integration.

View source

Similar papers

Preprint Oct 2026

From Memory Hits to Answerable Evidence: Query-Conditioned Memory Compilation for Long-Term Agent Memory

Long-term agent memory requires recovering answer-relevant evidence dispersed across turns and sessions. Existing systems increasingly use structured memories and adaptive retrieval, yet often pass retrieved or expanded units directly to the reader, coupling memory addressing with evidence presentation and leaving the...

Shang-Ze Li, Yan-Yu Yao, De-Rong Xu et al. · 0 citations

Remember by Asking: Retrieval-Induced Memory Evolution for LLM Agents

RIME is introduced, a retrieval-induced memory framework that shifts memory construction from monolithic compression toward evidence-centered integration and consistently achieves the best performance across all three quality metrics among the compared methods, while requiring substantially fewer query-time LLM tokens.

Wan-Qi Zhou, Jia-Wei Lu, Yang Wang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Recall What Is Missing: Composing Evidence from Long-Term Agent Memory

Under a limited context budget, a long-term agent must recall not merely memories that are individually relevant, but evidence that is collectively sufficient for the current query. Conventional memory access retrieves, scores, and truncates memories, often spending multiple context slots on redundant facts while leavi...

Qi Feng, Ji-Cong Fan · 0 citations
Preprint Nov 2026

MEMOIR: A Training-Free Memory Lifecycle for Long-Horizon LLM Agents

Long-horizon LLM agents require memory systems that preserve useful information across sessions and retrieve it when needed. Existing systems treat these as separate problems: memories are written prospectively with static importance scores that are never revised after use. This creates two coupled failure modes: conso...

Mayank Anand, Subham Raj, A. Jha et al. · 0 citations
Preprint Oct 2026

Memory as Code: Declarative Retrieval over Codified Long-Term Memory

In long-term memory systems, memories are constructed from interaction histories and retrieved in response to queries, enhancing the reasoning ability of LLM agents. In complex scenarios, facts are scattered across sessions and their relationships evolve over time, making it difficult for existing memory systems to com...

Ao-Ting Zeng, Yu-Xin Du, Jianwei Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.