Skip to content
Preprint

RRM: Experience-Driven Reflective Retrieval Memory for Long-Horizon Multimodal Reasoning

Jul 2026 · 0 citations · 19 references
Computer Science

TL;DR

Reflective Retrieval Memory is introduced, a reflective memory framework for long-horizon multimodal reasoning that consistently outperforms previous state-of-the-art approaches on M3-Bench-Robot, M3-Bench-Web, and Video-MME-Long, demonstrating the effectiveness of reflective retrieval memory for long-horizon multimodal reasoning.

Abstract

Existing multimodal long-term memory agents use external memory to overcome the limited context available for long videos. However, most methods emphasize what to store rather than how stored memory should be retrieved. When retrieval becomes inaccurate or repeatedly fails to obtain useful evidence, existing agents lack mechanisms to diagnose failures from previous task trajectories and adapt future search strategies.We introduce Reflective Retrieval Memory (RRM), a reflective memory framework for long-horizon multimodal reasoning. RRM augments an entity-centric multimodal memory graph with reflective experience memory, which distills transferable procedural retrieval knowledge from historical task trajectories. Unlike episodic and semantic memories that preserve factual evidence from the current video, reflective experience memory captures reusable search strategies across tasks. RRM converts retrieved experiences into query-level guidance, while answer generation remains conditioned only on factual evidence newly retrieved from the current video. A lifecycle management mechanism further regulates experience memory through usage frequency, reuse feedback, and temporal decay, thereby reducing redundancy and noise. RRM consistently outperforms previous state-of-the-art approaches on M3-Bench-Robot, M3-Bench-Web, and Video-MME-Long, demonstrating the effectiveness of reflective retrieval memory for long-horizon multimodal reasoning.

View source

Similar papers

Preprint Jul 2026

Exploratory and Assimilating Reflection: Reflective Recall Cycle for Long-term Memory

LLM-based autonomous agents require external memory to overcome their statelessness and limited context window for long-term interaction and dynamic knowledge reasoning. However, existing memory retrieval methods often lack adaptability and sample efficiency, and struggle to retrieve the right mixture of memories from heterogeneous stores. We propose Exploratory-Assimilating Reflection (EAR), a framework for high initial retrieval performance and sample-efficient adaptation. EAR combines two mechanisms: Exploratory Reflection, which performs iterative search to bootstrap retrieval and collect useful experiences for each query, and Assimilating Reflection, which replays these experiences from an Experience Buffer to refine a global reranker more efficiently than methods relying only on immediate rewards. Experiments show that EAR improves retrieval by up to 17.9% over the baseline retriever on two long-term dialogue benchmarks. We also show that EAR is highly sample-efficient and robust to noisy feedback.

Ganesh Senrayan, Moyuru Yamada, Ishan Jindal et al. · 0 citations
Jul 2026

Beyond Retrieval: Analytic Memory for Multimodal Agents

This paper presents AdaMM, a framework that jointly supports retrieval and analytic memory that extracts provenance-linked attribute-value observations from dialogue, images, and contextual metadata, discovers recurring field structures, and materializes them for analytical access.

Zhoujin Tian, Hao Zhang, Yao Tian et al. · 0 citations
Preprint Aug 2026

HERO: Human-profile Enhanced Retrieval Optimization Framework for Long-term Agent Memory

This work proposes a novel Human-profile Enhanced Retrieval Optimization framework for long-term agent memory (HERO), which converts the dialogue history into a traceable heterogeneous memory graph that preserves raw dialogue text as evidence for reasoning, thereby mitigating information loss.

Yuanhua Lin, Yile Li, Zhiyuan Zhao et al. · 0 citations
#machine learning Preprint Sep 2026

MemoryLACE: Memory Lifecycle-Aware Consolidation and Evidence Retrieval

Long-term LLM agents must preserve information across interactions while distinguishing repeated evidence, historical states, updates, and unresolved contradictions. Existing textual memory systems retrieve semantically relevant memories efficiently but often leave these relationships implicit, whereas richer structured approaches model them through global graphs, hierarchical abstractions, or reflection at greater complexity. We introduce MemoryLACE (MemLACE), a lightweight memory framework that explicitly models the lifecycle of textual evidence through sparse merge, supersession, and contradiction relations while preserving atomic natural-language memories and their provenance. Rather than retrieving memories independently, MemLACE reconstructs relation-aware evidence units that expose current, historical, supporting, and conflicting evidence for downstream reasoning. Across BEAM and StructMemEval, using open-weight and proprietary LLM backbones, MemLACE achieves the highest overall performance in same-backbone comparisons while reducing end-to-end runtime on BEAM by 66.6% relative to Hindsight, the strongest reported reflective-memory baseline. Ablation studies identify lifecycle expansion and temporal awareness as the principal contributors to these gains. Together, the results demonstrate that explicitly modeling the local lifecycle of textual evidence is sufficient to substantially improve long-term memory reasoning without requiring comprehensive knowledge graphs or global reflection.

Meriem Yacoubi, Pia Schmidt, Nenad Petrovic et al. · 0 citations
Preprint Aug 2026

RippleMem: From Isolated Retrieval to Associative Recollection for Long-Term Agent Memory

RippleMem is a long-term memory system that replaces one-shot retrieval with adaptive associative recollection, Inspired by cue-dependent episodic retrieval and associative completion, that stores interaction history as cue-rich episodic memory units and organizes them in an event-centric memory graph.

Jingbo Ji, Lingyi Li, Xilong Cheng et al. · 0 citations
Preprint Aug 2026

ERSkill: Evolving for Skill-Guided Adaptive Memory Retrieval

Experiments across multiple agent memory benchmarks demonstrate that ERSkill substantially outperforms strong non-evolving and self-evolving baselines.

Haolong Chen, Liangyin Zhang, Zhuodan Li et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.