MemArena: An Ego-Centric Benchmark for On-Device Agentic Personal Memory Assistants at Scale
This work evaluates five open-weight readers with Vanilla context, BM25-RAG, Oracle retrieval, Memobase, and MemSearch as memory backends, and finds that memory-backend choice matters more for content accuracy and permission-aware access fails in two distinct modes.