Memory enables language model assistants to maintain continuity across sessions and generate personalized responses, but knowing more about a user does not necessarily produce responses they prefer. Existing evaluations assess memory capabilities without directly establishing whether memory use benefits the user. To st...
Yijiang River Dong, Ze-Xue He, Cheng Yu et al.· 0 citations
This work presents the first systems characterization of agent memory, introducing a system-oriented taxonomy classifying agent memory systems along four axes, and derives 10 system recommendations covering construction scheduling, capability floors, amortization via query volume, freshness-latency tradeoffs, and fleet...
A user-centric framework for systematically auditing system prompts in AI systems, AISPA is introduced, a user-centric framework for systematically auditing system prompts in AI systems that examines specific parts of a system prompt and evaluates them along eight dimensions that matter to users.
Xiangning Lin, Shenzhe Zhu, Shu Yang et al.· arXiv.org· 0 citations
This work introduces DocHop, a benchmark for integrated chart--context reasoning in document-style images and constructs DocHop via a stochastic logic-first generation pipeline with controllable reasoning depth and visual density, to enable systematic evaluation.
Zhuo-Ran Yu, Le Thien Phuc Nguyen, Jaden Park et al.· 1 citation
Learning from Hindsight is presented, which brings hindsight relabeling to RL post-training of VLAs by scoring failed rollouts against the tasks they actually achieved, and achieves 5 times improvement in sample efficiency, and outperforms a dense progress-reward baseline on out-of-distribution LIBERO-PRO tasks.
Iris Xu, Sunshine Jiang, John Marangola et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.