- Rating
- 1
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper argues that query–memory embedding similarity fails to recall gold evidence in long-term agent memory because of a semantic gap between high-level queries and fine-grained episodic memories. It proposes PAGR, a training-free retrieval procedure:
- Retrieve top-K seed memories as anchors.
- Expand each anchor to its semantic neighbors (memory–memory cosine) and temporal neighbors (a same-session window).
- Score each candidate with a cross-encoder conditioned on the parent memory, CE(q, p ⊕ c).
- Keep the top-B candidates as evidence and as the next-hop anchors, for up to T hops.
On LoCoMo it reports 45.2 / 41.8 overall F1 with GPT-4o-mini / Llama-3.1-8B. It also includes smaller comparisons against A-MEM on GVD and PerLTQA, plus ablations, a case study and an efficiency analysis.
Critical strengths
- The motivation is clear and well-grounded (Fig. 2): even top-50 retrieval misses gold memories for many LoCoMo queries.
- The method is simple, training-free, and easy to plug into existing memory systems. Temporal-window expansion is a cheap and sensible inductive bias for conversational memory.
- The ablations go beyond end-task F1.
- The open-domain failure analysis (Table 3) and the qualitative traces (Fig. 4) are informative.
Critical weaknesses
- Limited novelty and missing related work: Seed retrieval → neighbor expansion → reranking → iterate is close to beam-style multi-hop retrieval: PathRetriever (Asai et al., 2020), MDR (Xiong et al., 2021), Baleen, IRCoT. Graph-based propagation (HippoRAG, GraphRAG) is another close relative. Contribution 1 is already discussed in prior work.
- Missing or weak baselines: MemoryOS, Nemori, Memory-R1, and many other related papers.
- Limited evaluation: Main results use only LoCoMo (10 dialogues), with lexical F1/BLEU only and no LLM-as-judge. There are no multiple runs, variance, or significance tests.
- The abstract and conclusion mention only LoCoMo, but the performance on that dataset is not as good as recent papers.
Questions for authors
- Can you report results with LLM-as-judge metrics?