- Rating
- 1(−1)
- Confidence
- 4(+1)
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper introduces NapMem, a framework that organizes long-term user memory into a multi-level structure and uses reinforcement learning to train AI agents to decide when and how to navigate memory, improving personalized question answering and retrieval efficiency.
Critical strengths
- The paper presents an effective framework for active long-term memory navigation.
- The experiments show improved accuracy and more efficient memory retrieval.
Critical weaknesses
1. The improvements may come from RL training rather than the proposed hierarchical memory navigation.
2. NapMem performs much worse on adversarial/unanswerable questions in LoCoMo.
3. The evaluation uses limited test users and only 100 LongMemEval questions, raising concerns about generalization.
Questions for authors
1. How can you show that the improvements come from hierarchical memory navigation rather than RL training alone?
2. Why does NapMem perform much worse on adversarial/unanswerable questions in LoCoMo?
5 comments
Very good rebuttal, I will maintain my score
Thank you for your positive feedback on our rebuttal. We appreciate your time and consideration. If there are any remaining concerns that led you to maintain your score, we would be grateful for the opportunity to clarify them.
We thank the reviewer for recognizing the effectiveness of active navigation for long-term memory. We address the three concerns below with one new experiment and additional analysis.
W1 & Q1: Contribution of components
NapMem is a co-designed framework, where the memory pyramid provides a structured and provenance-linked interface, and RL teaches the 9B model how to navigate this interface effectively.
To test whether RL alone explains the gains, we trained a new baseline, Flat-GRPO, from the same 9B base model with the same GRPO settings, but with a flat interface that searches raw dialogue only. The table compares it with full NapMem and two ablations from Table 5. All values are accuracies (%).
The two components are complementary: the pyramid makes it possible to move from a summary to its supporting dialogue, and RL teaches the agent when that extra evidence is worth retrieving. We will add the Flat-GRPO comparison to the revision.
W2 & Q2: Adversarial/unanswerable questions in LoCoMo
The large gap is specific to this category and has an identifiable cause. Adversarial questions are scored on abstention: the correct response is to recognize that the history does not support the question's premise. Our reward scores answer correctness and memory-use appropriateness but has no dedicated abstention term, and answerable questions make up most of the training mixture. The policy is therefore rewarded mainly for gathering evidence and committing to an answer. This tendency helps on questions that require composing evidence but works against abstention.
A qualitative analysis of LoCoMo trajectories shows two concrete failure modes:
In both cases the agent reaches related memory but does not check it against the question's premise. The remedy follows from the cause that an explicit abstention criterion in the reward. We will add this analysis and the failure cases to the revision as a stated limitation.
W3: LongMemEval subset
We held LongMemEval out of policy training. Each question has its own long, multi-session conversation history, making evaluating all 500 questions requires building 500 separate memory banks per method. To limit construction costs, we randomly sampled 100 questions and evaluated all methods on the same subset.
The 100-question subset closely represents the question-type distribution of the full benchmark. All six types appear in proportions within 0.8 percentage points of their full-benchmark shares, supporting that using the subset scores to estimate each method’s overall accuracy on the full 500-question LongMemEval benchmark. We will include the sampling procedure and the distribution above in the revision.