- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
MemPO learns memory-writing policies by attributing downstream query rewards to retrieved items through Shapley values and tracing these contributions back to historical writes. Experiments demonstrate improved accuracy, compact memory, and reduced gradient variance across six benchmarks.
Critical strengths
The paper addresses an important problem in learning what agents should remember. The proposed credit-assignment approach is intuitive, and the experimental study is extensive, covering multiple benchmarks, detailed ablations, and transfer evaluations.
Critical weaknesses
Major Concern 1: Mismatched supplementary materials. The supplied code and logs concern Qwen2.5 math evaluation rather than MemPO or its reported benchmarks, contrary to the reproducibility statement. The reported results therefore cannot be verified from these artifacts. Please provide the corresponding implementation and experimental records.
Major Concern 2: The memory statistics are inconsistent. Table 1 specifies a raw LoCoMo stream of 920K tokens and a MemPO store of 13K, whereas Table 4 reports a mean stream length of 9.2K. Relative to the latter, 13K is approximately 141%, rather than the claimed 1.4%. These quantities must be reconciled to validate the compression claim.
Major Concern 3: The bias bound needs clarification. Appendix B acknowledges that splitting rewards among writes can introduce bias. However, Proposition 2 only accounts for violations of the retrieval-locality assumption. Even when this assumption holds perfectly , reward splitting can still introduce bias. The authors should clarify how the bound accounts for this additional source of bias.
Minor Concern 1: The related-work discussion in the main text is way too brief and would benefit from clearer positioning against the closest prior methods. Additionally, the manuscript uses numerical citations rather than the author–year format specified by the ICLR template, which should be checked and corrected.
Questions for authors
My main concerns revolve the weaknesses stated above. I am willing to improve my score if the provided artifacts support the reported findings and these concerns are satisfactorily resolved.
Thank you for the detailed response. I appreciate the clarifications, which have addressed some of my concerns. However, my main concerns regarding the research motivation and method novelty remain insufficiently addressed. Therefore, I will maintain my rating.