- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The author proposes memflow, which is optimized according to the behavior supported by fixed budget soft memory. The text memory is compressed into k continuous vectors to form the memory of the reader. Then, the reader is trained with two complementary signals on its own sampling trajectory. The author tested personamem on three qwen backbone models and achieved good performance.
Critical strengths
-
Strong empirical results. The results on PersonaMem are particularly impressive. The memory intervention experiments provide useful evidence that the model relies on instance-specific memory when answering questions. Evaluation across multiple backbones and cross-dataset transfer experiments further strengthen the empirical support for the approach.
-
Clear presentation. The paper is well written and easier to follow, making the motivation and method straightforward to assess. Although the “our starting point” passage in the introduction could be explained more intuitively, the overall presentation is a strength.
Critical weaknesses
-
The experimental settings limit the relevance of the empirical evidence. PersonaMem-v2 was released in December 2025 [1], yet the paper evaluates only on the original PersonaMem. Although the experiments include three backbones, I find the two Qwen2.5 configurations less informative. Using older models is not necessarily a problem, but for a context- and memory-focused paper, evaluating a recent backbone is particularly relevant: in my experience, the increasingly widespread use of linear attention can substantially affect memory behavior. A concurrent work, From Passive Retrieval to Active Memory Navigation: Learning to Use Memory as a Structured Action Space [2], evaluates on PersonaMem-v2 with Qwen3.5-9B. So I think it is a normal requirement to experiment on the updated model and benchmark. The absence of such an evaluation leaves uncertainty about whether the reported benefits extend to current model architectures and the newer personalization benchmark.
-
The methodological distinction from prior work and the baseline selection are insufficiently established. Section 3.3, “On-policy memory distillation,” appears closely related to On-policy context distillation [3], which does not appear to be cited. Both train on student-generated trajectories using token-level guidance from a context-conditioned teacher. While the proposed method is more than a standalone on-policy distillation objective, this also means that comparisons should not primarily center on GRPO and OPSD. The system should be compared against memory methods addressing the same problem. xRAG and AutoCompressor are relatively old compression baselines; the only additional memory-specific method evaluated is MemGen, whose Trigger is disabled, so the comparison does not cover its complete method. These omissions make it difficult to assess both the incremental methodological contribution and the system’s competitiveness.
References:
[1] Jiang, B., et al. PersonaMem-v2: Towards Personalized Intelligence via Learning Implicit User Personas and Agentic Memory. December 2025. arXiv:2512.06688.
[2] Xu, Y., et al. From Passive Retrieval to Active Memory Navigation: Learning to Use Memory as a Structured Action Space. July 2026. arXiv:2607.05794.
[3] Ye, T., Dong, L., Wu, X., Huang, S., and Wei, F. On-Policy Context Distillation for Language Models. February 2026. arXiv:2602.12275.
Questions for authors
-
What is the core difference between Section 3.3 and on policy context Disintegration?
-
Are there any results on personamem-v2 or qwen3.5 models that use mixed/linear attention?
-
Why close the trigger of MemGen? Does this affect its performance? Why not compare more long-term personalized memory methods?
Clarification Regarding the Ethics Flag
Dear Reviewer wwcm,
Thank you for your thoughtful review. Regarding the ethics flag, we would like to clarify that all datasets used in our study are publicly available, open-source datasets. To the best of our knowledge, our research complies with the ICLR Code of Ethics. If you have any specific ethical concerns, we would appreciate your clarification and would be happy to address them.
Best regards,
The Authors