- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper tests whether an LLM-written user memory affects a model the way the history it replaces does. For 38 real users with two weeks of chats each, the authors compare the full history against memories written by five LLMs and seven single-property rewrites. Each context precedes a fixed low-mood or chest-tightness question and is given to five open and two commercial models. They measure the last-token residual state and whether the answer refers the user to a professional. No short context reproduces the history's state. On the two Llama models, memories lower the low-mood referral rate (100%/96% → 62–83%/77–93%), while an equally short episodic memory keeps it at 99%; the other five models are unaffected. The pattern reverses on the chest-tightness question, and neither a "forget" request nor activation steering restores the referral.
Critical strengths
Prior work on memory and safety mostly uses synthetic profiles and compares memory with no context. This paper uses real two-week histories and evaluates each memory against its own source history. This within-user design is a useful evaluation perspective, and the data are rare. The single-property rewrites, the human-validated judge, user-level bootstrap intervals, the full-history robustness check, and the candid limitations section make the reported numbers trustworthy as descriptions of the data. My concerns are with what the results explain and how far they generalize, not with their accuracy.
Critical weaknesses
The episodic memory preserves the referral on the two Llamas, but it is only a control and is never tested on personalization, recall, or general tasks. It may simply be less influential (state distance 0.90/0.94, near no context), and the two remedies tested (forgetting, steering) both fail. The paper only rules out explanations (length, speaker, word order, topic, size, precision). It leaves its own hypotheses untested and omits feasible analyses, such as trait-versus-event sentence ablation or memory swaps across users. The state analysis adds little, since it is largely predicted by TF-IDF overlap (ρ = −0.73 to −0.89). The drop occurs only on two 2024 Llama-3 models; all other models, including two current commercial ones, stay at 97–100%, and the effect reverses on the chest-tightness question. The general result is near-trivial, and the non-trivial result does not generalize, yet the title and abstract claim generality.
Questions for authors
- If only the trait-describing sentences are removed from a memory, keeping the event-describing ones, does the referral recover on the two Llamas?
- How does the episodic memory compare with the default memories on personalization or user-fact recall? This would show whether it is safer or merely less influential.
- Does the referral drop replicate on any recent open-weight model?