- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper focuses on memory mis-evolution in LLM agents, where experience accumulated in memory steers the agent toward incorrect or unsafe answers. It proposes RAMA, inserts trainable latent tokens at memory-query boundaries and optimizes them so that the KL drift is scaled to a fraction of the uncontrolled memory-induced drift. The novelty lies in formulating mitigation as self-supervised memory relaxation anchored, which requires no task labels or harmful-entry annotations.
Critical strengths
The motivation is clear as section 3 grounds the design in evidence.
The proposal sounds cheap, i.e. about 10 GPU-minutes of offline training and under 0.5% inference overhead
Critical weaknesses
Statistical support is thin, tbh. The QA track has 85 evaluation cases and the workflow track 58, RAMA is averaged over three optimization seeds with no variance reported, and baselines are run once
tthe theoretical analysis does not establish what matters in practice. Proposition 1 follows from the residual assumption via Pinsker's inequality and the reverse triangle inequality, i.e. it restates the target handed to the optimizer rather than proving that the 80-step Adam procedure reaches it, and the auxiliary condition is never checked empirically. The assumptions are close to the conlcusions as in Proposition 2
baselines miss the closest related methods. Beyond CK-PLUG (Bi et al., 2025), the tested defenses are a reminder prompt. Decoding-time control of context reliance has untested alternatives, e.g. layer-contrastive decoding (Chuang et al., ICLR 2024), contrastive decoding against a weaker model distribution (Li et al., ACL 2023), and activation steering (Li et al., NeurIPS 2023), and the trade-off between parametric and contextual knowledge has been mapped before (Mallen et al., ACL 2023). Results against at least one method from these families are needed, imo.
the analysis and metrics leave room for simpler explanations. The Section 3 association between misevolution and memory alignment has no control for generic context distraction, i.e. prior work shows models chase irrelevant context and defer to context under knowledge conflict (Longpre et al., EMNLP 2021), (Wu et al., COLM 2024), so misled behavior need not reflect memory-specific over-adoption.
practical guidance and reproducibility are insufficient. Static RAMA with nearly fails on Gemma workflow, 25.9 against 44.9 for uncontrolled memory, whereas works, and the paper offers no procedure for choosing before deployment
Questions for authors
refer to the weakness