- Rating
- 3(+1)
- Confidence
- 2(−1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies interference among multiple representations in long-term agent memory systems. It identifies two failure modes. Abstraction leakage occurs when omissions in an abstraction propagate to downstream memories. Cross-facet suppression occurs when heterogeneous records compete under a shared ranking budget. PrismMem addresses these issues in two ways. It constructs factual facets directly from source interactions, and it retrieves different representations in separate channels before restoring source evidence. Controlled experiments support both failure modes. PrismMem achieves the highest overall score among the evaluated memory systems on four long-term memory benchmarks.
Critical strengths
-
The paper tests its motivating failure modes rather than only using them as intuition. The abstraction analysis includes matched placebo conditions. The suppression analysis uses controlled distractor composition, dose-response experiments, and equal-budget evidence reinsertion.
-
The evaluation is broad. It covers four benchmarks and eight recent memory systems, with a shared answer model and five runs. PrismMem obtains the highest overall score on all four benchmarks.
Critical weaknesses
-
The benchmark gains are not clearly attributable to the proposed isolation principles. PrismMem combines hybrid lexical and dense retrieval, reciprocal rank fusion, a cross-encoder reranker, and relatively large channel-specific retrieval capacities. The competing systems use substantially different retrieval pipelines and answer-context sizes. The comparison therefore does not show whether the gains come from representation isolation or from stronger retrieval engineering. In the ablation, removing the central representation-isolated retrieval component reduces LoCoMo accuracy by only 1.52 points. In addition, the hyperparameter sweeps use the same 1,540 LoCoMo questions as the main evaluation rather than a held-out development set.
-
The proposed failure modes have fairly simple alternative explanations, and simple baselines are missing. Abstraction leakage is expected once an answer-critical fact is removed from the representation used for downstream extraction. Cross-facet suppression is closely related to score calibration and quota allocation across heterogeneous retrieval sources. The paper compares isolated retrieval mainly against shared-pool ranking. It does not compare against simple alternatives such as per-source normalization, quotas, or reranking after pool fusion. It is therefore unclear how much of the benefit requires the proposed architecture rather than standard retrieval controls.
Questions for authors
-
How do the baselines perform with the same hybrid retrieval, reranker, and answer-context budget as PrismMem?
-
How does isolated retrieval compare with simpler alternatives such as per-source normalization, quotas, or reranking over the fused candidate pool?
-
Can the hyperparameters be selected on held-out data, and do the main results remain similar?
-
On LongMemEval-S, PrismMem's evidence recall is lower than that of MemGAS and EverMemOS at all three cutoffs. Why does it still achieve the best answer accuracy on this benchmark?
Thank you for the detailed response. The additional comparison with shared-pool alternatives (per-source z-score and min-max calibration, and representation-aware RRF) addresses my question on channel isolation well, and the consistent gains across all four benchmarks show that the isolation is not easily replaced by simpler ranking adjustments. Please include this comparison in the final version and clarify that all variants use the same record budget and reranker. Regarding novelty, the response helps clarify the two design elements, but I still feel the methodological advance over existing multi-representation memory systems is not clearly demonstrated, as the method largely builds on existing techniques. Given the solid experimental evidence, I am raising my score.