- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The authors propose Intrinsic Representation Memory (IRM), a framework that decouples structural memory from semantic representation. Instead of generating text descriptions or storing frozen embeddings, IRM constructs a vector-free symbolic graph from a model’s intrinsic attention salience during a standard forward pass. IRM improves NarrativeQA F1 by 5.56 points over HippoRAG-2, with lower F1 on MuSiQue and mixed results on LoCoMo.
Critical strengths
S1: This paper has proposed an interesting question, and use a novel method as a solution. Using a model's intrinsic attention salience is a meaningful line of thought. S2: The paper conducted multiple experiments and honestly presented the results, including its weaker aspects. S3: The papaer has practical real-world value, substantially reducing the write cost. Also, the symbolic storage consists purely of integers and strings, supporting exact deletion and restoration (13.1 MB), which a clean engineering property.
Critical weaknesses
W1: Core innovation contribution is in doubt. The ablation of α∥v∥ edges vs. co-occurrence edges yields only +0.85 R@10 and +1.44 F1, and the paper itself concedes that "this comparison does not establish the superiority of salience-based connectivity." This is one of the paper's core selling points, yet the experimental evidence is weak. W2: Every reader switch requires re-selecting the (layer, KV head) pair on HotpotQA. The logistic probe must be re-fit on 600 external passages and the actual deployment cost contradicts the "zero-generation" promise. W3:Head selection uses retrieval AUC rather than relation extraction AUC, the correlation between the two is not demonstrated.
Questions for authors
Q1: Can you explain why IRM trails in some benchmark? MuSiQue: IRM trails by 7 points, LoCoMo IRM trails by 2.02 points. Q2: See in Weakness.
The main concern has been addressed in detail in the authors’ response. I will maintain the score.