- Rating
- 1
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper investigates the Knowing–Using Gap, in which fine-tuned models can memorize new facts but fail to use them for multi-hop reasoning. It characterizes this phenomenon through an accuracy gap and a temporal lag between memorization and generalization. The authors propose self-patching, which copies hidden states at entity positions from one layer to another within the same model, scans for layer pairs that recover correct answers, and tracks how these effects evolve during training. Across two knowledge domains and six models, selecting the optimal layer pair for each sample substantially improves reasoning accuracy. Based on these results, the authors propose a knowledge–circuit misalignment hypothesis and introduce LRSD to align middle-layer entity representations with deeper-layer representations. LRSD improves chaining accuracy across four models without test-time intervention while largely preserving factual recall.
Critical strengths
-
The paper provides systematic interventional evidence for the gap between memorization and knowledge use. Self-patching does not require activations from a separate correct run. Instead, it reuses representations from the failed query itself. Table 2 shows substantial recoverable headroom across models and both domains. For example, Qwen2.5-3B’s chaining accuracy on STaRK-Prime increases from 11.4% to 54.2%. The unrelated-fact controls and cross-context patching experiments further support the interpretation that the gains involve entity- and fact-related information. This is the paper’s most valuable contribution.
-
The mechanistic analysis leads to a training method that requires no test-time intervention, with improvements supported by multiple runs. LRSD trains only on single-hop facts and uses no multi-hop answer supervision. In Table 9, all seed-paired comparisons across four models and three seeds show improvements, with Qwen2.5-3B’s chaining accuracy increasing from 9.6% to 18.7%. Although absolute accuracy remains low, this result extends the contribution beyond per-sample oracle intervention and strengthens the evidence for the proposed explanation.
Critical weaknesses
The code repository linked in the submission contains author names and institutional affiliations, directly revealing the authors’ identities. This violates the ICLR 2027 double-blind submission requirements, which require anonymous code repositories and specify desk rejection for submissions that disclose author identities in the paper or supplementary materials. I recommend desk rejection on this policy ground, subject to verification by the Area Chair and Program Chairs.
Questions for authors
See weaknesses.