- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper studies how task demand makes a latent variable readable at the query position. Five task conditions share a context, and the analysis combines Jacobian lenses, linear probes, activation patching, ablations, and direction removal. Demand increases lens visibility, while donor-substitutable content concentrates at intermediate depth. Similar readout changes also produce substantially different behavioral effects. The authors interpret these findings as attention-mediated gathering and contrast them with their own formalization of admission at the query position.
Critical strengths
- The regularizer is straightforward to integrate. Its weights remain fixed during residual optimization. Top-k selection limits historical gradient evaluations, and Appendix D.6 correctly acknowledges that key scanning and storage still grow with the history.
- The experiments include useful comparisons. Tables 1–2 cover three models and two editing datasets, including AlphaEdit and HSE. Tables 4 and 6 examine selection strategies, response signals, and weighting functions. The reported LLaMA CounterFact generalization improvement from AlphaEdit's 78.15 to 93.95 would be meaningful if verified.
Critical weaknesses
For me, the primary issue with this paper is its lack of readability. Starting from the abstract, the text introduces technical terms without any explanation. Furthermore, while a significant portion of the abstract is dedicated to presenting empirical results, it offers very little insight into the implications of those findings. I do not believe this is an effective way to present research; moreover, the paper reads more like an empirical report than a formal academic paper.
To be honest, after reading the introduction, it seems to me that the phenomenon discussed is similar to the "attention sink" effect. However, the research relies heavily on "probing" methods—a technique used in interpretability studies—to examine the inconsistencies and commonalities among various existing probes. In my view, this does not constitute a substantive contribution.
Questions for authors
See Weakness