- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper studies how two-hop questions are processed in hybrid LMs (sequential and parallel) and transformer-only LMs. Activations are patched from a donor to a recipient prompt at every layer, and the logits of three candidates are tracked: (1) the recipient's value for the donor's intermediate key, (2) the recipient's value at the position of the donor's relevant fact, and (3) the donor's final answer. Each effect is normalized by subtracting a reference candidate's effect. Tracking these effects across layers shows where the intermediate key becomes available and where it is converted into an answer. The authors find that recurrent layers can carry the intermediate key to attention layers, which use it to retrieve the answer; in some (but not all) hybrids, recurrent layers also retrieve from their own memory after the final attention layer.
Critical strengths
[S1] The paper extends prior interpretability methods to hybrid architectures, showing how the intermediate key is carried through recurrent layers and used by attention layers.
[S2] The methodology is closely related to Gur-Arieh et al. (2026), which uses counterfactual interventions to distinguish different retrieval mechanisms. However, this paper extends the approach to two-hop retrieval, where the intermediate key must first be computed from the context. By independently varying the intermediate key and the position of its associated fact, the proposed setup distinguishes retrieval based on the computed key from positional retrieval and direct transfer of the donor's answer. This provides a useful way to track the intermediate key's causal effect across model layers.
[S3] The paper highlights differences in how hybrid and transformer-only models perform two-hop retrieval, with hybrid models concentrating retrieval in fewer attention layers and some additionally using recurrent memory. These findings provide insights into different retrieval strategies across architectures, although they do not establish a clear advantage for either architecture.
Critical weaknesses
[W1] The motivation is unclear. While the application to hybrid models appears novel, novelty alone does not sufficiently establish the importance of a problem. In particular, the introduction and abstract could better explain why understanding two-hop retrieval is important and why studying this process specifically in hybrid LMs is relevant. The significance of identifying where a key is computed, carried, and used could also be made more explicit.
[W2] Certain terminology and the paper's organization make the paper difficult to follow. Several important concepts are introduced before they are sufficiently explained, which makes the paper difficult to follow, especially in the abstract and Sections 1–2:
- Bridge entity vs. retrieval key. The abstract describes the model as producing a "bridge entity", but subsequently introduces the term "key" (line 014) without clearly explaining its meaning. The introduction clarifies that this is a retrieval key, but the relationship between the terms could be established earlier and used more consistently.
- Donor and recipient. Section 2 introduces donor and recipient prompts before sufficiently describing the tasks and experimental setup. Consequently, the examples are difficult to interpret on first reading (e.g., it is unclear what "row 14" means in line 090). Introducing at least the task setup before describing the intervention could substantially improve readability.
- Terminological overlap. Terms such as "reference" and the different answer candidates require several reads to be understood. An explicit definition to the notations would help (especially for reference).
- More suggestions (not as critical) about terminology can be found below.
[W3] While the paper specifies that the recipient's earlier-token computations remain unchanged during hidden state transplantation (Section 2, lines 098–107), and later clarifies that recurrent layers combine the injected residual with memory computed from the recipient's unmodified prefix (Section 3.3, lines 255–258), the explanations feel a bit scattered across sections and could be clarified much earlier since this is the primary novelty of the paper. In particular, it would be helpful to clarify how the intervention operates in sequential versus parallel hybrid architectures, where attention and recurrence are combined within the same layer.
[W4] The first three paragraphs of Section 2 do not clearly distinguish established techniques, such as donor–recipient activation patching and logit differences, from the paper's novel contributions. Similarly, the addition of a reference candidate is presented as a contribution, although its novelty is unclear. While the later "Relation to Prior Work" paragraph is well written, clarifying these distinctions for more core methods earlier would help readers better understand the methodological contributions.
I would consider revisiting my score if the authors propose clear steps to address the critical weaknesses.
Additional comments and suggestions:
Figures/tables
- Fig 1: See questions above.
- Fig 2: Label models as sequential hybrid, parallel hybrid, or transformer (as in Fig 3). Define balanced, key-dominant, and position-dominant ideally in caption.
- Table 1: State the units of the causal-scrubbing results (percentages?).
Writing
- Line 047: "Assay" and "crossed assay" are unusual in ML. Define in footnote or use standard terms.
- Line 049: The three predicted answers are not evident from Fig 1(b) as stated in Introduction. State them explicitly, along with the reference/recipient candidate, in ideally both text and figure.
- Line 105: A positive logit difference need not mean a meaningful probability change. This may need to be discussed.
- Line 115: The notation B_i, B_j, B_k, A is hard to remember; use more intuitive names or add a compact table.
- Line 119: Give an example of the arrow task. It is hard to understand what it is from this description alone. Or maybe add a forward-pointer to examples in Appendix.
- Lines 130–132: This reads as if prior work already tested hybrids and this paper makes minor improvements. To my knowledge it did not, so this undersells the contribution of this paper. Revisiting can help position the paper better.
- Line 216: "Step" is unclear at first. Also, isn't the reported alignment expected by definition, given how the largest conversion step is defined?
- Line 216: Define "profile" (e.g., "23 profiles"). This term is often used for different setups but it is not intuitive to the reader. Maybe use "setup" or "setting" instead?
Questions for authors
See clarifications requested in Weaknesses
3 comments
Figures and tables.
- Figure 1. Both captions are rewritten. Panel (a) is described as left and right halves; panel (b) names what each tag predicts and which state moves.
- Figure 2. Each panel is labelled sequential hybrid or dense transformer, and the caption defines key-dominant, position-dominant and balanced.
- Table 1. The scrubbing rows are marked (x), and the caption says they are multiplicative factors, not percentages, with x1 meaning no change.
Writing.
- Line 047, "assay". Removed from the main text; we say counterfactual patching and prompt pairs.
- Line 049, the three predicted answers. Stated explicitly in Figure 1b's labels and caption and in Section 2; the Introduction points to the figure.
- Line 105, logit difference versus probability. Section 2 now says what the number means: a candidate's logit minus the reference's is the log of their probability ratio, so an effect of d logits multiplies that ratio by e^d. Because a ratio can grow while both probabilities stay small, we also report how often the key's candidate is the model's top choice among the seven scored answers (Table 1: 86%, 71% and 67% in the rebinding test, against a chance level of 14%).
- Line 115, notation. B_i, B_j, B_k are replaced by B_key, B_pos and B_ref, with A for the donor's answer.
- Line 119, the arrow task. Section 2 gives an example (
Key NOG -> Value CFG,Key CFG -> Value 39, and the question "Starting from NOG, follow mappings until reaching a number"), and Appendix A shows a complete prompt pair. - Lines 130–132, prior work and hybrids. "Relation to prior work" now says that both prior studies examine transformers and a key the question names, and that we bring their design to hybrid models and extend it to a computed key.
- Line 216, "step", and whether the alignment holds by definition. The conversion step of a layer is defined as the increase in the donor-answer effect across it, and the resolving layer is the layer with the largest step. The alignment is not built in: the resolving layer is defined by the donor-answer effect and the peak by the key effect, and the rise spans three to twelve layers. A largest step placed at random within that span would meet the key peak in two to three of the nine model families; it does in all nine (Section 3.2 and Appendix C). The alignment is closest to a tie in Granite-H, whose key effect is nearly flat over the five layers before the resolving layer (margin 0.01 logits). In one of six new sweeps with other list lengths, run for Reviewer B9Na, its peak falls at the start of that plateau, statistically tied with the resolving layer's input (Appendix G).
- Line 216, "profile". Removed from the main text; we say layer sweep.
Dear Reviewer 6P66,
A short followup since the discussion period is ending. You said you would revisit your score if we had clear steps for W1–W4. We made all four changes in the revised PDF and our earlier reply goes through them point by point.
In short:
-
Motivation. The introduction now says why this matters up front. Retrieving with a key the model computed itself is the core step of multi-hop reasoning. Hybrids keep only a few attention layers, so which step needs attention is a real design question.
-
Section 2. It is rebuilt: the task comes first, then the intervention, then what each candidate answer means. Donor, recipient and the reference are defined before they are used, and one paragraph says exactly what the patch replaces and what it leaves alone.
-
Contribution. We now say plainly what is standard (activation patching, logit differences) and what is ours (a key the model computes and hybrid models).
If you get a chance to look at the revision, we'd really appreciate an updated assessment. If anything is still unclear, tell us and we'll fix it.
Thank you for the detailed review. You asked for clear steps on the critical weaknesses; each step below is already made in the revised paper, and we give its location.
W1. Motivation.
W2. Terminology and organization.
W3. Where the intervention is explained. The explanation is now in one place, Section 2 ("Counterfactual patching"), before any result:
W4. Established techniques versus our contribution.