- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates how language models perform compositional inference by identifying two distinct mechanisms: proactive reasoning, which precomputes relational representations, and retroactive reasoning, which composes relations on demand. Through causal interventions and activation patching on Llama 3.1 405B Instruct, the authors demonstrate the functional independence of these mechanisms and provide evidence for their hypothesized intermediate computations. Further experiments suggest that proactive reasoning is sensitive to contextual cues about future tasks and facilitates deeper multi-hop inference.
Critical strengths
- The paper addresses a fundamental question in mechanistic interpretability by investigating how language models internally compose relational information, rather than merely evaluating their reasoning performance.
- The causal intervention framework is carefully designed to distinguish proactive and retroactive mechanisms, providing stronger mechanistic evidence than correlational activation analyses.
- The intermediate-variable interventions offer compelling evidence for the proposed computational pathways, with layer-wise prediction changes closely matching the hypothesized causal models.
- The experiments examining contextual cues and inference depth provide meaningful insights into the functional advantages of proactive computation.
Critical weaknesses
- The primary mechanistic findings rely heavily on Llama 3.1 405B Instruct, while the proactive mechanism is substantially less pronounced in smaller models. This limits the generalizability of the proposed dual-mechanism account across model architectures and scales.
- The evaluation largely relies on synthetic relational reasoning tasks with highly structured prompts. The extent to which these mechanisms generalize to more realistic, linguistically diverse, and less constrained reasoning scenarios remains unclear.
- Although the activation patching results support the proposed causal models, they do not uniquely establish the hypothesized intermediate representations or exclude alternative computational explanations.
- The claim that proactive reasoning enables deeper inference is primarily supported by a controlled 3-hop experiment. More systematic evaluations across increasing reasoning depths and computational demands are needed to substantiate this broader conclusion.
Questions for authors
See above
2 comments
Dear reviewer dFA4,
As we approach the end of the discussion period, we would like to gently follow up on our rebuttal.
In response to your feedback, we have included new results that reproduce our experiment across 6 new open weight models in the 20B to 400B parameter range. These results demonstrate that both the proactive and retroactive mechanisms can be found in a wide variety of different models. We have also revised the manuscript such that the scope, intentions, and limitations of our work are stated more precisely. Overall, we believe that these changes now provide strong evidence for the generality of the identified mechanisms.
We have sincerely appreciated your feedback, and we believe that addressing it has strengthened our paper. If you feel that our response resolves your concerns, we would be grateful for a brief acknowledgment and, should you judge it warranted, an updated score. If any questions remain, we would be very happy to clarify them before the deadline.
We thank the reviewer for their positive and constructive feedback. Below we address each of their concerns.
1. The primary mechanistic findings rely heavily on Llama 3.1 405B Instruct.
The reviewer expresses concern that our work relies too heavily on a single model, Llama 3.1 405B Instruct, to make its claim. In response to this concern, we have added new results for Gemma 4 31B Instruct, GPT-OSS 20B, Qwen 3.5 397B A17B, Qwen 3.5 35B A3B, Seed-OSS 36B Instruct, and Olmo 3.1 32B Instruct. This is in addition to our existing results for Llama 3.1 8B Instruct and Llama 3.1 70B Instruct. We reproduce figure 2 on each of these models and find that we can replicate the core elements of the proactive and retroactive patch-in experiments with each of these models. Consistent with our existing experiments with Llama 3.1 70B Instruct and 8B Instruct, some of these effects are more subtle than they are for Llama 3.1 405B Instruct, but clear evidence for the existence of the proactive and retroactive mechanisms can nevertheless be found across these other LMs. These results can be found in Appendix A.3.2 and are illustrated in Figure 7.
2. The evaluation largely relies on synthetic relational reasoning tasks with highly structured prompts
We accept that this is an inherent weakness of our approach, although we counter that the main grandfather inference task that we study is a common type of inference that people and LMs alike tend to make, and that we also present results for a range of other tasks in the appendix. We also agree that because our activation patching experiments require structured prompt templates that support precise interventions, it is difficult to capture a great degree of linguistic diversity in our experiments. That being said, we believe that we have captured about as much linguistic diversity as other classic interchange intervention works such as Feng and Steinhardt (2023), Prakash et al. (2026), and Gur-Arieh et al. (2026). Thus, our use of a synthetic relational reasoning task is with strong precedent, and we hope that the reviewer can reconsider whether this weakness is truly critical. Extending causal abstraction techniques for naturally occurring, linguistically diverse inputs is an exciting area for future direction.
3. Alternative computational explanations
We consider and provide evidence against one alternative explanation, which we refer to as the ‘attribute enrichment hypothesis’, in Appendix A.3.4. We also acknowledge that it is entirely possible for there to be other mechanisms that also support the ability of LMs to make compositional inferences. We do not mean to claim that the proactive and retroactive mechanisms are universal, or that they uniquely enable compositional inferences, and we have softened our language so as to avoid implying that this may be our claim.
4. More systematic evaluations across increasing reasoning depths are needed
We agree that more systematic evaluations are needed to make this claim, and we are excited to pursue future work that considers this idea in more detail. We have softened the language in our paper to avoid making a strong conclusion about reasoning depth when our aim is to instead present some exploratory evidence. In particular, we have changed the subsection header ‘4.2 proactive representations make deeper tasks possible’ to ‘4.2 proactive representations can make deeper tasks possible’. We further emphasize here that our conclusion in line 444 is already hedged – we claim that ‘...one function of the proactive mechanism may be that it allows LMs to make deeper inferences…’.