- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes AttriCoT to study causal dependencies within a given chain-of-thought (CoT). It removes preceding reasoning units, measures changes in the log probability of subsequent units, and fits a linear model to construct an attribution matrix. The method requires O(U) forward passes. Experiments on five datasets and four models show improvements over Thought Anchors and prompting baselines under the proposed perturbation-based evaluation.
Critical strengths
-
The method efficiently computes pairwise attribution scores across prompt, reasoning, and answer units.
-
The experiments cover multiple models and reasoning benchmarks, with additional sensitivity analyses in the appendix.
Critical weaknesses
- Limited novelty.
The main approach closely resembles existing perturbation-based attribution methods. In particular, AttriCoT-LOO is mathematically equivalent to measuring leave-one-out changes in the target unit's log probability. MExGen/C-LIME and ContextCite already employ similar attribution techniques and linear surrogate models. Thought Anchors and CAGE have also studied pairwise dependencies between generated reasoning units. Related work on counterfactual reasoning-step importance (e.g., Paul et al., 2024; Yu et al., 2025; Macar et al., 2026) further motivates a clearer distinction between local attribution and reasoning-level causal effects.
The paper does not clearly establish what is fundamentally new beyond combining these ideas into an efficient framework.
- Unclear causal interpretation and insufficient validation.
The method measures how removing a preceding unit changes the probability of an already generated subsequent unit. However, it is unclear whether this reflects meaningful reasoning dependencies or simply textual predictability.
For example, a step that repeats the answer may receive high attribution without contributing meaningful reasoning. Conversely, an important reasoning step may receive low attribution if its information is available elsewhere.
The main evaluation also uses essentially the same likelihood-based criterion as the attribution method itself. Therefore, stronger performance does not necessarily establish better causal explanations of reasoning. Notably, the improvements from additional interventions do not transfer to the regeneration-based evaluation.
Furthermore, the input ratio metric in Eq. (16) contains a position-dependent normalization factor, which may confound the interpretation that models increasingly revisit the input during later reasoning.
Questions for authors
- What is the key methodological novelty beyond existing LOO attribution, C-LIME, ContextCite, and CAGE? In particular, what does fitting the linear model add in the basic LOO setting?
- Why should changes in the likelihood of fixed generated text be interpreted as meaningful causal dependencies in reasoning? Can the authors provide independent validation beyond likelihood-based perturbation evaluation?
- Does the observed increase in input importance persist when using the fraction of total attribution assigned to input units, without the position-dependent normalization in Eq. (16)?
5 comments
Response to Reviewer qBCM (continued)
Question 1
What is the key methodological novelty beyond existing LOO attribution, C-LIME, ContextCite, and CAGE?
- With respect to MExGen/C-LIME and ContextCite, the difference is that they attribute only one output, to input/context units only. AttriCoT attributes multiple output units to both input units as well as previous output units. Furthermore, AttriCoT attributes all output units using a linear number of forward passes, whereas straightforwardly applying MExGen or ContextCite separately to each output unit would be roughly times as costly.
- With respect to CAGE, a key difference is that CAGE focuses on attribution of the final output to prompt sentences. The pairwise dependencies between reasoning units serve only as a means to that end.
- With respect to both CAGE and TA-KL, our main contributions are:
- A linear structural equation model (SEM) that can both exploit multiple-unit interventions as well as make predictions on held-out interventions (as in the random removal experiment), which CAGE and TA-KL cannot. Furthermore, with respect to MExGen C-LIME and ContextCite, this SEM has multiple equations (one per output unit), the equations depend also on previous output units, and they are all fit together from a shared, linear number of interventions.
- Faithfulness evaluation of all unit-to-unit attributions using perturbation curves, as opposed to only final-output-to-prompt attributions.
- Quantitative analysis of unit-to-unit attribution matrices (Section 6).
Overall, AttriCoT offers a combination of elements that goes beyond what any one of these prior works has, implemented in an efficient manner.
Lastly, we neglected to cite and discuss CAGE in the paper, so we thank you for bringing this to our attention. We have now done so in Section 2.
what does fitting the linear model add in the basic LOO setting?
You are right that for the basic LOO variant, linear regression is not needed to fit the linear model. However, the resulting linear model does turn LOO effects into a predictive model of the effects of multiple-unit removals. This predictive ability is precisely what enables the new random removal experiment.
Dear Reviewer qBCM,
Thank you again for your review. As the author-reviewer discussion will end on November 18 at 11:59pm AoE (a little more than two days from now), we would be grateful if you could read our rebuttal and post any follow-up questions and comments within the next day or so to give us time to respond.
Our responses to your concerns include a strengthened independent validation on estimating re-generative dependencies and an answer to your question about the input ratio metric. Changes to the paper are marked in red.
Thank you,
Authors of submission 34895
Response to Reviewer qBCM
Thank you very much for your review, and for recognizing the method’s computational efficiency and the coverage of the experiments and sensitivity analyses. Below we respond to your concerns, including a strengthened independent validation (estimating re-generative dependencies) that shows AttriCoT’s competitiveness with a much more expensive method.
Question 2
We would like to reiterate that our paper focuses on local causality, referring to causal effects on the given, generated units (as discussed in paragraph 3 of the introduction). These effects are measured by changes in the likelihood of the given units. Removing prior units is an intervention on the model’s context, and the likelihoods of later units causally depend on these prior units. We believe therefore that this is a valid notion of causality and that the main evaluation is appropriate for assessing estimation of local causal effects.
As your review notes, Appendix D.2.2 provides such independent validation by measuring effects on re-generation of output units rather than their likelihoods. We think that this evaluation is closer to what you mean by “meaningful causal dependencies in reasoning.” We have now strengthened this evaluation; please see the common response titled “Strengthened Re-generative Evaluation.” The new results reinforce AttriCoT’s competitiveness in estimating re-generative dependencies: AttriCoT-LOO is never more than 5% below a much more expensive re-generative method, and can even significantly outperform it (on GPQA).
We provide a possible explanation of why AttriCoT-2x + Ber(0.3)’s improvements do not transfer in our response to Reviewer MgUU.
Question 3
The paper does not claim that models “increasingly revisit” the input as reasoning progresses. Section 6.2 states only that the input ratio grows to a peak, which may occur during mid to late reasoning as in Figures 3(a)(b), after which it decreases again. The paragraph goes on to say that “this pattern is suggestive of the model referring back to the input as it reaches one or more answers,” i.e., a peak that may correspond to relating answers to the input, not a steady increase.
We actually computed what you suggest, the fraction of total attribution assigned to input units (now eq. (17)), in an earlier version of this work. We have now restored these plots as Figure 18 in Appendix D.6. The issue with the unnormalized fraction is that the number of input units is small, sometimes only 1, and becomes dominated by intermediate output units as the output position t increases. The fraction therefore decreases, but largely because of the rapidly decreasing proportion of input units. We thought therefore that it would be better to compare the average importances of input units to all preceding units. The position-dependent factor 1/(S+t−1) serves only to average over a position-dependent number of units. Note that even with input fraction’s downward bias in Figure 18, some curves (particularly DS-Llama-8B and DS-Qwen-14B in Figure 18(a)) still show a mid-reasoning bump, similar to what input ratio shows more clearly in Figure 17. The mid-reasoning bump persists when we segment the model output into sentences rather than reasoning steps, as seen in the new Figure 19(a).