- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies how the faithfulness of a language model circuit is measured, that is, whether it preserves the model's behavior. When combining the results from multiple prompts, the absolute value can be taken either after averaging, allowing errors to cancel each other out, or before averaging. The authors show that changing only this order can lead to selecting a different circuit, one that preserves the model's actual behavior less effectively. The effect is clear in the main setting but weaker across other tasks, methods, and models. They conclude that research on circuits should clearly specify how faithfulness is measured.
Critical strengths
Strengths
-
The experimentation is rigorous and coherent. The authors present the results in the main experiment and then investigate whether the findings extend to other tasks and models. This provides a solid experimental evaluation of the proposed effect.
-
Although the effect is weaker in some of the additional experiments, I think the work provides valuable insights into the task. The experimental evaluation is particularly useful because it offers evidence about both the strengths and limitations of the observed effect, helping to better understand when it occurs and how it may be measured.
-
The paper addresses an interesting methodological issue in circuit discovery. Its findings highlight how seemingly minor choices in the measurement of faithfulness can affect the conclusions drawn from an analysis. This is an important consideration for future work in this area.
Critical weaknesses
Weaknesses
-
The introduction starts somewhat abruptly. A paragraph introducing the task and the main idea would help readers understand the problem before moving into the technical details.
-
The concepts could be introduced more clearly throughout the paper. Many acronyms are used (FIELD, STRICT, MASS, IMP, DISC-KL, CMD, EAP, AtP), along with statistical and preregistration-related terms ("blocks", "materiality gate", "equivalence margin", "delete-one-block jackknife"), which make the paper more difficult to read. The introduction could be improved in this regard.
-
Although the experimental results support the main finding, the effect becomes weaker in some of the additional settings: it is confirmed in only 2 of the 6 families in the scope study, does not exceed the preregistered threshold in the 8B model, and almost disappears with counterfactual patching. These results make it difficult to determine how broadly the observations generalize to real-world circuit discovery, with larger models, other tasks, or standard search methods. Nevertheless, the experiments provide useful insights into the conditions under which the effect is more or less pronounced.
-
As the authors acknowledge, some of the observations in this work have already been reported in previous studies. Although Section 7 summarizes some differences, I think these should be explained more explicitly, particularly earlier in the paper. The specific contribution of this work is not entirely clear until the reader reaches this section. I suggest moving Related Work to Section 2, immediately after the Introduction, and clarifying the incremental contribution of this work relative to previous studies.
Questions for authors
Questions for the Authors
-
Could the authors clarify the specific incremental contribution of this work compared with previous studies, particularly given that some of the observations have already been reported?
-
Given that the contribution of this work is primarily methodological, do the authors plan to release the analysis code in a public repository after acceptance?
W4/Q1 — What this paper adds. Thank you for this suggestion. Related Work now follows the Introduction (§2), ending with “What is new here” and Table 2.
Prior studies showed that opposite-signed prompt effects can cancel. We do not claim first discovery of cancellation, sign effects in selection, or circuit instability. We ask what happens when only the order changes: average-first [FIELD] takes the magnitude after averaging signed prompt effects; per-prompt [STRICT] takes magnitudes before averaging. We isolate three decisions: scoring equal-size circuits, ranking edges at matched budgets, and accepting a size with ranking fixed. We measure selection and held-out behaviour.
The revision also tests edge ranking inside the Mechanistic Interpretability Benchmark (MIB) under counterfactual patching (W3). We recommend disclosing the order and checking claimed behaviour (§9), not always choosing one order.
W3 — Where does the effect generalise? We agree with the limits: the six-family test passed in 2/6 settings, Qwen3-8B did not pass its role-mean threshold, and head-set counterfactual gaps were small. The abstract summarises these limits and §8 details them. New tests clarify where the effect appears.
Benchmark thresholds were fixed in advance but pilot-informed; pools were fixed, test prompts reused, and some low-budget Qwen average-first circuits became empty after pruning (General response; Appendix G.1). The effect is conditional: larger under mean/role-mean in several settings; under counterfactual patching, head-set gaps shrink, no whole-graph test passed, yet our MIB plain-EAP test found gains. A separate evaluation audit reversed no rankings among four reproduced MIB configurations; we claim no revised leaderboard, and earlier EAP-IG-inputs KL/top-token claims on GPT-2 remain unestablished (§7; §8; Appendices B.1, C, F, G, G.1).
W1/W2 — Clarity. Section 1 now introduces circuit discovery, activation patching and IOI through a Mary/John example, then shows cancellation with two circuits (+2/−2 versus +1/+1) before any formula. The main text uses “average-first” and “per-prompt” throughout and removes or expands other shorthand; the appendices keep some old labels, defined in Appendix A. Section 3 explains thresholds, delete-one intervals and evidence labels.
Q2 — Code. Yes. The anonymous supplement includes analysis code, preregistrations and amendments, hashed results, and nine claim ledgers with verification commands; eight run as shipped, while one needs unshipped unit arrays. An MIT-licensed, tested package implements both aggregation orders, cancellation checks and edge scoring, with a command to rerun selection and compare with the paper. Omitted inputs are identified by hashes. We will release the code and size-omitted raw discovery files publicly on publication.