- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Subspace Attribution Patching (SAP), which refines component-level EAP by projecting messages onto custom orthonormal basis axes in the residual stream. The authors evaluate various basis construction methods, reveal that top-performing bases can suffer from the "Interpretability Illusion", and propose a conditional variance metric (NormCondVar) alongside qualitative analyses to diagnose these illusions.
Critical strengths
-
Exposing the Interpretability Illusion: The paper does a great job demonstrating that finer-grained/subspace attribution methods can easily hallucinate causal effects through cancelling directions, cautioning the community against blind faith in standard faithfulness metrics.
-
Extensive Empirical Evaluation: The authors evaluate their methods across a diverse set of tasks and benchmarks (e.g., IOI, Greater-Than, Gender-Bias), accompanied by thorough statistical testing.
Critical weaknesses
-
The constructed "basis axes" are not intrinsic, persistent properties of the model. Because they shift depending on the specific heuristic, task, or data split, claiming that these axes carry standalone "semantics" feels quite forced—there is no stable mapping between a mathematical axis and a real semantic concept. Furthermore, these axes neither correspond to specific physical weights/neurons nor offer monosemantic, sparse representations like SAE features. In that sense, the paper’s primary take-home message seems to be showing how artificial subspace splitting leads to interpretability illusions, rather than establishing basis axes as valid, fundamental computational units.
-
Compared to sparse feature circuit discovery (e.g., SAE- or Transcoder-based circuits), SAP is less fine-grained and offers much less justifiable interpretability. It is difficult to see SAP standing on its own as an appealing new circuit discovery paradigm. The authors should reconsider the core positioning of the paper—perhaps framing it primarily as a diagnostic study of subspace illusions—and include a head-to-head comparison and deeper discussion against genuinely fine-grained sparse circuit methods.
Questions for authors
none
3 comments
Please respond to the authors
Hello!
Just a friendly bump that you should engage with the authors response
Dear Reviewer CLEu,
Thank you again for reviewing our paper and for your thoughtful and constructive feedback. We have posted our responses to your comments along with a revised manuscript, and would greatly appreciate any further thoughts you may have before the discussion period ends.
If our responses have addressed your main concerns, we would be grateful if you would consider revising your rating upward. If any concerns remain, please let us know and we would be happy to provide further clarification.
Best regards,
The Authors
Response to Reviewer CLEu
We thank the reviewer for their time in reviewing our paper and for their critique. We hope to have addressed their concerns below.
On basis axes as properties of the model
We agree with the reviewer that several bases which we evaluate are not intrinsic properties of the model. These are the data-derived bases Eig, SVD, RGrad, WMsg, NDM and NDMAx. We note that an SAE or a Transcoder basis is also not an intrinsic property of the model, and is similarly data-derived. However, we argue that the RWght and WWght bases are intrinsic, being constructed from an SVD of model weights. In this way (as Reviewer ApgJ points out), our work connects to prior work on SVD-based circuit analysis, which finds that singular vectors of model weights are highly interpretable with respect to the function of a given model component. We refer the reviewer to our discussion with Reviewer ApgJ for more details.
It is also true that the axes found shift between scoring methods, tasks and data splits; this is simply because the circuit which we are trying to find is task-specific. In our view, all subspace circuit localization methods would share this property. Finally, as we discuss in the paper, it is optimistic to expect the subspace axes for a particular edge to be aligned to the weight or neuron basis (please see: Arora et al. 2018, Elhage et al. 2022, Mueller et al. 2026, as cited in our paper). SAEs are better in this respect, but please see below.
On comparing SAP with SAE-based approaches
We thank the reviewer for raising this point, which was also raised by Reviewer ksrg. Our formulation of SAP has a number of advantages with respect to SAE-based circuit discovery methods.
A basis of SAE features does not (in general) form an admissible basis for an attention head writer at a given layer. Thus, an SAE basis is not guaranteed to produce patches which lie in the writer's column space, and is likely not to, as it spans the output space of all the attention heads in a given layer together. This could be overcome by training an SAE on the outputs of individual attention heads separately; however, this is expensive and not commonly done. Our bases are constrained to be a complete basis of the column space of each writer.
An SAE basis is not a complete orthonormal basis of the residual stream (it is overcomplete). This means that the scores of the basis axes separately will not add up to the score of the edge as a whole, due to the non-orthogonality of the axes. SAP ensures this property by construction, capturing the notion that (estimates of) their separate causal effects add up to the (estimated) causal effect of the whole.
To get around these problems, Marks et al. (2025) and other approaches dispense with the notion of edges between specific model components (attention heads and MLPs) and trace circuits between SAE features as the fundamental unit of analysis. This approach, however, ignores the fact that individual attention heads as such play important functional roles within many circuits.
Many subspaces used within a circuit are multidimensional, a fact which cannot be captured by tracing circuits with respect to an SAE basis. As discussed in Engels et al. (2025), SAE directions necessarily split multidimensional feature spaces (e.g., a 2D circle subspace for the days of the week) into a sum of one-dimensional features coding for the most common clusters within the space (e.g., each day separately). This is a property intrinsic to the SAE training objective. The bases we define have no such constraint, which allows us to find such multidimensional subspaces. We illustrate one such edge in Figure 1.
SAE-based circuit localization approaches frequently make use of "error terms" that store residual activation which could not be decomposed using the SAE basis. This means that a potentially large part of the edge score is carried by uninterpretable "dark matter" (in the parlance of Engels et al., 2024) rather than being decomposed into interpretable axes. Marks et al. find that such error terms are crucial parts of the circuit, as removing them from the circuit drastically reduces circuit faithfulness on both Pythia-70M and Gemma2-2B. An error term is an integral part of an SAE decomposition; our approach decomposes the entire edge score using a complete basis by construction, and has no error term.
We have added a discussion of these points to Appendix C of the amended manuscript. We hope that this alleviates the reviewer's concerns regarding the advantages of SAP over SAE-based approaches.