- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper tries to simplify the U/R/S decomposition into something more achievable in practice. This is maybe done by the marginal/interventional value function and this is maybe to connect to the mechanistic interpretability literature.
Critical strengths
Critical Strengths
Understanding U/R/S decompositions into unique contributions, redundant contributions, and synergistic contributions is an important problems.
It is very possible there are good ideas hidden behind the current writing.
Critical weaknesses
Critical Weaknesses
-
This paper manages to conflate all four commonly used value functions from the XAI literature: the baseline value function, the marginal value function, the conditional value function, and the causal value function.
-
The word "causal" is occasionally used when the "interventional" meaning is implied (i.e. true to the model). It is unclear whether this is an error due to the above conflation. If not, the wording interventional should probably be used throughout, or the authors should clarify they mean causal in the sense of mechanistic interpretability [A]. If that is true, the SCM wording should also probably be removed because it is confusing.
-
This is of particular concern because the typical definitions of U/R/S are directly tied to the conditional/informational interpretation of interpretability. In particular, there is no existing definition of "interventionally redundant information" and the paper seemingly makes no attempt to define it for their work, despite its seeming importance for their claims and their experiments. It is very plausible to me that this would be an interesting research direction introduced by this paper; however, the current version makes no attempt to make this clear.
-
The Monte Carlo bound and related variance reduction seem completely unrelated to the practical problem at hand, which is the exploration of all the subsets to properly define the minimum and maximum (later called the "budgeted regime"). It seems that assumptions on the functional form would be more appropriate to show the search gives a good approximation (e.g. submodularity like properties). The current theory does not seem relevant to the practical research.
-
The reasoning behind the reduction should be discussed more explicitly in the paper. Otherwise, the importance of the work in connection with existing work on "diamond sampling" from the feature interaction literature and marginal contributions will not be fully understood.
[A] "Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretability" Atticus Geiger et al. JMLR 2025.
Questions for authors
See the weaknesses above. If necessary, please ask your friend to convert the above weaknesses into a list of corresponding questions.