- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates whether DNNs encode generalizable patterns in specific feature directions. Using AND-OR interactions and a first-order Taylor decomposition, the authors learn a few directions that preserve low-order, more generalizable interactions. They show these directions transfer to unseen samples and largely preserve classification performance.
Critical strengths
The trend that low-order interactions generalize better is shown consistently across CNNs, ViTs, tabular models, and pretrained ImageNet models. This matters for my assessment because it suggests the finding is not specific to a single architecture or dataset. It is the most convincing empirical result in the paper.
Critical weaknesses
1.Patch selection. The paper does not explain how the input patches are selected or justify the choice theoretically. Since generalizability is determined by exact patch-index matching across models, the results may depend heavily on this choice. A sensitivity analysis is needed.
2.Scalability. There is no evidence that 10 patches suffice for high-resolution or complex images. Exact extraction requires 2ⁿ forward passes per sample, which prevents scaling to larger n and limits the generality of the conclusions.
3.Relation to SHAP. The AND interaction is the Harsanyi dividend, from which Shapley values are directly derived. The authors should clarify how their approach differs from SHAP and from Shapley interaction indices, and what concrete advantage it offers.
4.Taylor approximation. It is unclear whether the first-order Taylor approximation of the layer output is accurate. The only reported case study shows substantial error (about 26% of the masking-induced output change). Validation across all models and layers is needed.
- Practical utility. It is unclear what the identified directions enable in practice. Unlike CBMs, which allow concept-level intervention, the paper uses projection only for evaluation. It does not show any downstream use, such as improving generalization or model editing.
Questions for authors
See weakness