- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes a regularization term for network training that helps deal with overfitting. The regularization term couples two networks trained together from different initializations, and penalizes the difference of the two networks. By "difference" it measures how one network's output is affected by a particular combination of input patches. Namely they measure the change in the true-class log-odds that are caused by co-appearence of patch groups and compare this effect of one network with the other.
The experiments train VGG, ResNet and AlexNet on CIFAR-10 and Tiny-ImageNet, BERT on SST-2, and fine-tune Qwen2.5-3B with LoRA. With the regularization term the gap between test and training loss becomes smaller.
Critical strengths
1 Employing cross-network agreement on second-order differences as a training loss is a further development within the line of research on game-theoretic interactions in DNNs.
2 The direction of the effect is consistent across CNNs, BERT and a 3B LLM.
Critical weaknesses
(1) Novelty is marginal. The essential novel idea boils down to an additional training regularization.
While a significant part of the paper is devoted to the technical stack: interaction computation, the sparsifying AND-OR split, the patch selection and the reference-network test of generalizability. These tools/skills are taken from earlier works. Findings from a line of research, e.g. Ren et al. (2024b) and He et al. (2025), are repeated.
This also includes Zhang et al. (2024) and Cheng et al. (2025), which are not cited.
The loss itself is close in form to Zhang et al. (2021), which is not cited either.
References
- Ren, Q., Zhang, J., Xu, Y., Xin, Y., Liu, D., Zhang, Q. (2024b). "Towards the dynamics of a DNN learning symbolic interactions." NeurIPS 2024. arXiv:2407.19198.
- He, Y., Zhang, J., Cheng, L., Zhang, H., Zhang, Q. (2025). "Technical report: Quantifying and analyzing the generalization power of a DNN." arXiv:2505.06993.
- Zhang, J., Li, Q., Lin, L., Zhang, Q. (2024). "Two-phase dynamics of interactions explains the starting point of a DNN learning over-fitted features." arXiv:2405.10262.
- Cheng, L., Zhang, J., Ren, Q., Zhang, Q. (2025). "Revisiting generalization power of a DNN in terms of symbolic interactions." arXiv:2502.10162.
- Zhang, H., Li, S., Ma, Y., Li, M., Xie, Y., Zhang, Q. (2021). "Interpreting and boosting dropout from a game-theoretic view." ICLR 2021. arXiv:2009.11729.
(2) The motivation of the first finding is not clearly stated. The paper does not say whether the samples on which interactions are analysed are training or test samples. The conclusion even suggests they are training samples ("pinpoint the specific set of training samples on which such overfitted interactions emerge", Sec. 4). If so, an interaction that the target network encodes on its own training sample, but a reference network that never saw this sample does not encode, is just what overfitting means. Then "overfitted networks encode more non-generalizable interactions" restates overfitting rather than explains it.
Questions for authors
What does it mean to "explain" overfitting with non-generalizable interactions? An interaction is called non-generalizable when the target network encodes it on a sample but a reference network that never saw the training data does not.
9 comments
Response to Reviewer pShE (Part 2/2)
Q2: Ask which samples are used to evaluate interaction generalizability and whether the finding merely restates overfitting
(2) The motivation of the first finding is not clearly stated ... restates overfitting rather than explains it.
A: A good question. We have several perspectives from which to address your concern.
First, let us clarify the difference in the experimental settings between Section 2.2 and Section 2.3. In Section 2.3, two target DNNs are trained on the same data to measure interaction transferability. Therefore, the interactions are evaluated on the training set, and the interaction patterns in Figure 3 represent patterns that can be transferred across different DNNs. Such patterns are generally more reliable. In Section 2.2, the baseline DNN is trained on data that are unseen by the target DNN. The samples used to compute the interaction distributions in Figure 2 are test samples of the target DNN. Therefore, the interaction patterns in the target DNN, which can be transferred to baseline DNNs, actually represent patterns generalizable to unseen data (training samples of the baseline DNN are not used to train the target DNN). If an interaction pattern can be transferred to the baseline DNNs, this interaction pattern can also serve as a common inference pattern for the unseen data and is therefore generalizable [cite1, cite2].
Second, whether interaction generalizability is a restatement of model generalization or an explanation of model generalization is an insightful point. To some extent, yes: our study provides a fine-grained characterization of the overfitting phenomenon with validated practical value in model training, rather than an explanation of the fundamental causes of overfitting.
However, the exact causes of overfitting are naturally ambiguous and lack strict analytic formulations. In comparison, we adopt a reductionist perspective: a precise and structured mechanistic description of the overfitting phenomenon itself would contribute more to substantive progress in the field than qualitative findings that lack strict constraints.
Historically, because overfitting has not been analyzed in sufficient detail, practitioners have often had to rely on various regularization techniques to address it, with limited efficiency. As shown in Figure 4 and Table 2, once we can accurately identify and intervene on non-generalizable interactions, the loss gap decreases much more efficiently in our experiments.
[cite1] Defining and Extracting Generalizable Interaction Primitives from DNNs. ICLR, 2024.
[cite2] Does a Neural Network Really Encode Symbolic Concept? ICML, 2023.
Q3: Ask what it means to explain overfitting with non-generalizable interactions
What does it mean to "explain" overfitting ... does not.
A: Thank you for pointing out the imprecise wording. We will describe our contribution more precisely as a fine-grained characterization and intervention of overfitting, thereby removing the ambiguity that the word “explain” may have introduced in our previous wording.
Our work does not attempt to explain the fundamental features, root causes, or training settings that lead to overfitting. Instead, we use interactions as a new mathematical tool to reveal local details of the global overfitting phenomenon. Overfitting, traditionally viewed as a property of the model as a whole, is represented in terms of the aggregate generalizability of the interaction patterns encoded by the model.
More crucially, this decomposition of overfitting provides precise guidance for further mitigating DNN overfitting. Our experiments in Figure 4 and Table 2 also show that penalizing non-generalizable interactions reduces the loss gap in DNNs more efficiently than competing regularization methods.
Follow-up on our rebuttal
Dear Reviewer pShE,
Thank you again for your comments and for taking the time to review our responses. As the author–reviewer discussion period will end on November 18, we would sincerely appreciate any feedback on whether our responses have addressed your concerns.
If any concerns remain, please let us know, and we would be happy to provide further clarification or additional analyses before the discussion period closes.
Many thanks for your time and consideration.
Response to Reviewer pShE (Part 1/2)
Thank you for your great efforts on the review. We will try our best to answer all your questions.
If any answer is unclear or you have further questions, please let us know so we can respond before the deadline.
Q1: Ask about the relation to prior interaction-based work
A: A good question. This paper advances the research frontier of interaction-based explanation from the conventional topics of “interaction extraction” and “phenomenological analysis” to interaction-rectification-based generalizability enhancement.
Interactions offer a new mathematical representation tool for characterizing generalization of a DNN, and this tool has already been widely used [cite1, cite2, cite3]. However, previous studies are mainly limited to the scope of explaining and analyzing DNN generalization, e.g., examining DNN training dynamics [cite4, cite6], and measuring interaction generalizability [cite5, cite7].
By contrast, our work is the first, to the best of our knowledge, to move the research frontier from interaction extraction and analysis to interaction-rectification-based generalizability enhancement. Specifically, we explore a new methodology for boosting a model’s generalizability, i.e., directly penalizing non-generalizable interactions. Experiments show that our interaction-based training method reduces the model's loss gap much more significantly than standard regularization methods.
In sum, this work, for the first time to the best of our knowledge, advances the frontier of interaction-based explanation to the scope of interaction-rectification-based generalizability enhancement, and significantly reduces model overfitting.
In addition, regarding the paper [cite8] that you highlight, [cite8] shows that dropout mainly penalizes high-order interactions, but this paper does not rigorously disentangle non-generalizable interactions. Therefore, merely optimizing interaction complexity cannot improve performance as effectively as our method. Nevertheless, we will carefully cite and discuss all the above papers.
[cite1] Defining and Extracting Generalizable Interaction Primitives from DNNs. ICLR, 2024.
[cite2] Explaining Generalization Power of a DNN using Interactive Concepts. AAAI, 2024.
[cite3] Does a Neural Network Really Encode Symbolic Concept? ICML, 2023.
[cite4] Towards the dynamics of a DNN learning symbolic interactions. NeurIPS, 2024.
[cite5] Technical report: Quantifying and analyzing the generalization power of a DNN. arXiv:2505.06993.
[cite6] Two-phase dynamics of interactions explains the starting point of a DNN learning over-fitted features. arXiv:2405.10262.
[cite7] Revisiting generalization power of a DNN in terms of symbolic interactions. arXiv:2502.10162.
[cite8] Interpreting and boosting dropout from a game-theoretic view. ICLR, 2021.