- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
IV-SENN predicts node labels using normalized h-motif counts, learned feature prototypes, and a quadratic concept-interaction head. It provides exact concept-level logit decompositions and recomputes changes under structural edits with fixed model parameters. A separate convolutional branch supports local motif grounding. Experiments cover four real hypergraphs and a synthetic benchmark for motif recovery and intervention-effect comparison.
Critical strengths
- Using h-motifs directly preserves higher-order structural semantics and connects concept contributions to concrete hyperedge patterns. This is a useful explanation interface for hypergraphs.
- The evaluation includes retained/removed-subgraph fidelity, stability, planted-signal recovery, and null-intervention controls. The reported fidelity and stability improvements provide empirical support beyond classification accuracy.
Critical weaknesses
- The local grounding rule can miss interaction-driven concepts. Equation 37 selects candidate motif types using only effective linear weights, before Equation 27 considers their full contributions. Important types with weak linear weights may therefore be excluded. It is unclear how often this affects the reported explanations.
- The methodological and theoretical advances appear incremental. The compositional map is a linear reparameterization (Proposition 5(a)), and the convolutional branch does not enter prediction. Theorem 1 then formalizes exact differences of the resulting quadratic head. Table 3 supports the design empirically, but the conceptual advance beyond this transparent predictor remains modest.
- N-SYNTH measures agreement with a predefined quadratic reference score that does not generate the training labels (Appendix C.1). This is a useful controlled check, but its interpretation is limited to that reference. I therefore place less weight on this result as evidence of broader intervention-effect recovery.
Questions for authors
Please see the weaknesses above.
3 comments
Response to CW3
CW3:Scope of the N-SYNTH Results and Intervention-Effect Recovery
Response: Thank you for raising this concern. The original N-SYNTH experiment has a limitation as a test of intervention-effect recovery. The quadratic reference score was not used to generate the labels, so Table 2 measures agreement between the model’s response and changes in that reference score. To test whether IV-SENN can recover intervention effects defined by the label-generating mechanism, we added an experiment that uses the same nonquadratic rule to generate the training labels and compute the reference probability change for each test edit. IV-SENN was trained on unedited hypergraphs and evaluated on an independently generated test hypergraph. The results are shown below.
| Target | Edits | IV-SENN MAE ↓ | Baseline MAE ↓ | Dir. agreement ↑ |
|---|---|---|---|---|
| hm8-target | 472 (460) | 0.0437 ± 0.0015 | 0.0862 | 0.8539 ± 0.0106 |
| hm17-target | 465 (450) | 0.0392 ± 0.0016 | 0.0674 | 0.8018 ± 0.0183 |
Edits are reported as total (nonzero reference changes). The baseline predicts zero change.
For both edit targets, IV-SENN achieved lower probability-change MAE than the zero-change baseline and direction agreement above 0.80. These results show that, under this nonquadratic label-generating mechanism, IV-SENN can estimate the magnitude of probability changes caused by unseen hyperedge edits and recover their direction for most edits. Appendix D.11 (p. 29, lines 1544–1556) describes the protocol, and Table 3 in Section 5.4 reports the full results (p. 9, lines 446–452).
Official Comment by Authors
Dear Reviewer,
With the author response deadline approaching, we would appreciate any further feedback on whether our revisions have addressed your concerns.
We quantified how often candidate screening changes the final explanation, clarified the methodological and theoretical contributions, and added an experiment that uses the same nonquadratic rule to generate labels and define reference probability changes. The additional results support intervention-effect recovery under this known mechanism.
If these revisions and our responses have addressed your concerns, we would be grateful if you would consider a higher score. We remain available to clarify any outstanding questions.
Thank you again for your time and constructive comments.
Best regards, The Authors
Response to CW1-CW2
Thank you for identifying aspects of the manuscript that needed further clarification. We quantified how often candidate screening changes the selected explanation, clarified the link between motif-based prediction and hyperedge edits, and added a synthetic experiment with known probability responses. We address each of your concerns below.
CW1:Interaction-Driven Motifs Missed by Candidate Screening
Response: Thank you for pointing this out. We agree that a motif type with a small effective linear weight can still make a substantial contribution to the class prediction through interactions. Equation (37) uses only the magnitude of the effective linear weight to screen types, whereas the full contribution of a local type k is ϕv,k(c)=sv,k(wk,cstruct+Iv,k(c)), where Iv,k(c) is the interaction term. Let Mv be the largest positive contribution among the retained local types, with zero as the baseline. An excluded type with sv,k>0 exceeds Mv whenever Iv,k(c)>Mv/sv,k−wk,cstruct. In the pooled audit of Cora and DBLP, 4.4% of evaluated nodes had an excluded local type whose full contribution exceeded that of every retained local type.
To measure how often screening changed the final explanation, we held the predictor and three-hyperedge budget fixed and compared the original selection with the selection obtained by admitting all local motif types to Eq. (27). The selected explanation changed for 59 of 1,894 nodes on Cora (3.12%) and 710 of 36,433 nodes on DBLP (1.95%). An omitted type can rank higher by full contribution and still receive a lower grounding score once role evidence and instance matching are included. Across both coauthorship datasets, candidate screening preserved the selected explanation for the vast majority of evaluated nodes, showing that the rule can narrow the candidate set while keeping the final instance selection largely stable.
We added the screening condition and the audit to Appendix D.1 (p. 19, lines 1008–1016). Your comment also motivates future work on how to incorporate interaction contributions into screening while limiting the number of candidates.
CW2:Methodological and Theoretical Contributions
Response: Thank you for raising this point about the methodological and theoretical contributions. The original manuscript devoted more space to the quadratic head and could have made clearer how h-motif encoding, instance selection, and intervention analysis work together to explain hypergraph predictions. As a result, our advances in explanation at multiple levels and in hyperedge intervention analysis were less apparent.
Our main contribution is to connect the higher-order structural concepts used by the predictor to specific hyperedges in the original hypergraph and test the model’s response to edits of those hyperedges. To our knowledge, IV-SENN is the first self-explaining hypergraph model to use h-motifs as explicit structural concepts in its prediction path. An h-motif describes an overlap pattern among three connected hyperedges, giving prediction and explanation a common structural unit.
On the methodological side, we propose a rule that grounds a type-level h-motif contribution in a concrete instance. Equation (27) combines the type-level contribution from the prediction head with role weights from the convolutional branch and an instance match score. It selects a complete h-motif instance near the target node, and the three constituent hyperedges form the local explanation.
On the theoretical side, we use the definition of normalized h-motif frequencies to derive how hyperedge deletion changes the structural encoding. Proposition 3 bounds the changes in the frequencies of non-target types. Once the edited encodings are available, Theorem 1 uses finite differences of the quadratic head to calculate the exact logit increments from the structural and feature-prototype updates in the specified order. This traces how an edit to the original hypergraph affects the model’s output.
We revised the contribution statement in the introduction and the passages that describe and discuss the method. These revisions explain the distinct problems addressed by instance selection and intervention analysis and make the methodological and theoretical advances clearer.