- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a two-stage counterfactual learning framework for GNNs and HGNNs. It first identifies candidate supporting nodes through structural interventions. It then validates these nodes through node-feature interventions. The resulting counterfactual samples are used to constrain classification boundaries and decision-transition directions. The framework aims to make model decisions easier to interpret and improve performance on multi-class fault diagnosis tasks.
Critical strengths
-
A coherent use of counterfactual information beyond post-hoc explanation. The paper connects structure-level support discovery, node-feature intervention validation, and subsequent decision-transition learning within a unified framework. The generated counterfactuals are used as structured supervision rather than only as post hoc explanations, which is an interesting direction.
-
Relatively extensive empirical analysis. Beyond classification performance, the paper evaluates counterfactual validity, support sparsity, cross-stage intervention consistency, and several ablations. These analyses validate different components of the proposed framework.
Critical weaknesses
-
The causal interpretation appears stronger than what the current evidence supports. The paper repeatedly refers to the identified supports as "causal" and interprets prediction changes following interventions as evidence of causal factors. The experiments show that intervening on these variables can affect the predictions of the fixed model, supporting an intervention-based explanation of the model's behavior. However, the current evidence does not provide sufficient support for a stronger causal interpretation beyond the model's predictive behavior. The distinction between model-level causal influence and real-world causality should be clarified, as this interpretation is central to the paper's claims.
-
The justification for gradient-direction alignment is insufficiently established. Section 2.3 uses a first-order Taylor expansion, , to motivate alignment between the counterfactual direction and the gradient . This expansion establishes that their inner product determines the first-order change in the relative decision function, but it does not imply that the two directions must be aligned. The cosine-alignment objective may be a useful regularizer, as suggested by the ablation results, but its theoretical justification requires further clarification.
Questions for authors
-
Could the authors clarify what notion of causality is intended by terms such as "causal supports" and "causal nodes"? Are these claims intended only with respect to the fixed model's prediction under input interventions, or also with respect to the underlying physical process? If the latter, what assumptions or evidence support this interpretation?
-
Could the authors provide additional justification for requiring the counterfactual direction to align with the local gradient ? In particular, the first-order Taylor expansion establishes , but does not appear to require cosine alignment between the two directions. Is the alignment loss primarily an empirically motivated regularizer?
3 comments
I appreciate the authors' efforts in addressing my concerns. The motivation for combining the different components could be better justified. The framework seems well suited to industrial fault diagnosis, but its applicability to broader graph learning tasks remains unclear.
Clarification on Framework Integration and Broader Applicability
We thank the reviewer for this constructive follow-up. We agree that the dependency among the components should be made more explicit. Our framework is intended as a closed loop of discovery, validation, and learning, rather than a collection of independent modules. Stage 1 identifies a compact structural support associated with the source prediction. Stage 2 restores the original graph structure and intervenes on the features of this support to test whether it can induce the specified target transition. The resulting model-valid source–counterfactual pairs are then used by dual-target learning to constrain both fault-to-normal restoration and fault-to-fault decision boundaries. Thus, Stage 2 converts structural attribution into intervention-backed evidence, while the learning stage converts validated counterfactuals from post-hoc explanations into structured supervision. Without Stage 1, the feature search lacks a compact prediction-relevant region; without Stage 2, the identified support is not interventionally validated; and without paired transition learning, the generated counterfactual relations are not exploited to refine decision boundaries. The support-selection, dual-branch, and objective-component ablations were designed to examine these dependencies. We will revise the motivation and method overview to present this closed-loop rationale more clearly. Regarding applicability, the optimization framework itself does not rely on TEP- or Paderborn-specific equations, sensor identities, or fault definitions. It requires a differentiable graph/hypergraph classifier, intervenable node features, and meaningful source–target class transitions. The experiments cover two distinct settings—a learned graph with GNN-TAM and a fixed, knowledge-informed hypergraph with HGNN—showing that the method is not tied to one graph construction or backbone. Nevertheless, we agree that both datasets are industrial fault-diagnosis benchmarks, so the current evidence does not establish empirical generality across all graph-learning domains. We will explicitly narrow the empirical claim to graph- and hypergraph-based fault classification and distinguish it from the broader methodological applicability of the framework. Extension to molecular, biological, and other graph-classification tasks will require domain-specific plausibility constraints and constitutes important future work. We appreciate the reviewer’s comments, which help us clarify both the necessity of the integrated design and the appropriate scope of our claims.
Clarification of Model-Level Causality and Gradient-Alignment Motivation
We thank the reviewer for the careful assessment and for identifying two places where our claims and motivation require clarification.