- Rating
- 3
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes STAR, a transferable approach for explaining the predictions of pretrained graph neural networks (GNNs). STAR first trains a generator using multiple source GNNs to produce initial edge importance scores based on the input structure and the representations and predictive responses of the model being explained. It then performs local optimization, subgraph search, and candidate selection on the target model to refine potentially unsuitable source-derived guidance. Both the generator and the target GNN remain frozen during explanation. The authors conduct comparative and ablation experiments across six datasets and three GNN architectures. The results show that the complete procedure achieves competitive explanation fidelity in most evaluated settings.
Critical strengths
-
The paper addresses a practically meaningful problem in explanation transfer: Many parameterized explainers are trained for a particular model, and their effectiveness may not be preserved when the model being explained changes. Refitting an explainer may also require additional target samples.
-
The experimental evaluation is extensive. The paper includes multiple datasets, several model architectures, component ablations, and cross-domain tests. These experiments examine the complete method from different perspectives and provide empirical support for its effectiveness and transferability within the evaluated settings.
Critical weaknesses
STAR uses pretrained source GNNs to train a generator that produces initial explanation scores. However, whether the knowledge learned by the generator from these source models is representative and applicable to the target model’s decision-making process requires further validation. Although the paper includes held-out and cross-domain evaluations, it does not sufficiently establish how source model quality, diversity, and differences from the target model affect the initial scores and final explanations. Consequently, it remains unclear how much benefit the generator provides when available source models are limited or differ substantially from the target model, and whether subsequent refinement can adequately compensate for unsuitable guidance.
Questions for authors
How sensitive is STAR to the choice of source models? When source models are of lower quality, fewer in number, or rely on different decision cues from the target model, how do the quality of the initial edge scores and the final explanations change? To what extent can target-specific refinement compensate for unsuitable source-derived guidance?
Thank you for your valuable question. We examine the initial and final explanations under limited source availability and a held-out target architecture, and explain how STAR handles potentially unsuitable source guidance.
Firstly, in each run, the explanatory prior generator is fitted using only three source GNNs pretrained on MUTAG, one GCN, one GAT, and one GIN. It then explains target GNNs pretrained on BBBP. BBBP is excluded from generator fitting, and search width is fixed without selection on BBBP. Results are averaged over three seeds.
With this restricted source collection from a different dataset, refinement improves average Fidelity AUC by 0.0899 and Robust Fidelity AUC by 0.0902. These comparisons quantify the improvement over explanations derived from the initial edge scores when only a small source collection is available.
Secondly, we conduct an additional leave-one-architecture-out experiment. Every GCN–dataset combination is excluded from generator fitting and inference-configuration selection. Only GAT and GIN models across the six datasets participate in these procedures. The held-out GCNs are used exclusively for target evaluation, without generator refitting. Results are averaged over three seeds.
Refinement improves both dataset-level mean metrics on all six datasets despite the absence of the target architecture from the source collection. Average Fidelity AUC increases by 0.0593, and Robust Fidelity AUC increases by 0.0617.
Regarding lower-quality source models or different decision cues, their influence enters STAR through the explanatory prior learned by the generator. At explanation time, the generator also conditions on the target GNN’s input information and predictive responses, rather than simply reproducing a source-associated explanation. Refinement then assesses prior-guided candidates alongside locally optimized alternatives under the target GNN. Source-derived guidance therefore influences the search without uniquely determining the final explanation.
This design addresses source–target differences by using source-acquired information to guide candidate construction and the target GNN’s predictive responses to assess the resulting explanations. Locally optimized alternatives allow refinement to select evidence beyond the generated prior when that guidance is unsuitable. The improvements in both tables demonstrate the benefit of this target-specific refinement under limited source coverage and an unseen target architecture.