- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes AdaMF, a robust GNN for node classification under evasion attacks. It has three components: (1) a hybrid spectral filter that combines low-, high- and mid-pass filters with learnable weights on the probability simplex, (2) a framelet-based multi-scale filtering branch to capture localized variations, and (3) a pseudo-label-guided prototype contrastive loss between two views augmented with 1% feature and structure perturbations. The paper provides bounds on the sensitivity of the hybrid filter to eigenvalue and Laplacian perturbations. Experiments on Cora, Citeseer, Pubmed and ogbn-arxiv against ten baselines and seven evasion attacks (five graph modification and two node injection attacks) show that AdaMF achieves the best accuracy in almost all settings, with further results under varying perturbation strength, a 10% target-node setting, ablations and a sensitivity study.
Critical strengths
The method is simple and well motivated by the observation that attacks shift the whole spectrum rather than one band, and the evaluation covers several datasets (including ogbn-arxiv), ten baselines and seven attacks, with consistent improvements and an ablation of each component.
Critical weaknesses
1. The evaluation does not convincingly show adversarial robustness.
- Mismatch between the attacks and the theory. For the graph modification attacks, the paper perturbs 2% of the feature dimensions of 1% target nodes, i.e., only features are changed and the graph structure is untouched. However, the motivation and Theorem 2 concern perturbations of the graph Laplacian, which do not change under feature-only attacks, so the theory does not apply to most of the reported results. Classic structure attacks such as Metattack, Nettack or PGD, which are discussed in the related work, are not evaluated.
- No adaptive attacks. The paper does not state whether the attacks are generated against AdaMF itself or transferred from other models. Prior work (e.g., Mujkanovic et al., 2022) shows that many GNN defenses break under attacks designed against them, so evaluating only against generic attacks likely overestimates robustness.
- The attacks appear weak. Many models barely degrade under attack; for example, AutoGCN on Cora drops only from 85.40 to 85.03 under GC-RWCS. AdaMF sometimes performs better under attack than on clean data (Cora RWCS: 88.35 vs. 88.17 clean; Pubmed AFGSM: 90.00 vs. 88.56 clean), which suggests the attacks are not strong enough to test robustness.
- Unfair comparison. AdaMF is trained with 1% feature and structure perturbations as augmentation, which acts as a mild form of adversarial training, while the baselines are not. It is unclear how much of the gain comes from this augmentation rather than from the proposed filters.
- Incomplete statistics. The paper reports paired t-tests over 10 runs, but Table 1 gives no standard deviations. AFGSM uses only 50 fixed target nodes, so accuracy per run moves in steps of 2%, and differences between methods may not be meaningful.
2. Limited novelty and some inconsistencies.
- Limited novelty. Adaptive combinations of multiple frequency filters (e.g., AutoGCN, and HyperAIM cited by the authors) and framelet-based GNNs (Zheng et al., 2021) already exist. The paper mainly combines these components and applies them to adversarial robustness.
- Inconsistencies. ξ = 1 is used in all experiments, but the sensitivity analysis only covers ξ ∈ {0.1, 0.3, 0.5, 0.7, 0.9}, which excludes the default value. On ogbn-arxiv, some baselines have unusually low clean accuracy (GAD 33.66, Elastic 25.86), which suggests they may not be properly tuned.
Questions for authors
- How does AdaMF perform under structure attacks such as Metattack, Nettack and PGD, which are the setting the motivation and Theorem 2 address?
- Are the attacks generated against AdaMF itself? Can you report results under adaptive white-box attacks that target the full AdaMF model?
- Can you explain why AdaMF sometimes performs better under attack than on clean data, and report results with stronger attack budgets on all methods?
- How do the baselines perform when trained with the same 1% perturbation augmentation, and how does AdaMF perform without it?
- Can you report standard deviations for Table 1 and the results of the t-tests per setting?
- Why does the sensitivity study exclude ξ = 1, and how were the baselines tuned on ogbn-arxiv?