- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
WaveGuard addresses transductive source-free graph test-time adaptation for node classification. The method computes a fixed node-wise intervention score that combines multiscale graph-wavelet deviation from source statistics with frozen-model predictive entropy, then uses the same score to attenuate directional messages and to weight entropy, anchor, and consistency losses. Experiments cover CSBM, ogbn-arxiv, Elliptic, PubMed, and Twitch, with ablations, edge selectivity analysis, and adaptation dynamics.
Critical strengths
-
The motivation is grounded in an empirical observation. Figure 1 shows that harmful structural perturbations increase high-frequency energy and spectral centroid, while a homophily-preserving control does not. This supports the claim that multiscale spectral responses can distinguish harmful shift from normal structural heterogeneity, rather than assuming it.
-
The edge selectivity analysis provides mechanism-level evidence. On PubMed3, clean homophilic edges retain weight 0.956, original heterophilic edges 0.444, and injected heterophilic edges 0.154. This shows the score is selectively attenuating contamination rather than uniformly suppressing heterophily, which is more informative than aggregate accuracy.
Critical weaknesses
-
The source-reference assumption is not examined at its boundary. The score assumes source spectral statistics remain a meaningful reference for the target. When the target's global topology differs substantially, deviations could be broadly elevated rather than localized, and the score could lose discriminative power. The Twitch DE-to-ES result, where the method trails ActMAD and Matcha-LAME, may reflect this limitation, though the paper attributes it to being target-dependent without analyzing when the source reference ceases to be informative.
-
The benefit of coupling is not tested against external alternatives. The motivation states that adjusting only the loss or only the structure is insufficient, but the ablations remove internal components rather than comparing against a structure-only or loss-only baseline. A direct comparison would substantiate the coupling claim rather than leaving it as a design rationale.
-
The incremental value of the source reference and the fixed-score design is not isolated. The paper does not ablate the source reference (e.g., target-only spectral statistics) nor compare against a variant where the score is updated during adaptation. Without these, the gains cannot be attributed specifically to the source reference or to the fixed-score property.
-
The advantage over adaptation baselines is scenario-dependent. On ogbn-arxiv the margin over SOGA is 0.75 points, and on CSBM4 and CSBM6 WaveGuard ranks second with gaps of 8.2 and 20.2 points. The consistent gains over ERM are clear, but broad superiority over adaptation methods is not observed across all scenarios.
Questions for authors
-
Can you characterize when the source spectral reference remains informative? For instance, a diagnostic showing how the score distribution behaves as target-source structural distance increases would clarify the boundary of the method's applicability.
-
Can you compare against a variant that performs structure-only adaptation with standard entropy minimization, and against loss-only adaptation on the original graph, to directly test whether coupling is necessary?
-
Can you ablate the source reference by using target-only spectral statistics, and compare against a variant where the score is updated during adaptation? This would isolate the contribution of the source reference and the fixed-score design respectively.
-
On Twitch DE-to-ES, can you analyze why the method trails ActMAD and Matcha-LAME? Understanding this case would help clarify the method's scope.
My concerns have been addressed
Thanks for the authors' response. My main concerns have been addressed, and I will raise my score.