- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SPR, a graph foundation model combining shared Chebyshev spectral filters with Gromov–Wasserstein prototype geometry for cross-domain transfer. It uses contrastive learning and masked spectral reconstruction for pretraining, and evaluates transfer on node and graph classification, including few-shot settings.
Critical strengths
- SPR presents a coherent framework combining shared learnable spectral filters with cross-graph relational geometry to support transfer across heterogeneous graphs.
- Under the experimental settings used in the paper, SPR demonstrates strong generalization performance on unseen graphs.
Critical weaknesses
- Key details of cross-graph representation alignment remain unclear, including how K-means assignments correspond to fixed prototype indices and how ambiguities in independently computed SVD coordinates are handled. These details are important for assessing the consistency of the shared representation space.
- The computational evaluation does not clearly separate geometry construction, barycenter learning, and target alignment costs. Moreover, large-graph experiments replace GW with K-means without a controlled comparison quantifying the resulting accuracy–efficiency trade-off.
Questions for authors
Q1 : On graphs without node attributes, how sensitive is SPR to degree one-hot, constant, random, and structural positional features? Could controlled ablations isolate the contribution of spectral parsing from that of the constructed input features? Q2 : Could you provide controlled comparisons using a randomly initialized encoder, fixed spectral filters, and source-independent prototype geometries, with architecture and preprocessing matched, to isolate the contribution of source-domain learning? Q3 : What does SPR stand for? Please provide its full form at first occurrence, as the acronym is not explicitly defined in the manuscript.
2 comments
Thank you for the detailed response and clarifications. I have decided to keep my current score.
We thank the reviewer for the detailed and helpful feedback. We respond to your suggestions point by point as follows.
For W1: We will clarify both alignment mechanisms in §§4.1–4.2 and App. D:
For W2: Pretraining (Cora, CS, Photo, Chameleon) incurs one-time costs of 4.60 s (diffusion geometry), 14.17 s (GW barycenter C⋆), and 77.7 s (25 epochs). Frozen target evaluation (3 splits, 2,000-ep probe) reports GW Dist, Solver, and Total Eval (GW / KM):
Exact GW better preserves relational alignment on CiteSeer and PubMed, whereas K-means cuts solver runtime by an order of magnitude at minimal accuracy cost (slightly improving on denser Physics). This aligns with Prop. 2 and scales to large graphs (ogbn-arxiv, n=169,343: 12.5 s total, 1.1 s transport).
For Q1: On IMDB-B (205 matched 1:1:8 splits, val-weighted affine probes; Random Bank = best of 3 norm-matched banks), we compare five structural inputs:
Full SPR leads every control across all five inputs—including eight-scale heat kernels alone—isolating spectral parsing and prototype transfer beyond structural input choice. Under strict batch size = 1 Table 2 probing, SPR leads all baselines on featureless COLLAB (74.86% vs. 73.78%) and IMDB-B (70.43% vs. 69.60%).
For Q2: We evaluated the contribution of pretraining, prototype geometry, and spectral filtering on two heterophilic graphs (Cornell and Wisconsin) and one homophilic graph (CiteSeer). Results are accuracy (%, mean ± SD).
Replacing the learned prototype geometry with ER geometry or disabling the prototype branch reduces accuracy on all three datasets. On CiteSeer, the pretrained encoder with ER geometry also trails the random encoder with ER geometry, suggesting that the pretrained backbone and gate work best with their learned geometry.
The learned filter bank outperforms both the identity and random banks across the three datasets. Together with the diverse filter responses in Fig. 4(b), these results support the contribution of learned spectral patterns to transfer.
For Q3: SPR stands for Spectral Patterns and Relational Geometry, which we will define explicitly at first use in the Abstract and §1.
We hope these clarifications adequately address your concerns. We are grateful for your feedback.