- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies why cross-domain graph SSL often underperforms target-matched pretraining. The authors decompose the transfer gap into capability loss and accessibility loss, and propose the task–geometry profile (TGP) to characterize both the amount of retained task signal and its placement in representation geometry. They develop a linear theory based on optimal predictors and a spectral ridge surrogate, link TGP distortion to GCN and GIN aggregation mechanisms, and validate the framework through extensive transfer experiments across domains, SSL objectives, backbones, and probes.
Critical strengths
The proposed TGP provides an intuitive framework linking transfer performance to both the amount and placement of task-relevant signal, and is supported by extensive empirical evaluation across diverse transfer settings.
Critical weaknesses
The paper’s central explanatory claims are not fully supported by the theory. The capability–accessibility decomposition is exact only within a constructed population-eigenmode ridge surrogate, while the experiments use finite-sample classification objectives and nonlinear probes whose connection to this surrogate remains empirical. Moreover, Section 3.5 establishes that graph aggregation changes feature covariance, but not that it relocates task signal, which additionally depends on target-label alignment. Consequently, the proposed framework is an informative diagnostic, but its ability to explain the observed transfer behavior and support architecture-level conclusions is less rigorous than claimed.
Questions for authors
- The theory is developed under a population-optimal linear predictor and a spectral ridge surrogate, whereas part of the empirical evaluation uses classification metrics and nonlinear MLP probes. Could the authors provide additional evidence (empirical or theoretical) that the proposed capability and accessibility quantities remain meaningful beyond the linear ridge setting?
- Section 3.5 argues that graph aggregation can relocate task signal toward weaker representation modes. However, the analysis primarily derives changes in covariance structure, while the task-signal component additionally depends on target-label projections. Could the authors clarify what assumptions are required to connect aggregation-induced covariance distortion to changes in the full TGP?
Thank you again for your thoughtful and constructive feedback. As the public discussion period is approaching its deadline (November 18), we would like to politely follow up and let you know that we have uploaded our revised manuscript, with all changes highlighted in red. In particular, we have formally incorporated the comparison with Dubois et al. (ICML 2023), the finite-endpoint disentanglement results, the intervention-tracking analyses, and the scarce-label scalability.
Could you kindly let us know if our response and revised manuscript resolve your concerns, and whether you have any other questions we can further clarify before the discussion closes? Thank you very much for your time!