- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies graph-text pre-training for sparse text-attributed graphs, addressing how missing or noisy node text destabilizes alignment and cross-domain transfer in existing LLM-as-Aligner methods. Experiments across zero-shot classification, link prediction, and retrieval show strong overall performance, with gains varying across tasks and directions.
Critical strengths
The consistency gate is a clever addition. By dynamically scaling structural signal injection based on reconstruction agreement, it prevents noisy structural representations from destabilizing training under sparse textual supervision.
The cross-domain risk balancing mechanism aligns well with zero-shot transfer.
Critical weaknesses
The individual contributions within the cross-domain risk balancing mechanism are not fully disentangled.
The text-sparsity experiments rely on random dropouts rather than realistic missingness patterns. Without testing scenarios where missing text correlates with node classes, domains, or graph structures, the robustness claims under non-random missingness remain uncertain.
Questions for authors
Could you clarify the exact rule used for dropping or retaining node text in your experiments? Also, how closely does this setup mimic real-world missingness patterns where data availability might depend directly on node labels or graph topology?
Based on the current results, is there any clear way to tell how much of the zero-shot transfer boost comes from the density-ratio weighting versus the cross-domain risk-variance regularizer?
Thank you for the additional experiments on non-random text availability. They substantially address my concern about the original random masking protocol. The remaining issue is the contribution of the cross-domain risk-variance regularizer. The rebuttal reports only the density-ratio = 1 ablation, while the risk-variance term is retained.