- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
Full graph training of heterogeneous GNNs remains an important and challenge problem, especially when there are long-range heterogeneous dependencies. This paper proposes a phase-aware multi-GPU framework that jointly optimizes workload organization and cross-GPU communication while preserving message-passing semantics. It mainly adopts two optimizations: first, at preparation time, a lightweight surrogate trading scheduling flexibility against one-time materialization overhead. Second, during recurrent training, asynchronous aggregation overlaps cross-GPU reduction with local computation. The results show substantial performance improvement.
Critical strengths
- Accelerating GNN via multi-GPU system is an important area.
Critical weaknesses
- I think the granularity selection is proposed by GNNAdvisor, though GNNAdvisor is designed for single GPU. But I do not find any challenge for extending GNNAdvisor to multi-GPU system.
- This paper has 10 pages, while the ICLR requirement says only 9 pages main content is allowed.
- The dataset is not public, the hardware is not specified. And in section 5.1, there are placeholders like [framework and version], [collective communication library and version]. I think this paper is even not finished or at least not proofread.
- Actually, the Appendix E lists 7 limitations (maybe they are generated by AI), and I think 2, 3, 5, and 7 are also my concerns.
Questions for authors
See weakness.