- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
this paper proposes a distillation method to distill large GNNs into small ones (especially with fewer layers) and maintain good performance and reduce the latency.
Critical strengths
- This paper’s writing is good and clear
- Design of the distillation method is reasonable
- It has a detailed introduction on the domain they studied (Section 3.2) which is necessary for broad machine-learning practitioner.
Critical weaknesses
- The novelty is somewhat limited, even for a domain application-oriented paper. 3 out of the 4 distillation loss terms are off-the-shelf and the only domain-specific loss term is Eq. 3.
- It is a bit surprising the proposed 4 distillation terms somewhat conflicts with each other, because according to Table 4, the best combination is without the L_physKD and L_lat terms.
Questions for authors
Suggestions:
- Lots of the \cite shall be \citep
- Eq. and Equation are both used. Authors might want to use only one of them.