- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper attempts to address the over-smoothing problem, or low-frequency bias, in traditional GNN models. It proposes to combine spectral representation learning, cross-layer alignment, and multi-layer GNNs to mitigate this issue. Instead of directly relying on conventional node embeddings, the authors claim to learn, for each node, a low-dimensional, globally optimized spectral manifold representation.
Critical strengths
- The paper claims to test on a lot of different datasets and claims good results.
Critical weaknesses
Weakness:
- The introduction section is poorly motivated and overclaims the research gap. It does not clearly explain why the MLNC problem requires learning high-frequency signals. It also does not provide enough theoretical or empirical evidence that this is the dominant problem in MLNC. The discussion also largely ignores modern heterophily-aware and frequency-adaptive GNNs, which makes the claimed research gap appear incomplete and insufficiently justified.
- The methodology claims to bring a “paradigm shift,” but it is actually a repackaging of well-known ideas, such as learning node representations in the frequency domain using eigenvectors and reformulating the learning process to prevent representation collapse or basis coupling.
- Once the optimization problem becomes Equation 7, the optimal can be obtained from the eigenvectors of . Therefore, the need for SVD is not well explained.
- The paper calls the GPI update an “exact closed-form solution,” but it is actually iterative. The matrix depends on the matrix , and the SVD provides an updated , which is still an iterative step. So the algorithm flow should be double-checked before submission.
- The paper does not properly explain how high-frequency signals are actually learned or preserved. A lot of prior work has suggested that learning low- and high-frequency components separately, without mixing them, helps resist over-smoothing.
- Alignment is not the same as high-frequency preservation. A model can enforce alignment with the previous layer, but that does not guarantee that it learns distinctive or high-frequency signals. Figure 4(d) appears unusually clean and idealized. The figure seems more like an illustrative portrayal of an ideal graph. A real-world graph, where both the structure and features are often noisy, would not usually produce such a clean diagonalization.
- A flatter singular-value spectrum only tells us that uses more independent representation dimensions. It does not necessarily mean that contains more high-frequency graph signals. The paper should directly analyze the representation energy across Laplacian frequencies.
Questions for authors
- Can the authors clarify why the GPI procedure is necessary after equation 7, because the problem is the standard Rayleigh-Ritz problem whose solution is the eigenvectors corresponding to the smallest eigenvalues of M. Since G depends on F, how can equation 9 be considered a closed-form solution??