- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper investigates oversmoothing predictions for trained residual GNNs using an effective-depth statistic, . It reports that effective depth grows sublinearly with nominal depth and that incorporating this scalar into a random-weight simulator improves predictions of normalized Dirichlet-energy decay, particularly for deep GCNs. The evaluation includes gain-profile perturbations, prediction across depths, and training interventions that regularize effective depth toward specified targets. The central empirical observation is promising, although the claimed connection to existing theory and the interpretation of the supporting evidence require clarification.
Critical strengths
-
Potentially useful empirical predictor. Table 6 (p. 14) reports substantial improvements for residual GCNs: prediction error decreases from 0.071 to 0.012 at depth 32 and from 0.051 to 0.0055 at depth 64. Section 4 also reports improvement across all 12 GCN configurations. These findings suggest that accumulated relative branch magnitude captures useful information about trained dynamics.
-
Complementary experimental evidence. The comparison of full and uniform gain profiles, prediction across depths, and regularization interventions goes beyond a single observational correlation. The intervention provides evidence of controllability within the tested range. The authors also explicitly discuss prediction bias, architecture-specific failures, and limitations of the mechanistic interpretation.
Critical weaknesses
-
The theoretical attribution and mathematical justification do not support the central framing. Section 2.1 (p. 2) and Appendix A.4 (p. 11) attribute an i.i.d. weight assumption to Oono and Suzuki (2020). Their main contraction theorem instead uses layerwise spectral norms and does not require random weights. Although Appendix A.4 allows nonlinearities to be handled through contraction, it does not resolve this attribution problem. The manuscript needs to distinguish its simulator assumptions from those of the cited theorem and establish the connection to normalized-energy slopes. See Oono and Suzuki, Sections 3.2–3.3, pp. 3–4.
Separately, Section 2.4 (p. 3) infers a magnitude-only explanation from predominantly nonnegative cross-terms. However,
The sign of alone cannot determine the change in normalized energy. Branch energy and alignment remain relevant. This undermines the proposed justification, although it does not invalidate the empirical prediction improvements.
-
The evidence supports narrower conclusions, and statistical reporting requires reconciliation. The initialization-versus-training comparison (Section 3, pp. 4–5) changes multiple properties simultaneously and therefore does not isolate the contribution of non-i.i.d. structure. The authors appropriately limit profile ablations to simulator predictions (p. 7), but nonsignificant differences do not establish equivalence; the introduction’s stronger exclusion of distributed mechanisms should be narrowed.
Table 1 (p. 12) specifies four target-level means, yet gives approximately under a standard two-sided Pearson test at , rather than the reported 0.011. This may reflect a caption or aggregation mismatch. Section 6 (p. 8) also compares intervention error 0.013 against observational depth-32 P4 error 0.027, whereas Table 6 reports 0.012 for the latter. These discrepancies need resolution before the associated significance and predictability claims can be assessed.
Questions for authors
- Which precise theoretical result motivates the i.i.d. assumption, and how does it connect the residual simulator to the normalized-energy slopes evaluated here?
- After accounting for normalization, what existing evidence supports excluding branch alignment and spectral content from the explanation?
- What statistical unit was used in Table 1, and what analysis produced the 0.027 comparator in Section 6? Which conclusions remain supported after these discrepancies are reconciled?