- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies the interaction between cross-layer edge-role sampling and adaptive message weighting in graph neural networks. The authors propose Persistent Tri-State Message Passing (P3MP), which assigns each edge an additive, subtractive, or inactive role that persists across layers, while recomputing its weight from the current endpoint representations. Through a two-layer analysis, the paper decomposes the interaction between sampling and weight sharing into target-state feedback and weight-source covariance, deriving conditions under which local and shared weights exhibit different preactivation orderings. Experiments on multiple graph benchmarks support the theoretical analysis and show that local weights perform better under persistent sampling, whereas shared weights perform better under layerwise resampling.
Critical strengths
- The paper investigates an interesting and underexplored interaction in stochastic message passing. This paper examines how cross-layer dependencies induced by sampling affect subsequent weight computation. This is a meaningful problem for understanding stochastic GNN architectures.
- The experimental design includes several informative controlled comparisons. The authors compare persistent sampling against layerwise resampling, as well as local weighting against shared weighting. Exact enumeration, checkpoint-level interventions, and distribution-preserving weight reassignment provide additional evidence for the proposed explanation beyond end-to-end performance comparisons.
- The empirical evaluation is reasonable. The paper evaluates P3MP on multiple graph benchmarks with varying levels of homophily and compares it against numerous established GNN baselines. The reported results are promising.
Critical weaknesses
- The theoretical results are primarily established for a restricted computational setting. The paper does not establish a general guarantee linking the derived interaction to the final predictive performance of an end-to-end trained GNN. Consequently, the extent to which the theoretical results explain the observed accuracy improvements remains unclear.
- The empirical evidence for the proposed interaction is somewhat limited. The reported accuracy interaction is approximately 1.1–2.5 percentage points on the five datasets used for the main sampling-weighting comparison. Moreover, each of the ten benchmark partitions uses only one initialization, limiting the ability to disentangle variability due to data splits from variability due to model initialization. Additional experiments would help establish the robustness and generality of the observed ordering.
- The relationship between the theoretical mechanism and the overall architectural improvements could be established more directly. P3MP combines persistent tri-state roles, endpoint-dependent adaptive weights, thresholding, mixture NLL, and structural regularization. Although the paper includes component ablations and controlled sampling-weighting comparisons, the theoretical analysis focuses on the interaction between sampling and weighting rather than the full training dynamics. It remains unclear how much of the end-to-end improvement can be attributed specifically to the proposed interaction, as opposed to the combined effects of the other architectural and optimization choices.
Questions for authors
- Can the authors extend the theoretical analysis beyond the two-layer setting to establish conditions under which the derived preactivation ordering also translates into final prediction or classification performance?
- How robust are the reported sampling-weighting interactions across random initializations, additional datasets, and different graph structures?
- Can the authors further isolate the contribution of the proposed sampling-weighting interaction from the effects of tri-state roles, adaptive endpoint scoring, thresholding, and mixture NLL?