- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
In this work, the authors present a diffusion geometry for GNNs which is task-depending. The fixed graph Laplacian gives its place to a learned discrete Laplacian with a propagation operator that keeps the original topology. Furthermore, by studying the spectral decay, the work associates the learned geometry to the well-known phenomena of oversmoothing and oversquashing. The introduced µ-ChebNet is a novel architecture that exploits spectral and message-passing. µ-ChebNet performs well already at smaller depths, showing we can use a less layers for long-range. Finally, the model is on par with widely known and strong baselines.
Critical strengths
- Novel GNN arch where the diffusion geometry is learned directly
- Provides interpretability via μ which shows how propagation is affected
Critical weaknesses
- Related work missing: for example "Neural Sheaf Diffusion" (Bodnar et al.), provides connections between GNNs and topology
- The paper talks about rewiring, yet no rewiring method appears in any results table.
- Learnable-filter spectral GNNs (like GPR-GNN, BernNet, ChebNetII, JacobiConv) aren’t compared, even though L_μ could plug into any of them.
- More benchmarks, like LRGB, the standard long-range suite, and maybe heterophily benchmarks could strengthen the paper.
Questions for authors
- Connection with StableNet from paper "Return of ChebNet: Understanding and Improving an Overlooked GNN on Long Range Tasks". The paper appears also as two similar references (a diff in the order of authors)
2 comments
I thank the authors for their response which address most of my concerns. I will raise my score accordingly.
We thank the reviewer for the useful suggestions.
Weaknesses
Questions