- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
FR-NLD addresses node classification on heterophilic graphs by placing neighborhood label distributions, estimated from soft predictions, on the probability simplex. For a neighbor, target node, and candidate class, it compares directions toward the target and class prototype in the Fisher–Rao tangent space anchored at the neighbor. Radial distances gate angular evidence, producing signed, class-conditioned messages. Dynamic configurations additionally use degree-aware shrinkage, residual inference, and periodic belief refresh; Amazon-ratings uses a different feature–geometry fusion path.
The authors evaluate on ten public splits of five modern heterophily benchmarks, distinguishing a single model, a three-member Plus variant, and a Pro variant incorporating auxiliary GCN predictions. The single model reaches 99.116% ROC-AUC on Minesweeper; Pro has the highest mean on three datasets among the ranked comparators in Table 1. The paper also reports same-hardware resource comparisons, compact-model interventions, and appendix analyses of priors, refresh, and depth.
Critical strengths
-
The router has a clear technical motivation and some supporting mechanistic evidence. Equations (3)–(4) on page 5 compare class directions in a neighbor's tangent space and fall back to radial experts for short displacements, yielding interpretable class-conditioned messages. Appendix D.3 reports a 0.161 percentage-point improvement from the combined prior on Roman-empire, with a paired 95% interval of [0.015, 0.306]. An earlier matched experiment reports a 0.607-point benefit from dynamic refresh, with an interval of [0.388, 0.827]. These support the prior and iterative-inference components, although they do not establish the necessity of angle or gating themselves.
-
The single-model Minesweeper result and its particular resource savings are meaningful. Table 1 reports 99.116±0.170. Against the authors' same-hardware Polynormer reproduction in Table 2, which obtains 97.281, the gain is 1.835 percentage points, with 2.20M versus 10.54M parameters and 0.97GB versus 4.15GB peak memory. This is strong evidence that does not depend on Pro ensembling. The use of five modern datasets and ten public splits, together with disclosure of negative ablations and resource disadvantages on Amazon-ratings, also improves transparency.
Critical weaknesses
-
The independent contributions of direction and reliability gating remain insufficiently quantified. The geometry-off intervention in Table 3 removes a substantial routing module, including class-conditioned messages and prototype-related inputs; the full performance gap cannot be assigned to angle alone. After retraining without angle, the gaps are +0.236, +0.118, +0.012, and +0.313 percentage points on Roman-empire, Minesweeper, Tolokers, and Questions, respectively, but −0.261 on Amazon-ratings. The authors candidly acknowledge these mixed outcomes. What is missing is uncertainty for these particular contrasts and validation in at least one representative main configuration, rather than a wholesale repetition of already completed ablations. Zeroing angles or shuffling viewers in a frozen model shows dependence on those inputs, but changes the input distribution and cannot by itself establish that a retrained alternative router is worse. The prior/depth analyses also do not directly isolate the three-expert reliability gate.
There is a further interpretive boundary. The simplex tangent space is one-dimensional for the three binary datasets. For nondegenerate displacements, the Fisher–Rao tangent cosine equals
This remains useful directional information, but it is exactly the same as this ordering test; treating the equivalent expression as an independent competing baseline would be uninformative. The binary results can support the complete router, but cannot distinguish this angle from a one-dimensional Euclidean angle. A discriminating test should instead use a multiclass task, preserving prototypes, message channels, and training budget while comparing a radial router or a reasonable Euclidean geometry, and separately examining the gate. Likewise, the square-root map with spherical geodesic geometry preserved is an isometric reparameterization of Fisher–Rao, not an independent alternative.
-
System rankings, evaluation protocols, and efficiency claims need clearer separation. Pro benefits from multiple FR-NLD members and auxiliary GCN predictions; Appendix Table 4 explicitly supplies mixture weights for three auxiliary GCNs. In Table 1, the single FR-NLD obtains 91.677 versus Polynormer-r's 92.55 on Roman-empire and 78.405 versus 78.92 on Questions. Table 2 uses a different, same-hardware Polynormer reproduction, obtaining 78.299 on Questions; conclusions from these two tables should not be conflated. Table 1 also mixes ten-split results with source-specific protocols. Pro's highest means do not automatically establish either the superiority of the core router or statistical significance.
On Amazon-ratings, Table 2 reports 162% of the comparator's parameters and 199% of its memory, with lower performance. The Minesweeper efficiency advantage therefore does not generalize to every configuration. Appendix E.1 defers the complete search candidates and validation rankings to release, limiting scrutiny of search budgets. Useful additions would be the auxiliary predictor's own performance, one comparably budgeted ensemble control, and complete deployment costs. Ensembling and validation-based tuning are not themselves methodological errors.
Questions for authors
- Primary; could affect the recommendation: Please provide per-split results or paired intervals for the retrained angle contrasts in Table 3. In one representative multiclass main configuration, can you compare radial/Euclidean routing while holding class prototypes, message channels, and budget fixed? What does the three-expert reliability gate contribute relative to a control without that distance-dependent gating? A separate evaluation of the mathematically equivalent binary sign implementation is not requested.
- Primary; could affect the recommendation: What is Pro's incremental benefit over the auxiliary GCN predictor alone and one comparably budgeted baseline ensemble? Please distinguish the source results in Table 1 from the same-hardware reproduction in Table 2, and report actual Plus/Pro inference costs and paired differences for the principal comparisons.
- Reproducibility clarification: Please supply the A28 specification, stopping criteria, number of candidate configurations, and validation-selection record. The paper mentions anonymous supplementary utilities, but they were not included in the PDF materials supplied for this review; if they contain these details, please identify where.
- Interpretive clarification: As displacements shrink, direction may persist while fixed positive thresholds suppress angular weight. What are the observed displacement-to-threshold ratios and expert masses during training? This would clarify the useful operating regime. I do not interpret the local motivation as an already-established universal anti-oversmoothing theorem.