- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper claims that common node-level graph OOD benchmarks partly reward feature-scale artifacts and graph-level discrimination. The author shows that a deterministic encoder (DCE) can outperform stochastic uncertainty methods on feature anomalies.
Critical strengths
-
The motivation (including Figure 1) is clear and easy to follow.
-
Theoretical analysis is broad.
-
Experiments support the claims of the paper.
Critical weaknesses
-
The novelty seems incremental, which mainly stems from the benchmark critique.
-
In the theoretical analysis, the invariance claims require node-wise decoding (+ separable objectives), which seems very hard to satisfy this condition.
-
Although several exact marginal-matching comparisons are statistically inconclusive, the paper describes structured-prior effects as absent.
Questions for authors
Please see the above weaknesses
3 comments
Thanks for the detailed response.
I would maintain my positive rating.
Dear Reviewer mhF1,
Thank you for your valuable and constructive feedback. We sincerely appreciate your thoughtful comments and suggestions, which have helped us significantly improve the quality, clarity, and overall presentation of our manuscript.
We thank the reviewer for the careful report. Changes in the revised PDF are printed in blue, and section, figure, and table numbers below refer to the revision.
W1. Incremental novelty. The benchmark critique is one of three results.
W2. Node-wise decoding and separable objectives seem hard to satisfy. They hold by default, and our wording obscured that. Section 6.1 now reads: "Neither condition demands a special design, since cross-entropy is separable by construction and a model is node-wise whenever message passing acts on deterministic states and the draw enters through per-node maps." Message passing over features is unrestricted. Only the random draw may not travel between nodes. Where the conditions fail, Proposition C.4 extends the certificate and Section 6.4 removes each premise experimentally.
W3. Inconclusive comparisons described as absent effects. Correct on both counts.
Evidence. We added twenty trials and analysed them alone as an independent replication, so that no verdict is tested twice.
The ninth cell (matched-noise AUROC, Amazon Computers) has a pooled difference of +0.004 with interval [−0.002, +0.011], and we report it as uncertified.
Language. "Changes no endpoint" is now "we detect no change in any endpoint", "show no gain" is "we detect no benchmark gain", and "stays inert" is removed.