- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper tests whether spectral descriptors of Instance-Learning Graphs (ILGs) can replace the four-round 1-WL color histograms in WL-GOOSE for learning domain-specific planning heuristics. Holding the rest of the WL-GOOSE pipeline fixed (ILG encoding, Scorpion training states, Ridge/LSVR/GPR regressors, and GBFS in Fast Downward), the authors evaluate nine spectral families—with and without color counts—across 63 configurations on the 900 IPC 2023 Learning Track problems. Overall, the best spectral setup (return moments plus color counts with GPR) solves 513 tasks, essentially tying 1-WL with GPR at 516, though with complementary domain strengths: return moments win on Transport and Rovers, while losing on Blocksworld and Childsnack. The paper rounds this out with a cost analysis, out-of-fold (OOF) error diagnostics, and theoretical limit results (feature-collision bounds and path-graph extrapolation failure).
Critical strengths
Clean, Controlled Empirical Design & Transparency: By changing only the feature map, the paper cleanly isolates the effect of the graph representation—something rare in learning-for-planning comparisons. Reporting all 63 configurations (alongside separate search and feature-extraction times, OOF diagnostics, and promised code) transparently answers key ablation questions regarding edge labels, color counts, sign/basis invariance, and regressor choice.
A Compact, Fixed-Dimensional Alternative to 1-WL: Return moments form a tiny, fixed-dimensional feature vector that requires no training-dependent vocabulary, yet they nearly match the coverage of full 1-WL histograms. This is a strong practical finding because it avoids the vocabulary-growth and unseen-feature issues of WL histograms while remaining lightweight.
Critical weaknesses
Overclaimed Headline Results and Test-Set Selection Bias: The abstract claims spectral features "outperform 1-WL... achieving SOTA performance," whereas the body accurately notes they "closely compete" (513 vs. 516 tasks, 4/3/3 domain split, and 1.14× more expansions on shared tasks). This is a parity result, not SOTA—especially without comparisons to recent WL improvements (Hao et al., 2025), classical baselines (LAMA, h FF ), or GNNs. Moreover, selecting the best of ~60 spectral configurations directly on the 900 test problems (against just three 1-WL variants), alongside tuning on a "90-task screen" and reporting single runs without variance estimates, makes a 3-task margin shaky. Configurations should be selected via OOF error or a held-out validation split. Compounding this, Table 1 claims to show the best configuration per family, but Table 3 shows better LSVR + counts results than Table 1's Ridge entries for SignBasis (341 vs. 330), normalized heat transfer (435 vs. 414), and raw heat transfer (468 vs. 423)—the last of which would be the third-best family overall.
Unexamined Disconnect Between Global Motivation, Bipartite Redundancy, and Local Winners: Because the paper evaluates existing descriptors rather than proposing a new method, its value hinges on explaining why and when spectral features work. The paper motivates spectral features via global structure, yet the global families perform worst, while the winner—length-4 return moments—is a purely local message-passing statistic. Because ILGs are bipartite, odd walks vanish and q=4 return moments mostly count 4-cycles (e.g., symmetric road(a,b)/road(b,a) pairs in Transport), which 1-WL misses. Bipartiteness also makes the spectrum of S symmetric about 0 (and L norm about 1), meaning the top and bottom eigenvalues, distribution quantiles, and SignInv/SignBasis eigenvector budgets are redundant pairs—halving the effective information in those families. Finally, the paper repeatedly claims that complementarity with 1-WL motivates combining them (the domain oracle hits 564), yet omits a cheap feature-concatenation experiment that would turn a speculative claim into a concrete contribution.
Questions for authors
Questions for Authors:
What is the coverage when concatenating 1-WL with return moments + counts across each regressor, and what is the per-task union of the two leading setups?
Why did Table 1 default to Ridge for SignBasis and both heat-transfer variants when Table 3 has stronger LSVR + counts results? Does your 1-WL baseline match the original WL-GOOSE coverage?
Can you report test coverage when configurations are selected strictly via OOF error or a held-out validation split (without touching the 900 test problems or overlapping screens)?
Did you account for bipartite spectral symmetry when allocating the endpoint and eigenvector budgets, or are the upper/lower halves redundant?
Since OOF error on small training instances doesn't test size extrapolation, how do prediction error and unseen 1-WL color fractions scale across test problems binned by ILG size? Additional Feedback & Minor Cleanup:
Missing Recent Literature & SOTA Context: To properly contextualize the SOTA claims and position this work within the broader learning-for-planning landscape, please expand the related work and discussion to include recent SOTA GNN-based policy/heuristic learning methods—most notably GABAR (NeurIPS 2025, Graph Attention-Based Action Ranking for Relational Policy Learning)—alongside other recent 2025/2026 advancements in WL features (e.g., Hao et al., 2025) and LLM/GNN-generated heuristics on the IPC 2023 Learning Track.
Clarify why 1-WL is so much worse under Ridge than dot-product GPR (351 vs. 516), and state whether return moments use q=4 or q∈{0,…,4}.
Fix the mismatched citations in Section 3 (Chen et al., 2025 vs. LM4Plan; Chen et al., 2024a vs. Chen & Thiébaux, 2024) and minor typos ("˚ Return", "generation generation").
Please engage in the discussion
Dear Reviewers,
As we enter the final stage of the author-reviewer discussion, I would like to encourage everyone to actively engage with the authors’ responses and any additional evidence they have provided.
Please take this opportunity to reconsider your initial assessments with an open mind, particularly where the authors have offered substantive clarifications, detailed arguments, or additional experimental results. The goal of the discussion is not to defend initial positions, but to reach the fairest and most informed evaluation of the submission.
I encourage you to engage directly with the authors on any remaining concerns, clearly distinguishing between issues that have been satisfactorily addressed and those that remain unresolved. Where appropriate, please update your reviews and scores accordingly, or explain why your original assessment still stands.
Your active and constructive participation in these final exchanges is essential to reaching a fair, evidence-based decision.
Your AC