- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper introduces AlphaSolve, a game solver using AlphaZero style learned guidance to more quickly solve games.
Critical strengths
Approach is interesting, and so are results. This introduces a method for best-first solvers. Limitation is that not compared against state of the art other solvers.
Critical weaknesses
The three listed contributions are measurement facts. It would be nice to also provide a more high level contribution concerning the impact on the field of Game Solving.
Related Work, the term weakly solving goes back much further than the listed references, and should be introduced formally. Scholarship appears weak, with many older references, starting with the first survey. There are many diverse topics in related work. Are they all relevant?
Full code is not provided as part of the reproducibility requirements. There is no supplementary material. Why?
Questions for authors
The footnote on page 1 should add a reference to the definitions of strong and weak solving.
The paper is light on discussion/future work. How would this approach work in larger games? Can it solve 8x8 Othello, Chess? Please shrink related work and enlarge discussion, and provide some ideas how this coudl work on state of the art solver problems (such as 8x8 Othello).
Unbalanced paper. weak reject.
2 comments
Main concern remains
Thank you for your remarks. Adding 8x8 Othello and Chess is worthwhile. The overall feeling remains: interesting idea, but not groundbreaking, and writing style is for insiders. Code is still not released, main contributions are still rather technical, without reference to broader impact or outside the narrow field of combinatorial game solving, few recent related work references, difficult to scale to larger games.
I feel the paper has improved, but I still believe this paper is better suited for a more focused, technical/games oriented venue, where AlphaZero-inspired combinatorial game solving might be better appreciated.
I leave my score unchanged
Higher-level contribution. §1 now opens the contributions with it: solvers have so far started from guidance built outside the solve, and we show a solve can supply its own, from random initialization on its exact verdicts. The three findings are the evidence for it.
Weak solving and scholarship. §2 gives Allis's (1994) definitions of ultra-weak, weak and strong solutions, and the page-1 footnote points to them.
Balance and larger games. Related work is shortened to what the paper uses, and the conclusion (§6) now discusses larger games, including 8×8 Othello and chess.
State-of-the-art comparison. See Table 3: alpha-beta and Pons's Connect Four solver.
Code. We intend to release the code upon approval of our institution's release process. Algorithm 1 (Appendix B) and Appendix A specify the search and every setting used.