- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
How should we use MCTS on graphs? One option is to use a transposition table, the standard approach for using tree algorithms on graphs, as old as Computer Chess. But how in stochastic domains, with MCTS? Motivated by the Physics principle of electrical resistance, a new exploration rule is introduced and analyzed, for pooling successor states' counts, using an exploration bonus. The paper contains lengthy proofs in the appendices, 60 pages in total.
Critical strengths
- the theoretical result on the computational complexity of the algorithm for Monte Carlo Graph Search may be correct and interesting
Critical weaknesses
- limited, theoretical result, that builds on previous algorithm: Power-UCT.
- 60 pages of proofs with no empirical results besides toy examples, this is not an ICLR paper
- the proofs are claimed to be checked by an AI, but its name and the prompts are missing from the paper, appendix and supplementary material
This builds on a previous algorithm, Power-UCT. The contribution of the paper is a theoretical analysis that convergence rate holds as for Stochastic Power UCT. Also, there are numerical simulations and a toy-example (Frozen Lake, Passenger Grid, Four Rooms) of tabular grid size. There are no significant empirical results or experiments with real-world applications or games. There is also no ablation study, or a discussion where this algorithm can be used, and what the advantages are, not a comparison against alternative methods.
The theoretical analysis is checked by the authors by unspecified AIs, no prompts are provides for this check. No indication is given as to how surprising these results are from a theoretical perspective.
Questions for authors
The contribution is interesting, the idea is nice, but the result and lack of experimentation/application is too limited to be accepted. I could not find the LLM prompts for the proof checking, or the results, in the reproducibility information.
Dear Area Chair and Reviewers,
Thank you for your time, effort, and constructive feedback on our submission. We truly appreciate the thoughtful insights and detailed comments provided during the review process, which have been invaluable in helping us identify areas for improvement.
After careful consideration of the reviews and our current results, we believe that the manuscript requires additional experiments and further empirical validation to fully substantiate our claims and strengthen the overall contribution. To ensure the work meets the high standards of ICLR, we have decided to withdraw the paper at this stage and dedicate more time to conducting these comprehensive experiments for a future submission.
Thank you once again for your support.
Best regards,
The Authors