- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates how to improve the decision-making ability and the accuracy of natural-language analysis of reasoning LLMs in the specialized domain of Go. The authors identify two main challenges faced by existing LLMs in Go tasks. First, candidate move generation and final move selection require distinct capabilities, which are difficult for a single model to balance effectively. Second, existing training methods primarily focus on move quality, providing insufficient supervision for the accurate use of professional Go terminology and board-state analysis.
To address these challenges, the authors propose a dual-model reasoning framework consisting of a Sampler and a Text Reward Model, which are responsible for candidate move generation and evaluation-based selection, respectively. Both components are trained using task-specific SFT and RL objectives. In addition, the authors introduce Term-DPO, which expands approximately 5,000 human-corrected Go analyses into 500,000 preference pairs through progressive terminology replacement and text rewriting. These preference pairs are then used for DPO training to improve the accuracy of professional Go terminology. The authors also construct KataGo-Eval-Levelwise, a benchmark designed to evaluate Go decision-making capabilities across different difficulty levels.
The experiments cover Qwen3 models of different sizes and evaluate the proposed approach through Go benchmarks, full-game matches, and human evaluations. The resulting system achieves a 92.1% move hit rate on KataGo-Eval-Levelwise, substantially outperforming the Single LLM baseline (82.8%). It also wins 73 out of 81 games against nine professional Go players and achieves near-even results against strong KataGo models under the specified search budget. Furthermore, Term-DPO improves professional terminology precision to 87.4% while maintaining comparable move prediction performance. The paper also includes model scaling studies, reward model comparisons, and ablation experiments to further examine the contributions of different components.
Critical strengths
-
This paper investigates the decision-making and analytical capabilities of LLMs in the specialized domain of Go. It proposes a dual-model framework to address the distinction between candidate move generation and final move selection. The overall approach is straightforward, and the research problem is practically meaningful.
-
The authors construct large-scale preference data from human-corrected professional Go analyses, reducing the need for extensive manual annotation while significantly improving the accuracy of professional Go terminology and largely preserving the model's move prediction performance.
-
The paper conducts experiments across Qwen3 of different sizes and introduces a difficulty-level benchmark for Go evaluation. The system is further evaluated through full-game matches against KataGo, matches against professional Go players, and human evaluations. In addition, model scaling studies, reward model comparisons, and ablation experiments provide further evidence supporting the effectiveness of the proposed approach.
Critical weaknesses
-
The proposed Sampler + Text RM framework largely follows the existing Generate–Verify–Select paradigm, while Term-DPO adopts the standard DPO objective. Although these two components improve move selection and professional terminology usage, respectively, they address relatively independent problems, and the paper does not sufficiently demonstrate their synergy at the methodological level.
-
The authors construct Chosen–Rejected pairs through progressive terminology replacement, assuming that responses with fewer replaced terms are of higher overall quality. However, the number of replaced terms does not necessarily have a strictly monotonic relationship with the actual quality of Go analysis, and rewriting with GPT-5.1 may alter the original semantics. While the human-annotated dataset is a valuable contribution to the community, the reliability of the large-scale synthetic preference labels remains questionable.
-
Term-DPO significantly improves the accuracy of professional Go terminology, but correct terminology usage does not necessarily imply accurate board-state analysis or reasoning. The current evaluation primarily focuses on terminology-related metrics and relatively limited human evaluations, lacking systematic verification of the correctness of generated move sequences and the reliability of win-rate estimates.
-
The proposed approach requires deploying two separate models, the Sampler and Text RM, which introduces additional inference overhead. Although the authors provide comparisons with repeated sampling, evaluations against other candidate verification and selection strategies under comparable computational budgets remain relatively limited.
Questions for authors
I'm open to raise my score if the authors could address the following concerns. Given the substantial engineering effort involved in the experiments, I believe that a few lightweight additional experiments and clarifications would be sufficient.
-
Could the authors clarify whether there is meaningful synergy between the Sampler + Text RM framework and Term-DPO? For example, could a more explicit component-wise ablation study demonstrate whether combining these two components yields benefits beyond their individual contributions?
-
Have the authors examined whether the preference relationships constructed through progressive terminology replacement are consistently valid? Although the paper provides some human validation of the preference labels, further analysis of how the number of replaced terms and GPT-5.1 rewriting affect label accuracy would help establish the reliability of the large-scale synthetic preference dataset.
-
Beyond terminology accuracy and the existing human evaluations, could the authors further investigate whether Term-DPO genuinely improves the model's Go analysis and reasoning capabilities? For example, a more fine-grained evaluation of generated move sequences, positional assessments, and win-rate estimates using KataGo or professional Go players would provide stronger evidence.
-
Could the authors provide more comprehensive comparisons between the dual-model framework and alternative Generate–Verify–Select strategies under matched inference compute budgets? For example, increasing the number of candidates sampled by a single model or employing alternative candidate reranking strategies would help clarify the necessity of separately training the Sampler and Text RM, as well as the trade-off between performance gains and computational cost.
Response to Reviewer qD5e(1/2)
First, thank you for the time and effort you devoted to reviewing our paper, and for your insightful questions and suggestions! We respond below to each of the weaknesses and questions you raised. We hope our responses address your concerns!
Weakness 1 / Q1: Complementary roles of the dual-model framework and Term-DPO
Thank you for this valuable question! In our view, the dual-model framework and Term-DPO serve primarily complementary roles. The Sampler and Text RM improve candidate generation and move selection, while Term-DPO improves the reliability of the accompanying professional analysis. To examine this directly, we compared the dual-model system before and after Term-DPO.
Specifically, we invited ten strong amateur and professional Go players to evaluate the analyses and move predictions on 30 positions. Terminology accuracy increased from 27% to 95%. In comparisons between the two systems’ responses, the version with Term-DPO achieved a 100% helpfulness preference rate over the version without it. Meanwhile, move accuracy remained largely unchanged, at 92.0% before Term-DPO and 92.1% after it. These results show that combining the two components allows the system to make strong move predictions while providing analyses that players find more helpful. We will clarify this complementary relationship in the appendix and include these comparative results.
Weakness 2 / Q2: Expert agreement before and after rewriting
Thank you for this interesting question! To investigate it, we collected 100 preference pairs and assessed expert agreement both before and after rewriting. Each pair was judged by three Go players, yielding 300 judgments in each condition. Before rewriting, 281 of the 300 judgments favored the response labeled chosen, giving an agreement rate of 93.67%. After rewriting, 274 of the 300 judgments favored chosen, giving an agreement rate of 91.33%. Thus, even after rewriting, experts still preferred the intended positive response in most judgments.
This supports the reliability of the constructed preferences and indicates that rewriting generally preserves the quality differences experts recognize. Some labels nevertheless remain inconsistent with expert judgments. We will include these results to clarify how rewriting affects preference-label reliability. From a Go player’s perspective, the terminology and positional descriptions applicable to most positions are unambiguous, making it relatively straightforward to judge whether a term or positional analysis is correct.
Weakness 3 / Q3: Accuracy of positional analysis beyond terminology
Thank you for this insightful question. First, variation prediction and win-rate estimation are mainly learned during the earlier training stages. Term-DPO mainly focuses on improving professional analysis. Our existing experiments show that move accuracy is preserved after Term-DPO.
In addition, the expert corrections used to construct the training data include corrections to inaccurate positional analysis. To evaluate this more directly, we selected 50 positions for a focused human evaluation of the outputs before and after Term-DPO. Players judged whether the model correctly assessed which side had the advantage and whether its analysis of the position was accurate. After Term-DPO, advantage-assessment accuracy increased from 28.0% to 74.0%, and positional-analysis accuracy increased from 36.0% to 78.0%. These results provide clear evidence that the trained model also improves its analysis and understanding of specific Go positions.