- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MCTS-EPPL, an iterative preference-learning framework for LLM-based Automatic Heuristic Design (AHD). Experiments on OP, CVRP, and MKP under ACO, and TSP under GLS demonstrate the effectiveness of MCTS-EPPL.
Critical strengths
S1: The paper identifies a meaningful limitation of existing LLM-based AHD methods.
S2: The ablation study is reasonably extensive.
Critical weaknesses
W1: The novelty of this manuscript appears somewhat limited. The use of MCTS for LLM-based automatic heuristic design has already been explored in [1], while fine-tuning LLMs with DPO to improve heuristic generation has also been investigated in [2].
W2: The empirical validation of the proposed framework is still limited. The main experiments are mainly conducted within the ACO-based heuristic design setting, and the trainable LLM is restricted to Qwen2.5-7B-Instruct. This is insufficient to demonstrate that the proposed MCTS-EPPL generalizes across different heuristic-generation frameworks and LLM backbones. This concern is further amplified by the fact that the framework adopts problem-specific hyperparameter configurations, as shown in Table 2.
W3: The manuscript claims that EPS captures the future search value of a heuristic. However, this claim is not directly validated. The current experiments mainly show that incorporating EPS-based search-feedback preferences improves the quality of the discovered heuristics, but they do not explicitly evaluate whether EPS itself is predictive of a heuristic’s future search value.
W4: This manuscript has substantial room for improvement in terms of presentation quality. For example, EPS is used in the Introduction before its full name, Evolutionary Potential Score, is formally introduced later in the methodology. In addition, the citation style is inconsistent; in most cases, citations should be presented using the \citep{} command.
[1] Monte carlo tree search for comprehensive exploration in LLM-based automatic heuristic design. ICML 2025.
[2] Fine-tuning large language model for automated algorithm design. arXiv: 2507.10614, 2025.
Questions for authors
Q1: The authors state that MCTS-EPPL "modifies the expansion stage to produce multiple comparable candidates" and subsequently evaluates these candidates. Are all fitness evaluations incurred by these additionally generated candidates counted toward the total heuristic-evaluation budget? If not, the comparison may not be fully fair, since the proposed method could effectively consume more fitness evaluations than the baselines under the same nominal search budget.
Dear reviewers,
We have now received the author responses to your raised questions and concerns. Please go through them. Also, have they answered your questions appropriately? Please also look other reviewers' strengths / concerns. Have they changed your perception of the paper? In all cases, please communicate with the authors. It is important that we let them know what relevant issues still exist or have been answered. Please remember we have limited time to get any further responses from them.
Regards,