- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces COT2-META, a training-free framework for test-time scaling. Its main idea is to efficiently select reasoning actions (repairs, expansion and pruning) within the search space. Specifically, the authors first use an LLM to evaluate the process quality of each reasoning step. Then, they compute a UCB-style frontier score for each node and estimate the feasible action utilities. Finally, the action with highest value is chosen for reasoning. Authors employ experiments on multiple tasks and benchmarks to verify the effectiveness of their methods.
Critical strengths
1.COT2-Meta provides a more detailed action selection strategy by defining action scores.
2.The method achieves good results and outperforms other test-time scaling methods in the experiments.
3.The authors evaluate the method on different types of tasks and compare it with many test-time scaling baselines. The main experiments are comprehensive.
4.The authors compare different control strategies and different settings of computing values.
Critical weaknesses
1.The main idea (action selection and value calculation) rely on existing methods (e.g., UCB) and several hand-designed choices, such as the Q functions and the 32-dimensional features. The paper lacks a clear analysis of why these designs are chosen. The method seems more like an engineering solution, and its novelty is somewhat limited.
2.Is the 32-dimensional meta-state really necessary? Is there any redundant features? The authors should provide a more detailed analysis or ablation study of these features.
3.The action value calculation needs baseline comparisons. For example, the authors could compare their method with a simple baseline that first selects a node by UCB and then uses the LLM evaluator to get the score of each action.
Questions for authors
See Weaknesses