- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
MIGE rewards exploration based on how a decision affects later reasoning. At the strategy level, it swaps strategy contexts and compares the probabilities of the full reasoning sequences. At the local level, it generates branches at high-entropy positions and measures their effect on the next intermediate conclusion. These rewards are assigned to strategy tokens and branching tokens, respectively. Experiments on Qwen3 1.7B and 4B report gains on math and science question answering, with metric validation and ablation studies.
Critical strengths
-
The paper addresses a useful question: token uncertainty or differences in wording do not necessarily mean different solution strategies. Measuring changes in later reasoning offers a more concrete way to study exploration.
-
Beyond final accuracy, the paper examines strategy rewrites, local branches, and the two reward components. These analyses help explain what the proposed influence measures capture.
Critical weaknesses
-
The method depends heavily on hand-designed rules for identifying strategies and reasoning steps. The reported parsing coverage is useful, but does not establish whether the extracted content is semantically correct. It is also unclear whether these rules generalize to other models and output formats.
-
The main experiments use different prompts for MIGE and the baselines. The same-prompt comparison in Table 7 examines solution routes on only one problem, so it does not resolve this concern for the benchmark results. The extra computation also makes gains at the same compute budget unclear.
Questions for authors
-
Beyond the single-problem comparison in Table 7, do the benchmark accuracy gains remain when the baselines use the same strategy-first prompt?
-
How do the authors check whether the extracted strategies and intermediate conclusions are semantically correct, rather than merely matching the expected format? After accounting for branch generation and cross-scoring, how much does MIGE improve over additional ordinary sampling or existing branching methods?
Thanks for the authors' response and the extended experiments, I maintain my original positive score.