- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
CoReD assigns continuous training weights to reasoning steps using a council of three LoRA experts. It first trains the experts on adaptively truncated teacher trajectories and encourages diverse predictions at high-entropy steps. It then combines mean predictive uncertainty and relative disagreement to set the step weights. A merged model initializes the student and provides a frozen KL reference during weighted training. The final system uses one model at inference. Experiments on three backbones and four math benchmarks report the highest average score among the compared methods.
Critical strengths
-
The motivation is clear, and the content is accessible and easy to follow. Besides, the paper provides clear mathematical definitions and formal proofs for the key properties of the proposed method, especially the information-theoretic interpretation of council disagreement.
-
The combination of LoRA and model merging is a good design choice. It makes training multiple experts efficient while adding no extra inference overhead. The experiments are also fairly comprehensive. Detailed ablation studies help explain how different components contribute to the final performance.
Critical weaknesses
-
The contribution of the design choices to the final student needs clarification. Table 2 shows that functional repulsion drives most of the predictive diversity. Orthogonality and step-level dropout have little effect on JS. The final student benefit of orthogonality and dropout remains unclear.
-
The stability of the evaluation and the total training cost require further analysis. Table 3 reports results based on only three samples per problem. I think there is still significant fluctuation regarding AIME24/25 and AMC12, rendering the evaluation results and conclusions unreliable. I suggest the authors report results for avg@32 or avg@64 and analyze whether the conclusions remain consistent.
Questions for authors
-
How do one or two alternative merge operators affect final CoReD performance under the same setting? Do higher merge-only scores also lead to higher final scores?
-
Whether each diversity-oriented design is meaningful? How does removing orthogonality or step-level dropout affect the final CoReD student after Phase 2?
-
How does the total cost of compare with standard CoT distillation and other step-aware baselines?
Reminder to engage in discussion
Dear Reviewer GShw,
We have provided detailed responses and additional experimental results addressing the concerns raised in your review. We would greatly appreciate it if you could take a moment to review our responses and let us know if any questions or concerns remain. We would be happy to provide further clarification if needed.
As the rebuttal deadline is approaching, we kindly invite you to engage in further discussion.
Thank you for your time and consideration.
Best regards, The Authors