- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper works on the mathematical reasoning verification. It designed a Deep-Research-Grounded Trajectory Distillation workflow followed by RL to increase the verification ability of the base model. In its main experiment, they used trajectories generated by DeepSeek-V4-Pro to distill Qwen2.5-Math-Instruct and reported certain performance gains.
Critical strengths
None
Critical weaknesses
- Poor presentation makes it hard to understand the method and key insights in this work.
- An important baseline is omitted in this work. Since this paper is using a distillation method with a specially designed workflow to increase the verification ability of smaller models, it is not surprising that in Table 3 all training backbones received a performance increment. But at least we should include a comparison with direct SFT distillation on the direct generation trajectory of the teacher (DeepSeek-V4-Pro) without any agentic workflow, or we will not be able to determine how much of the performance gain can be attributed to the framework proposed in this work. This work did not compare their method with others as well.
- The amount of experiments presented in this paper is far too limited to support the main conclusions.
- This work provides little insights or valuable discoveries for future works.
Questions for authors
- In Table 3, all models evaluated obtained exactly the same score on CLEAN and Detection under RL and SFT + RL setting. Why would this happen? I believe this is a severe data error that will reduce the overall soundness of the paper.