- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper aims to mitigate the rollout barrier caused by long-tail response generation in conventional synchronous RL. The authors propose MindPRO, which does not wait for all prompt groups to finish rollout, but instead selects a subset matching the target training batch size to proceed with training. The unfinished groups are left to later rounds to continue generation. To address the policy mismatch across steps, they introduce prefix importance sampling, length reweighting, and zero-variance group salvage. Evaluations on mathematical reasoning tasks demonstrate the efficiency of MindPRO.
Critical strengths
- The motivation is intuitive and the overall method is sound.
Critical weaknesses
- The research problem is not new. Many previous works have explored this issue, as already listed in the related work section (e.g., APRIL, CoPRIS, RollPacker). However, this study only compares against standard GRPO and a naive APRS variant, which are too weak as baselines to support the claimed novelty and superiority of the proposed approach.
- The experimental results in Table 1 are questionable. The reported accuracies on the Qwen2.5 series are much lower than official reports. More importantly, in several rows, the accuracy on GSM8K is significantly lower than on MATH, which suggests potential bugs in the evaluation pipeline or column misalignments.
- Although three stability safeguards are introduced, Table 3 shows no clear benefit from combining them together. Removing redundant components would make the method cleaner and more convincing.
- The evaluation is limited to mathematical reasoning tasks. Evaluating on more diverse domains (such as code generation or general agentic tasks) is recommended.
Questions for authors
Please refer to the weaknesses above