- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies how reasoning length affects the accuracy and efficiency of LLMs. The authors find longer reasoning doesn't always improve accuracy. So they propose CARE, a framework uses sampled responses to estimate whether longer or shorter reasoning is more helpful. The method adjusts length rewards during GRPO training. They do experiments on 3 models and 4 benchmarks. Results show that CARE improves accuracy while reducing reasoning tokens.
Critical strengths
The method is simple and can be integrated into GRPO without additional inference cost.
Experiments show improved accuracy and reduced token usage across three model sizes.
Critical weaknesses
Experiments focus only on mathematical reasoning. Performance on other tasks are not unclear.
The method uses noisy accuracy estimates from small response groups and may affect training stability.
Questions for authors
How does CARE perform on other reasoning tasks?
How stable are the results across different training seeds?
2 comments
Thank you for your positive assessment of our work and for highlighting the importance of evaluating cross-domain generalization and training stability. We have provided additional experimental results on non-mathematical reasoning tasks and independent training seeds to further address your questions.
We hope our additional results and explanations will be helpful in addressing your concerns, and we would welcome any further thoughts you may have.
Response to Reviewer X5xV
We thank the reviewer for highlighting the importance of cross-domain evaluation and training-seed stability. We address these concerns below.
Q1: How does CARE perform on other reasoning tasks?
A1: CARE achieves higher pass@1 than GRPO on SynLogic-Easy, SynLogic-Hard, and GPQA-Diamond for all three Qwen3 model sizes. We compared GRPO and CARE on three non-mathematical reasoning benchmarks: SynLogic-Easy and SynLogic-Hard (official validation splits), which assess logical reasoning, and GPQA-Diamond, which covers graduate-level scientific reasoning in physics, chemistry, and biology. For consistency with the main paper, we followed the same evaluation settings as in the main paper, using a temperature of
0.6, top-p of0.95, and32independently sampled responses per question. The results are presented in Table 1, where each entry reports pass@1 (%) and the average number of generated tokens.Table 1: Cross-Domain Reasoning
Q2: How stable are the results across different training seeds?
A2: CARE achieves higher pass@1 than GRPO in most model–benchmark comparisons while generally consuming fewer tokens under three independent training seeds. We conducted
threeindependent training runs with different random seeds for both GRPO and CARE at each of the three Qwen3 model sizes. The resulting checkpoints were then evaluated on AIME 2025, AIME 2026, HMMT February 2026, and MATH500, using the same evaluation settings as in the main paper. Table 2 reports the mean ± standard deviation of pass@1 (%) and average generated tokens for the three training seeds.Table 2: Training-Seed Robustness