- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes RISE-RL that helps an AI learn from specific mistakes rather than relying only on an overall score. It identifies requirements the AI repeatedly misses and temporarily provides hints to generate better answers. It then uses responses that score above the average of the original responses to train the AI to respond without those hints. The core idea is to give targeted help early in training, then remove it so the AI can perform on its own.
Critical strengths
Instead of relying only on an overall score, the method identifies which requirements the AI repeatedly misses and targets them during training The hints are temporary, and evaluation is conducted without them. This tests whether the AI retains what it learned It shows results across different tasks, the method improves reported performance in writing, chat, health, and science using two model sizes. In the tested writing setting, it exceeds a baseline given similar or greater training resources. The ablations investigate several design choices
Critical weaknesses
Table 9 reports three evaluations of the same trained checkpoint, rather than three independently trained models. This measures variability in generation and judging, but leaves uncertainty about training stability (especially in places where gain is only 0.13 points, or 0.32 points) The paper discusses several papers (e.g., Rubric-Guided Self-Distillation and RGR-GRPO ) but does not evaluate them. These comparisons would help establish the added value of selective guidance, reward filtering, policy support shaping. Some ablations change more than one factor, making the results harder to interpret. For example, in effect of policy support shaping, it changes both which tokens receive more attention and the overall strength of the training update. The comparison does not clearly separate these effects. in the reward filtering, “no-filter” version actively discourages below-average responses rather than simply learning from all guided responses. results favor the proposed settings, but do not establish why they help Both model sizes belong to the Qwen3 family, and the four domains use separately trained models. The results therefore do not establish that one jointly trained model improves across all domains.
Questions for authors
Table 9 reports repeated evaluations of the same checkpoint. Have you repeated training with different random seeds, and do the improvements over Rubric-RL remain consistent? Do you have comparisons with referenced papers (e.g., Rubric-Guided Self-Distillation or RGR-GRPO) that establish the added value of RISE-RL? Why does the “no-filter” variant use signed gains, which actively discourage below-average responses? Compare methods using the same computing budget on more models and tasks