- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Rubric-to-Segment (RtS) addresses coarse credit assignment in rubric-based GRPO. It compares sampled answers separately on each criterion and uses judge-cited evidence to add segment-level corrections to the global advantage. On safety and medical tasks with two Qwen models, the paper reports gains over rubric GRPO and RLSD, plus ablations and a Dr. GRPO extension.
Critical strengths
-
RtS turns criterion scores and evidence citations from one judge assessment into a simple local update. The paper also shows that equal total rewards can hide different criterion scores and that criteria often point to different parts of an answer (Figure 2; Appendices C–D).
-
RtS improves the reported task score over GRPO and RLSD for both models in both domains (Table 1). The ablations and Dr. GRPO results add useful support, while general-capability scores show no broad decline (Tables 2–3).
Critical weaknesses
-
The shuffled-evidence control does not isolate whether feedback reaches the right content. Equation 5 centers corrections across segments, but the loss applies them to tokens; shuffling evidence across unequal-length segments can therefore change the answer's mean token advantage as well as its location. If the Table 2 gap persists after matching that mean, the semantic-localization claim would be more convincing.
-
The comparison is broad, covering GRPO, RLSD, Dr. GRPO, and even OPD, but it omits a matched multi-reward, response-level method such as GDPO. The Table 2 ablations retain local allocation or shuffle its evidence, so they do not show how much of the gain comes from criterion-wise normalization alone. If RtS remains stronger than a response-level combination of the same criterion advantages under the same training budget, this concern would be resolved.
Questions for authors
-
The following question is related to my concern in Weakness 1. How large is the token-mean shift caused by shuffling? Can a more controlled ablation separate this length effect from semantic correspondence, and does RtS still win?
-
As a complementary test to shuffling, does RtS outperform a response-level combination of the same criterion-wise advantages with matched rubric scores and training budget?