- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper adapts GRPO to post-train visual representation models via accuracy and uniformity rewards, evaluated on image classification and semantic segmentation.
Critical strengths
Clear motivation, extensive experiments across eight datasets, and a reasonable engineering adaptation of GRPO to deterministic representation models.
Critical weaknesses
-
Missing non-RL baselines (critical). The paper only compares against standard fine-tuning. It lacks comparisons with label smoothing, entropy/uniform regularization, focal loss, and class-weighted CE—methods that are functionally close to the proposed uniformity reward. Without these, it is impossible to tell whether GRPO adds value beyond a well-designed loss regularizer.
-
Limited necessity of the RL formulation. For fixed-class classification/segmentation, there is no genuine rollout diversity; the group-relative advantage largely reduces to a reweighted loss. The paper does not justify why this RL adaptation is preferable to a simple regularized objective.
-
Statistical significance. Standard deviations are reported, but no significance tests are performed. Several gains (e.g., segmentation mIoU +0.2–0.7) may not be statistically meaningful.
-
Overstated claims. The “first RL post-training for representation models” claim needs precise scoping, and the conclusion that GRPO is an effective paradigm is not fully supported without the above controls.
Note on fair comparison: The concern about asymmetric evaluation appears partly addressed: Table 1 reports both SR and kNN for fine-tuning, implying the same frozen re-probing protocol. However, this should be stated explicitly in the main text to avoid confusion.
Questions for authors
I encourage the authors to further clarify the above concerns and discuss how they plan to address these limitations in future revisions.