- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
RubricEvo is an online framework for text-to-image RL that, at every training step, rewrites rubrics that all rollouts pass or all fail (using pass rates plus visual differences among the current images, via a two-stream design) so rewards stay discriminative, and it outperforms scalar-reward and static-rubric baselines.
Critical strengths
This paper proposes RubricEvo, an online rubric evolution framework that addresses the problem of static rubrics becoming uniform during training, which removes the discriminative power of group-relative advantages. Its strengths are that the idea is simple and clear and can be added on top of existing rubric methods without changing the RL algorithm or training an extra reward model. Through diagnosis, two-stream evolution and re-scoring, it turns otherwise uninformative rollouts into useful supervision rather than discarding them as rejection sampling and CGPO do. Ablations support the design choices, showing that online evolution beats offline evolution and that the two-stream design beats a single coupled call, and it improves results on both SD-3.5-Medium and FLUX.
Critical weaknesses
The paper’s central premise is that static rubrics become uniform and starve GRPO of learning signal, but it never reports how often this happens, giving neither the share of rubrics rewritten per prompt nor the share of zero-variance groups. The comparison to baselines is also not compute-matched: RubricEvo adds extra rubrics and several extra MLLM calls at every step, so the gains may come from additional judging rather than from evolution itself, the evidence is thin as well. Finally, the same 8B model writes and grades the new rubrics, and reward validity rests on one limited audit (100 groups, one external judge, agreement below 50%). It is therefore unclear whether the improvement reflects better supervision or simply a noisier, more heavily judged reward.
Questions for authors
- How often do static rubrics actually become uniform, and what share of rubrics is rewritten per prompt and over training?
- Do the single-run gains on TIIF-Bench and DPG-Bench, hold across multiple random seeds?
- Does the improvement come from evolution itself or simply from extra judging, when compared with compute-matched static baselines?
- How many additional MLLM calls and how much extra training time does RubricEvo add per step compared with each baseline?
- How do the results change with a different judge or evolver model, and how well do the evolved rubrics agree with human judgments?