- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Transition-GRPO (T-GRPO), a reinforcement-learning fine-tuning method for flow-matching models. Instead of optimizing the usual clipped likelihood-ratio objective, T-GRPO constructs a target for each reverse transition mean by shifting the rollout mean in the direction of the sampled transition, with the shift scaled by the group advantage. It then trains the model to regress toward this detached target. The paper evaluates the method primarily on SD3.5 Medium. According to the reported score, T-GRPO improves over Flow-GRPO on PickScore, HPSv2.1, GenEval, and OCR.
Critical strengths
1、 T-GRPO turns advantage-weighted transition updates into regression toward a constructed target. This is a straightforward formulation that could be useful for practitioners and may be easier to integrate with some flow-model training setups.
2、Positive results on several metrics, including a substantial OCR improvement. On SD3.5 Medium, T-GRPO improves over Flow-GRPO across different metrics.
Critical weaknesses
1、The theoretical justification is limited. The analysis shows that T-Loss matches the local direction of an unclipped Flow-GRPO update, up to a scale factor, but does not explain why fixed-target regression improves finite-step optimization or training stability. The role and sensitivity of the target scale (set as 10) are also unclear.
2、The gains are uneven and do not establish broad superiority. T-GRPO improves over Flow-GRPO on the reported metrics, but DiffusionNFT remains stronger on GenEval and OCR.
3、The qualitative evidence for improved visual quality is weak. Figure 3 provides only a small number of examples, and the visual differences do not clearly substantiate a substantial quality improvement.
4、The comparisons with stronger GRPO variants are narrow. The paper does include compatibility experiments with methods such as MixGRPO and TempFlow-GRPO, but these results are reported only for PickScore. It is therefore unclear whether the gains extend to structured metrics such as GenEval and OCR, or how much comes specifically from T-Loss rather than the full T-GRPO recipe.
Questions for authors
How sensitive are the results to the parameter (target scale)? Could the authors report a sweep or explain how to choose this value?
Could the authors evaluate the MixGRPO and TempFlow-GRPO comparisons on additional core metrics, and isolate the effect of T-Loss from T-Init?