- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Imago studies which reward signals and prompt distributions make online RL effective for compositional text-to-image generation. Using DiffusionNFT with LoRA, the study compares rewards, scoring formats, reward-model sizes, and controlled prompt corpora on two generator backbones. The resulting recipe combines graded MLLM feedback with a short-to-long curriculum. Both final models improve across five compositional benchmarks, with Imago-6B achieving the highest reported medium and long-prompt scores among the evaluated systems.
Critical strengths
-
The controlled reward comparisons offer useful guidance for visual RL. With the algorithm and corpus fixed, graded MLLM feedback improves composition across both backbones (Table 1), and compact reward models remain effective.
-
The final recipe improves both generators across all five compositional benchmarks. Imago-6B raises T2I-CoReBench from roughly 85 to 90 and achieves the highest reported medium- and long-prompt scores among the evaluated systems, supporting the recipe's practical value.
Critical weaknesses
-
Reward reliability needs stronger independent validation. The selected training reward and all compositional judges use Qwen; the Gemma control checks correlations on the original models, rather than evaluating RL-optimized outputs. Appendix D.3 also acknowledges that PickScore remains a proxy. These checks support the reported metric gains, but do not establish resistance to reward hacking or preservation of perceptual quality.
-
The curriculum ablation matches update budgets but confounds training order with resetting optimizer states, EMA weights, and reward statistics (Appendix C.2). Joint and single-corpus baselines receive no equivalent reset. The gains therefore cannot be attributed specifically to staged capability acquisition, a central claim. Comparisons with matched resets and a sequential run without resets are needed to isolate the curriculum's effect.
Questions for authors
-
Do the relative gains of VQAScore-trained models persist when their optimized outputs are assessed by a judge from another model family or by blinded human evaluation? Evidence on these outputs would directly address my main concern.
-
Does the sequential advantage persist without resetting training states, and how do joint or single-corpus runs perform with an equivalent midpoint reset? If available, a long-to-short comparison would further clarify whether the proposed order is essential.