- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper investigates several design choices for training text-to-image diffusion models. The authors conduct extensive ablation studies on a customized dataset, covering image captioning, VAE architectures, text encoders, MAR training, and the scale of RL training data. Based on these experiments, the authors identify several factors that contribute to improved model performance, including dense caption supervision, stronger VAEs and language encoders, mixed-resolution training, and a large, diverse, and well-balanced RL prompt set.
Critical strengths
-
Extensive ablation studies. The paper provides a relatively comprehensive set of ablations for text-to-image generation, offering insights into how different VAEs and text encoders perform within the proposed dataset and model architecture, even with a relatively compact model.
-
Promising post-training performance. The model achieves promising results after post-training, demonstrating the potential of the proposed training recipe to improve the performance of a compact text-to-image diffusion model.
Critical weaknesses
-
Limited novelty and generalizable insights. Many of the architectural ablations primarily compare existing VAEs and text encoders. While the experiments identify which components perform better in the proposed setting, they provide limited insight into why these components work better or what general principles can guide future model development. For example, the conclusion that stronger VAEs and text encoders improve performance is not particularly surprising. It remains unclear how researchers could apply these findings when new VAE or text encoder variants become available.
-
Limited novelty of the training strategies and backbone architecture. Dense caption supervision and MAR training have already been explored in prior work, such as Qwen-Image and SD3. Similarly, the finding that scaling up the RL prompt set in terms of both size and diversity improves performance is relatively intuitive. The architecture is borrowed from SD3, and the text feature injection mechanism is similar to Hi-Dream.
-
Unclear scope and insufficient evaluation of training efficiency. Although the paper is titled around training efficiency, it does not provide quantitative evidence demonstrating improved training efficiency, such as training time, computational cost, or the resources required to achieve a given performance level. Most of the ablation studies focus on generation quality, particularly GenEval, and the reported performance improvements appear to be largely attributable to post-training. Furthermore, it is unclear why few-step distillation, which primarily targets inference efficiency, is included in a study focused on training efficiency. The scope and central contribution of the paper therefore remain unclear.
-
Incomplete and inconsistent evaluation metrics. The ablation studies rely heavily on GenEval, and a more comprehensive evaluation using additional metrics could provide a more convincing assessment of generation quality. In addition, it is unclear why Table 1 reports two different evaluation metrics. If multiple metrics are used throughout the ablation studies, reporting them consistently would make the comparisons more transparent and easier to interpret.
Questions for authors
Given the various factors investigated in the paper, how would the authors rank their relative importance for training a strong text-to-image diffusion model?