- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Flow-OPD consolidates specialized flow-matching teachers into a single text-to-image student. The student is initialized through filtered teacher-trajectory SFT or LoRA merging, samples its own states, and receives velocity supervision from one teacher selected by prompt metadata. A separate aesthetic teacher supplies manifold-anchor regularization. Experiments evaluate composition, OCR, preference, and image quality against an interleaved GRPO-Mix baseline, with additional controls for direct distillation, initialization, and the aesthetic reference.
Critical strengths
-
A practically relevant consolidation problem with promising reported results. Combining task-specialized teachers into one generator can retain useful capabilities without deploying several experts. The reported composition and OCR improvements over the evaluated GRPO-Mix recipe suggest that dense teacher supervision is a productive direction for this setting.
-
Useful attribution controls for the complete system. The manuscript includes direct velocity distillation, MAR removal and reference replacement, GRPO-Mix with MAR, and merging controls. In particular, the aesthetic-anchor comparisons support a separate contribution to image quality, and the direct-distillation result helps show that much of the overall gain comes from dense supervision. These are consequential controls for assessing the system’s value.
Critical weaknesses
-
The actual optimization objective and its incremental contribution are unclear. Section 5 describes differentiating a weighted velocity loss on detached student states and explicitly avoiding score-function estimation. Appendix B.1 instead discusses a detached transition-KL reward, and Table 5 labels Flow-OPD as a “PG-style update.” The distinction from direct velocity distillation is therefore not specified consistently. This is central because the reported independent aggregate gain over that control is 0.0155; without the exact two losses, it is difficult to identify what the proposed objective contributes beyond existing online velocity supervision.
-
Inconsistent results and an underspecified merge prevent reliable reproduction of the key comparison. Table 2 gives merge-model scores of 0.93/0.93/4.31/23.05 with average 0.9021, whereas Section 6.2 gives 0.92/0.94/4.35/23.08 with average 0.9044. SFT+GRPO-Mix is also 0.8515 in Table 2 but 0.8165 in Table 5. These may represent different runs, but their identity and aggregation need reconciliation. Moreover, Eq. 17 averages three rank-32 weight updates, whose sum need not remain rank 32, without explaining the representation subsequently optimized. Both issues affect whether the claimed incremental gains and parameter comparison can be verified.
Questions for authors
- Please provide exact Flow-OPD and direct-distillation losses or pseudocode, including weighting, any reward/log-probability terms, and all stop-gradient operations. What precisely differs between the two controls?
- Which checkpoint, evaluation setup, and seed aggregation produce the canonical main results? Please reconcile the Table 2, Section 6.2, and Table 5 values.
- How is the average of the LoRA weight updates represented and subsequently trained? What is its resulting rank, and is compression or another approximation applied?