- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes UniEvo-VL, a critique-conditioned on-policy self-distillation framework for improving text-to-image generation. It distills corrective information from revised prompts into a generator while preserving the original prompt as the student’s conditioning. Experiments on GenEval, GenEval2, and OCR demonstrate improvements under certain configurations, with additional gains from stronger critics and inference-time reflection. However, the extent to which the proposed objective itself accounts for the observed improvements remains insufficiently established, particularly in the absence of stronger controlled baselines and comprehensive ablation studies.
Critical strengths
The paper introduces a promising approach that conditions an EMA teacher on critique-derived revised prompts and distills its predictions along the student’s own sampling trajectories. This provides dense intermediate supervision without requiring corrected-image targets, offering a meaningful application of on-policy self-distillation to feedback-driven image generation. Besides, the experiments cover compositional generation and text rendering, distinguishing direct generation from reflection-assisted generation. The paper also analyzes performance across prompt difficulty and acknowledges regressions and stylistic biases, providing a balanced assessment of the method’s potential and limitations.
Critical weaknesses
The primary novelty appears to lie in constructing privileged teacher conditioning from image-specific visual critiques, while the underlying on-policy prediction-matching mechanism follows existing distillation approaches. However, the paper does not provide sufficiently strong, controlled comparisons against generic prompt rewriting, image-independent prompt expansion or off-policy distillation. Consequently, the reported improvements cannot be attributed confidently to the proposed distillation mechanism rather than to prompt rewriting, data filtering, or other aspects of the training recipe.
Besides, the main results do not clearly establish variance across independent training runs or provide confidence intervals. Furthermore, only small part of acquisition attempts are accepted when post-revision verification is enabled, yet the reported learning curves primarily use optimizer updates rather than total end-to-end computational cost. Finally, the implementation uses fixed external critic and synthesis models and separately trained task-specific generator adapters. The evidence therefore supports task-specific feedback-guided adaptation more directly than general, continual self-improvement of a unified multi-modal model.
Questions for authors
A key concern is whether the reported improvements stem from the proposed on-policy distillation objective or from prompt rewriting and other training factors. A controlled comparison against generic prompt expansion, image-independent rewriting, and off-policy distillation under matched data and computational budgets would help clarify the contribution of each component. In addition, reporting means and standard deviations across independent training runs is important for establishing the robustness of the results.
The reliability of the evaluation also requires further clarification. The authors should describe how training and evaluation prompts are separated, including the detection of semantically similar and template-level near-duplicates. Furthermore, since Qwen-family models provide training feedback and are also used in GenEval2 evaluation, independent validation using evaluators from different model families or human assessments would help determine whether the reported improvements reflect genuine gains in generation quality rather than alignment with Qwen’s judging preferences.
2 comments
Response to Reviewer KkZW (2/2)
| Updates | Total GPU-h | Acquisition GPU-h | OPSD GPU-h | Attempted | Accepted | Acceptance |
|---|---|---|---|---|---|---|
| 20 | 22.26 | 21.15 | 1.11 | 540 | 161 | 29.81% |
| 40 | 39.26 | 37.04 | 2.22 | 928 | 320 | 34.48% |
| 60 | 61.54 | 58.20 | 3.34 | 1,500 | 480 | 32.00% |
| 80 | 81.32 | 76.86 | 4.45 | 2,024 | 641 | 31.67% |
| 100 | 105.36 | 99.80 | 5.55 | 2,664 | 800 | 30.03% |
Cost is linear at about 1.05 GPU-hours per update. As you noted, about 30% of acquisition attempts pass verification; acquisition accounts for about 95% of total cost and the distillation updates for about 5%. Because cost is linear in updates, the learning curves keep their shape when re-plotted against GPU-hours, and we will add that axis to Figure 3.
For reference against inference-time reflection: direct generation takes 4.49 s per GenEval prompt and base + one reflection takes 51.60 s. The 105.36 GPU-hours are recovered after about 8,000 requests served without reflection, assuming single-GPU inference.
4. Scope: task-specific adaptation, not general continual self-improvement
We agree with your reading. In the submitted experiments the critic and synthesis models are fixed and separate from the generator, and a separate generator LoRA is trained for each task. We have no multi-task or continual-learning experiment. The evidence supports task-specific, feedback-guided adaptation of a generator, and we will describe it that way. Concretely, we will:
- replace "a single multimodal model to act as both teacher and student" with wording that names the fixed vision-language critic, and reserve "self-distillation" for the student generator and its EMA teacher;
- replace "without external supervision or guidance" with "without paired ground-truth images, human annotation, or task-specific reward functions";
- write the critic as with φ fixed, instead of sharing θ with the generator;
- state in Section 3.1 that adapters are trained per task, and list unified and continual adaptation as future work.
5. Train/evaluation separation
GenEval2. We construct 50,000 adaptation prompts and a separate 800-prompt development set, and reserve the official 800-prompt benchmark for evaluation. A candidate is excluded if it matches an official or previously accepted example by normalized prompt text or by canonical annotated-scene identity (objects, counts, attributes, relations). The scene comparison canonicalizes entity order, symmetric relations and inverse-equivalent spatial relations, so paraphrases and reorderings of the same scene are removed, not only identical strings.
GenEval. There is zero exact or normalized prompt overlap between the training collection and the 553 evaluation prompts. GenEval is template-based ("a photo of X and Y"), so training and evaluation prompts share templates by construction; what is held out is the specific object, count, color and position combination.
OCR. We use the publicly released Flow-GRPO splits (19,653 training rows, 1,018 evaluation prompts) unchanged.
6. Evaluator independence
The concern is that Qwen-family models supply the training feedback and also score GenEval2. Four pieces of evidence do not depend on a Qwen judge:
- GenEval native score is computed by the official detector-based pipeline, not a vision-language model. It improves from 0.748 to 0.818 under direct generation.
- OCR native score is edit similarity on recognized text. It improves from 0.769 to 0.790.
- Gemini-2.5-Flash atomic accuracy, from a different model family, improves on both compositional benchmarks: 95.41% → 97.41% on GenEval and 81.47% → 82.75% on GenEval2 (Table 2).
- A non-Qwen critic also raises the Qwen-scored metric. With GPT-5.6-Luna feedback, GenEval2 Soft-TIFA improves from 32.97 to 35.53, so the gain on that metric does not require Qwen-generated feedback.
Two limits. The new results in Sections 1 and 2 above are reported only in GenEval2 Soft-TIFA; we will add Gemini scores for them. We have no human evaluation, and we will label HumanPref explicitly as an automated model judgment, not a human rating.
Closing
Thank you again for the time and care you put into this review. Your requests for controlled baselines and repeated runs have made the paper's claims more precise, and the revisions above will all appear in the updated manuscript. If these responses address your concerns, we would be grateful if you would consider raising your score. We are happy to answer any further questions during the discussion period.
Response to Reviewer KkZW (1/2)
Thank you for the detailed review. Your questions separate three things we had not separated clearly enough: the source of the teacher's conditioning, the on-policy objective, and the rest of the training recipe. We answer each below and state plainly which controls we have and which we do not.
1. What the improvement can be attributed to
Scope of the claim. The on-policy prediction-matching objective follows prior work (OPD, DiffusionOPD, D-OPSD) and is not our contribution. Our contribution is the teacher's conditioning: a critique of the student's own draft, synthesized into a revised prompt. The controls below are organized around that distinction.
Control A — image-independent rewriting (same objective, different conditioning). We distilled from the official Qwen prompt enhancer, which expands the request without seeing any generated image. This covers both generic prompt expansion and image-independent rewriting. The objective, backbone (Qwen-Image-2.1), seed (43), evaluation prompts and scorer are identical; only the source of the teacher prompt differs. Scores are official GenEval2 Soft-TIFA ×100 under direct generation, with 800 images and 6,012 checks per checkpoint.
Two conclusions follow. First, rewriting alone can be distilled into better direct generation, so part of the gain does come from prompt rewriting, as you suspected. Second, image-specific feedback is higher at every post-training checkpoint and ends +6.98 GM and +6.33 AM ahead.
Limits of this control: it is a single seed, and it is matched in optimizer updates, not in compute. The prompt-only pipeline skips drafting, critique and regeneration, so it is much cheaper per update. We will add a compute-matched comparison to the revision.
Control B — off-policy training on corrected images (same data source, different objective). We trained on the regenerated corrected images with standard supervised flow matching, which does not use the student's own trajectories. Both runs use 100 development prompts, 750 checks and Gemini-2.5-Flash scoring.
SFT falls below its own starting point while OPSD finishes above it. A second SFT run at the OPSD learning rate degraded faster (80.40% → 66.40% checks by step 20). This is preliminary evidence only: the two runs differ in learning rate (10⁻⁴ vs 3×10⁻⁴), the evaluation set is small, and this is not a full off-policy distillation baseline with a prompt-conditioned teacher. We will add that baseline under matched data and compute.
Data filtering. The submitted verified and unverified configurations differ in learning rate, acquisition seeds per prompt and run seed as well as in verification. We therefore cannot attribute their difference to filtering alone. We will rerun the unverified configuration under matched settings and report it.
2. Variance across independent training runs
We ran three seed-labelled training runs (42, 43, 44) on Qwen-Image-2.1. Values are mean ± sample SD, official GenEval2 Soft-TIFA ×100.
The direct-generation gain is positive in every seed. The mean within-seed improvement from step 0 to 150 is +27.07 ± 1.49 GM (95% CI [23.4, 30.8], t-interval, n = 3) and +20.86 ± 1.07 AM (95% CI [18.2, 23.5]).
What this does not cover: the Qwen-Image-2512 results in Tables 1 and 2 (GenEval, GenEval2, OCR) and the prompt-only control above are still single runs. We will add repeated runs for these in the revision.
3. End-to-end computational cost
GPU-hours are elapsed time multiplied by allocated GPUs and include rejected acquisitions.