- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces PE-OPSD, a prompt-enhanced on-policy self-distillation framework for text-to-image flow-matching models that internalizes prompt-enhancement benefits into the generator, removing the need for an external prompt enhancer at inference. A student model samples on-policy trajectories from raw prompts, while an EMA teacher conditioned on enhanced prompts provides vector-field supervision at student-visited states. Experiments across multiple backbones, prompt enhancers, and benchmarks show improved prompt fidelity over SFT and off-policy distillation baselines without sacrificing inference efficiency, and ablation and out-of-domain evaluations support the method’s effectiveness and generalizability.
Critical strengths
-
Clear and Well-Organized Presentation. The paper is clearly written and well structured, with intuitive illustrations and detailed explanations that make the proposed method easy to understand.
-
Improved Inference Efficiency. The method eliminates the need for an external prompt enhancer at inference time, offering noticeable speedups while maintaining competitive generation quality. However, the practical necessity of this efficiency improvement remains debatable, as discussed in the weaknesses.
Critical weaknesses
-
Limited Methodological Novelty. The proposed approach mostly adapts existing on-policy self-distillation (OPSD) techniques to prompt enhancement. Its central contribution is to use enhanced prompts as privileged teacher conditions, and it does not introduce substantial algorithmic advances beyond established OPSD frameworks. Consequently, its methodological novelty appears modest.
-
Insufficient Motivation and Unexamined Controllability Trade-offs. The paper’s main rationale for internalizing PE is to reduce inference latency, but it neglects the value of explicit PE for flexible and controllable generation. Embedding PE into the generator may compromise adaptability to user-specific requirements, yet these trade-offs are neither discussed nor evaluated. Moreover, PE-induced latency may be acceptable in many practical production settings, so the necessity of the proposed approach is not adequately justified.
Questions for authors
-
Since on-policy self-distillation and privileged-teacher conditioning are already well explored, what fundamental methodological novelty does PE-OPSD offer beyond applying existing OPSD techniques to enhanced prompts?
-
What evidence establishes the necessity of removing inference-time PE when its latency may often be acceptable? Moreover, has the work examined whether internalizing PE compromises the generator’s flexibility and controllability, especially under detailed or dynamically changing user instructions?