- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper studies OPD in diffusion models, asking what OPD transfers, what determines transfer at student-visited states, and when distillation is worthwhile relative to direct joint optimization. It evaluates three representative OPD methods on two backbones and thirteen routes through budget-controlled comparisons, held-out behavioral evaluation, frozen-trajectory interventions, temporal-supervision and teacher-source experiments, and comparisons with direct joint reinforcement learning. The results show that OPD consolidates specialist gains selectively, method rankings depend on the training budget, and a higher-scoring teacher can produce a weaker student.
Critical strengths
The paper conducts an extensive empirical evaluation of existing OPD methods across two backbones, thirteen task routes, and multiple training configurations, including equal-time and equal-data comparisons. This provides useful practical evidence for understanding their effectiveness and limitations beyond a single task or configuration.
Critical weaknesses
The paper does not sufficiently synthesize its extensive experimental observations into a clear set of contributions. The narrative emphasizes individual results and numerical comparisons, while the insights and their implications for understanding OPD remain underdeveloped. This makes the conceptual contribution difficult to assess.
Questions for authors
Could the authors clarify the paper’s central insights and explain how the experimental evidence supports each of them and establishes the main contributions?