- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes GOJO, a framework for multi-teacher on-policy distillation of diffusion models. Instead of directly regressing to teacher velocities, GOJO constructs a target that balances teacher agreement, a covariance-based penalty on student displacement, and increases in other teachers' matching errors. The target is obtained by solving a small dual problem followed by an analytical velocity update. Experiments on SD3.5-Medium report improved capability transfer, while Qwen-Image experiments motivate the problem of teacher interference.
Critical strengths
- The paper studies a meaningful problem. Combining specialist teachers can create conflicting supervision, and accounting for both transfer and interference is a useful direction.
- The target construction is technically interesting and keeps student training as a simple regression problem. The appendix provides substantial details on covariance estimation, singular covariance, and the numerical solver.
- The reported SD3.5-Medium results are good, and the covariance and teacher-protection ablations help characterize the method.
Critical weaknesses
- My biggest concern is attribution in the comparisons with complete OPD recipes. Appendix F, Table 3 shows differences in query construction and teacher guidance: GOJO uses eight endpoint re-noising queries, whereas the baselines use rollout states and different time-sampling or CFG conventions. Appendix E.5 further introduces RMS compensation and a separate base-unconditional consistency loss. These choices can affect both reward and drift. Although Table 2 provides target ablations, the headline comparisons and behavior diagnostics need a baseline with the same queries, guidance, outer losses, and optimization budget, changing only the proposed target.
- The practical covariance is not the query-conditional geometry used in the theory. Appendix E.3 pools residuals across prompts, spatial locations, and time buckets, and explicitly shows that the estimate contains conditional-mean error. Appendix E.6 also notes that the old student's velocity need not equal the required conditional mean. This makes the implemented penalty a surrogate. The isotropic ablation is useful, but its update RMS differs substantially from the diagonal and channel versions. A scalar-shrinkage baseline with matched correction magnitude and outer weighting is needed to determine whether the improvement depends on meaningful anisotropic geometry.
- The probability-reweighting derivation needs correction and a clearer scope. A valid reweighted distribution requires 1+A >= 0, but the minimum-energy credit in Appendix C.1.2 is optimized without this constraint. Appendix D.1.1 acknowledges that the resulting linear credit may violate it. Thus, the claimed equivalence is to a relaxed quadratic credit problem, rather than generally to valid probability redistribution. In addition, Eq. 9 and Proposition 4 miss the factor 1/2 in the local expansion KL = (1/2) E[A^2] + higher-order terms. This constant can be absorbed into lambda, but the derivation should still be corrected and distinguished from the stronger probability interpretation.
- The evidence for mutual-teacher protection is internally inconsistent. In Table 2, enabling protection changes diagonal H+ from 0.007 to 0.053 and channel H+ from 0.013 to 0.081, although lower is better. Figure 4 and Sec. 5.3 describe approximately the opposite direction and claim reductions of 86.0% and 84.3%. Different checkpoints or protocols might explain this, but they are not identified clearly. This discrepancy directly affects the empirical support for one of the central components.
- The validation is narrower than the framing suggests. Qwen-Image is used for the motivating conflict analysis, while the main GOJO transfer experiment uses three RL-trained SD3.5-Medium teachers. This leaves the motivating SFT/RL mixture insufficiently tested. Moreover, Table 2 averages repeated monitoring checkpoints from one seed, which does not establish training-run uncertainty. Absolute training time and teacher-query counts would also help interpret the reported 1.09x relative cost, especially when hard routing still queries other teachers for protection.
Questions for authors
Please see above weaknesses.