- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes Handoff: a unified multimodal model starts generating an image, and an image expert takes over to finish it. This requires compatible models that share the same VAE, but no additional training. It also proposes P-OPD, which teaches the unified model to imitate the expert during the later steps, so the expert is no longer needed at inference. Experiments cover image generation and editing across several model pairs. Handoff shows strong gains in text rendering and sometimes beats both models used alone. P-OPD improves BAGEL on all six benchmarks.
Critical strengths
- A simple method delivers clear improvements. Handoff needs no additional training and works across several model pairs. It can outperform both models used alone. For example, BAGEL→FLUX scores 0.655 on LongText-Bench, compared with 0.390 for BAGEL and 0.612 for FLUX. This is convincing evidence that the two models can help each other rather than merely relying on the stronger one.
- The distillation method makes the idea more practical. P-OPD improves BAGEL without requiring the expert at inference. The ablations support its two main choices: train only the later steps, and train on states produced by the current student. Together, these choices give more consistent gains than the tested alternatives.
Critical weaknesses
- The handoff timestep needs clearer justification and broader testing. The paper uses fixed handoff steps, but only studies timestep sensitivity for BAGEL→FLUX on LongText-Bench. It is unclear how the other handoff steps were selected and whether a separate validation set was used. This makes it difficult to judge whether the method works reliably across different prompts, resolutions, and sampling budgets without further tuning. Please explain the selection procedure and provide representative sensitivity results for editing and another model pair, including how the handoff step should change when the number of sampling steps changes.
- P-OPD is only validated on one unified model. Handoff is tested on three unified models, but P-OPD is tested only on BAGEL, with separate adapters for generation and editing. The broader Handoff results therefore do not establish that P-OPD also works across different unified models. Please evaluate P-OPD on another UMM, or clearly limit the conclusions to BAGEL and discuss what may affect its use with other models.
- The effects of partial training and late-only inference are not separated. Table 3 already compares full-trajectory OPD with P-OPD. However, this comparison changes both which steps are trained and when LoRA is enabled, so it does not show which change drives the improvement. Please take the same LoRA checkpoint trained with full-trajectory OPD and compare enabling it throughout sampling versus only after the handoff step, then compare both with P-OPD. This would help show whether keeping the original UMM in the early steps is sufficient, or whether training only the later steps provides an additional benefit.
Questions for authors
See weakness.