- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper identifies the "lost in the rollout" problem in on-policy distillation (exemplified by Self Forcing) for multimodal video diffusion, and proposes four targeted improvements: curating and optimizing image and text conditions to fix input defects in conditioning; training the ODE trajectory distillation to convergence to solidify the initialization foundation; introducing an auxiliary audio energy loss to restore the teacher’s trajectory signal; and increasing the learning rate and tuning classifier-free guidance strength to amplify the teacher’s learning signal. These remedies effectively stabilize training and improve lip-sync performance. Validated on OmniAvatar, MiniMax-H3 and multiple benchmarks, the 4-step model achieves improved image quality and lip-sync, with over 20× inference speedup.
Critical strengths
- Within a relatively short submission timeframe, the authors conduct experiments on the MiniMax-H3 base model and verify the effectiveness of the proposed method on state-of-the-art larger-scale base models, which is beneficial to the research community. The ablation study is thorough and detailed, demonstrating the effectiveness of each component of the method, which helps readers intuitively grasp the detailed effects of the proposed approach.
- The insights and findings regarding image conditions in on-policy DMD training are interesting. I believe the community needs to pay more attention to this issue, and this observation is instructive even in non-avatar scenarios. In addition, the converged ODE initialization is well-justified; while the community has previously noted the importance of ODE initialization, few have provided in-depth analysis of the training process.
- This paper is well organized and easy to understand.
Critical weaknesses
- The visual quality and lip-sync alignment of the "livetalk_interactive" demo are noticeably inferior to the generation results in the "h3_samples". Since the supplementary material does not include a README or directory structure guide to clarify the experimental setup, I can only infer that the proposed method suffers from noticeable performance degradation in real-world real-time interactive scenarios.
- Some baselines are missing. Given the fast-growing interest in this task and the large number of recent works, I consider it reasonable to include more baselines for a more comprehensive comparison of model performance, e.g., AvatarForcing (Cui et al., 2026), daVinci-MagiHuman (Chern et al., 2026), Hallo-Live (Li et al., 2026), and LongCat-Video-Avatar 1.5 (Cai et al., 2026).
Questions for authors
- Please explain the noticeable performance degradation of the LiveTalk demo mentioned in the weaknesses.
- Please add more baselines.