- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents Rectified Meanflow, a framework to improve one- and few-step generation by training Meanflow on rectified noise image pairs generated by a pretrained generative model. The paper claims that straighter transport trajectories simplify mean velocity learning, leading to faster convergence and better sample quality. Experiments on ImageNet and text-to-image generation show substantial improvements over direct Meanflow fine-tuning.
Critical strengths
- Clear presentation of the benefit of coupling
The authors show that MeanFlow trained on the same generated images with independent noise barely beats Meanflow on real data. That shows the gain comes from keeping the noise–sample correspondence, not from the synthetic images themselves.
- Interesting presentation
Showing the loss as a function of the input z_t for different (r, t) pairs is an intuitive way to illustrate the problem. As the jump t − r grows, the Meanflow landscape gets visibly sharper while the Re-MeanFlow landscape stays smooth. It makes the motivation of the paper easy to follow and demonstrates where the gains might come from.
Critical weaknesses
- Curvature claim not isolated
The authors claim that reduced curvature is the actual reason for the gains, but the rectified coupling also makes the regression target almost noise-free, which can explain the faster convergence just as well. AYF already avoids noisy targets by using the teacher velocity, but the comparison isnt fair, since AYF doesnt use the proposed training tricks, which alone give a large improvement as table 4 shows. If the authors provide AYF trained with the same insights and a loss-landscape plot that shows AYF landscape is not smooth, the argument would be much more convincing. Especially since AYF is very close in terms of FID.
- Gain in other baselines
Does the gain also hold for other baselines such as Improved Meanflow? I am not asking about the largest model, rather, I am wondering whether the rectified coupling is a general plug-in that also helps the newer MeanFlow variants, or whether the improvement mostly disappears once the objective and guidance are already improved, as in iMF. Even a small-scale experiment, e.g. iMF-B at 256x256 with and without rectified couplings under the same budget, would answer this.
Questions for authors
- Is the loss-landscape of AYF smooth as well?
- Does the method still beat AYF when training design of table 4 is applied to AYF?
- Is the gain transferable to SOTA?