- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MFlow, which extends AsymFlow's binary PCA-based prediction targets to continuous learnable weights, allowing the model to adaptively combine x-prediction and v-prediction. The authors also introduce ConvRefiner, a lightweight convolutional module for recovering missing high-frequency details.
Critical strengths
-
MFlow is simple and does not require changes to the transformer architecture. By learning prediction weights for different PCA directions, it avoids manually selecting the cutoff rank in AsymFlow. The authors also evaluate the method across image, video, and text-to-image generation tasks.
-
The authors identify a clear high-frequency deficit in JiT-style models and introduce ConvRefiner to address it. The module can be trained without updating the diffusion backbone and substantially improves high-frequency statistics while largely preserving FID.
Critical weaknesses
-
The novelty over AsymFlow is limited. AsymFlow already uses different prediction targets across PCA directions, while MFlow mainly replaces its binary selection with continuous learnable weights. Although this provides more flexibility, the paper does not clearly establish why continuous weights are necessary or what they offer beyond the existing binary formulation.
-
The performance gains are relatively small. Compared with AsymFlow, MFlow shows only marginal improvements across image, video, and text-to-image generation, and even performs worse in some settings. Its ImageNet results also fall behind recent methods such as PixelDiT and DeCo, although these use different architectures.
Questions for authors
-
Could you provide more evidence that continuous weights are necessary? For example, how would MFlow perform if its learned weights were binarized and the model retrained under the same setup?
-
Given the small performance differences, could you report results from multiple training runs to demonstrate that the improvements are consistent? It would also be useful to compare the total training and hyperparameter tuning costs of MFlow and AsymFlow to reach similar FID scores.
4 comments
Additional Experiment: Binarizing Learned Mꜰʟᴏᴡ Gains
We thank the reviewer for suggesting this experiment. We conducted two additional ImageNet-256 B/16 training runs, where the learned Mꜰʟᴏᴡ gains were binarized using thresholds () and (), and subsequently held fixed while retraining the generator under the same training recipe.
- ImageNet-256, B/16, with LPIPS. Results are from a single training seed, with FID evaluated using the default JiT-B sampling hyperparameters. | Parameterization | Gain configuration | FID | |------------------|--------------------------|-----| | JiT | Rank 0 (pure ) |3.424| | AsymFlow | Rank 8 |3.400| | Binarized Mꜰʟᴏᴡ | (rank 2, frozen)|3.370| | Binarized Mꜰʟᴏᴡ | (rank 5, frozen)|3.449| | Mꜰʟᴏᴡ (Ours) | Continuous, learned gains|3.327|
In this controlled comparison, Mꜰʟᴏᴡ achieves FID 3.327, compared with 3.370 and 3.449 for the two binarized variants. Although these differences are modest and we cannot establish their statistical significance from a single training seed, the results suggest that continuously learned gains remain competitive with fixed binary parameterizations and may offer additional benefits beyond identifying a binary subspace.
Furthermore, the two binarization thresholds yield different results, pointing towards the slight sensitivity to the choice of binary mask. Together, these observations provide additional empirical support for Mꜰʟᴏᴡ's flexible parameterization without requiring manual cutoff or threshold selection.
Dear Reviewer,
In our rebuttal, we addressed the binarization experiment suggested by you, supporting Mꜰʟᴏᴡ's flexible parameterization empirically, while saving thousands of hours of parameterization search. We furthermore provided five-seed inference evaluations and additional clarification of Mꜰʟᴏᴡ's mathematical and analytical contributions. We provide more results including the effectiveness of ConvRefiner in our Anonymous Website.
Based on these additional results and clarifications, would the reviewer kindly consider upgrading their rating?
response to authors
Thank you for the detailed rebuttal. However, my main concern remains unresolved. Despite the results across five random seeds, the performance gains over JiT and AsymFlow are marginal, with even larger gaps relative to PixelDiT and DeCo. Moreover, the improvements from ConvRefiner are barely noticeable in the provided visualizations, and the methodological contribution remains incremental. Therefore, I will maintain my original score.
Dear Reviewer,
Thank you again for your thoughtful review. We have posted a detailed rebuttal addressing your concerns, along with additional experimental results.
We would be grateful if you could please review our responses and let us know whether they address your concerns, or whether any further clarification would be helpful.
Thank you for your time and consideration.