- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Moment Z-Flow jointly predicts temporal moments of a velocity path for one-step generation. It trains these predictions using local differential identities and cocycle consistency across intervals, then combines the outputs through a normalized real-linear readout.
On CIFAR-10, the method achieves FID 3.54 versus 3.84 for MeanFlow at 100k updates. Two-seed experiments support the benefit of the active readout and cocycle supervision. The paper also reports one-step FID 2.44 on ImageNet-256.
Critical strengths
-
The path-moment formulation provides a coherent extension of average-velocity prediction. The local identities connect the moment outputs to tractable supervision, while the cocycle relates predictions across intervals. The analysis clearly distinguishes moment-estimation error from readout bias and does not claim that higher moments improve an already exact interval average.
-
The within-checkpoint and cocycle comparisons provide useful evidence. The active readout improves over the center readout in both training seeds. With the representation and readout fixed, cocycle supervision reduces mean FID from 4.04 to 3.61. These controls support the usefulness of output combination and interval-consistent training, while preserving one backbone evaluation at inference.
Critical weaknesses
-
The experiments do not isolate the contribution of higher moments from cocycle supervision. The cocycle ablation retains all moment heads in both conditions. Since the zeroth moment also satisfies an interval-composition identity, a zeroth-moment model with the same consistency training is an important missing control. The current results establish that cocycle helps the complete method, but leave the additional value of the proposed higher-moment representation unclear.
-
The advantage over MeanFlow is not established under comparable training compute or paired training seeds. The reported FID improvement from 3.84 to 3.54 comes with 17.3% more training GPU-hours. The two-seed readout comparisons support active versus center readout, but do not provide a corresponding two-seed comparison against native MeanFlow. In addition, seed 0 shares evaluation noise with readout screening. The independent confirmation is helpful, but the evidence for a stable advantage over the baseline remains limited. The ImageNet result lacks matched comparisons that could resolve this concern at larger scale.
Questions for authors
-
Do any existing results compare a zeroth-moment model with the same cocycle supervision against the full moment model? This would help determine whether higher moments provide an advantage beyond interval consistency.
-
Do existing training curves or runs allow a compute-matched, paired-seed comparison with MeanFlow? Please also clarify the readout search range and whether the selected parameter was fixed before the independent confirmation evaluation.
2 comments
We appreciate your careful review. For the new comparison in Table 5, we fixed the original readout before evaluation and used noise disjoint from screening. The full model improved on both native MeanFlow and the zeroth-order cocycle control in both seeds. We paired native MeanFlow and the full model by initialization seed and training random stream for seeds 0 and 1. The full model had lower FID in both pairs at both approximate training budgets (Table 9). We hope these additions address your concerns. We’d appreciate hearing your updated view and would welcome a reconsideration of the rating if you find the new evidence persuasive.
We thank the reviewer for identifying the controls needed to separate the representation, readout, and training-budget effects. The new evidence addresses these separately: the full extension improves over K=0 + cocycle, positive gains occur across two training seeds at approximately matched budgets, and fixed-q improvements survive independent confirmation.
1. Incremental value of the full moment extension.
At 100k updates:
Each entry averages two FID-50K evaluations on noise disjoint from screening, with common evaluation noise, reference statistics, and preprocessing across methods. The gains over K=0 + cocycle are 0.15/0.10 FID.
The control retains the EMA-teacher construction, detached subinterval targets, split distribution, optimizer, and global cocycle schedule. Both use the order-averaged objective in Eqs. (10)–(11). The zeroth-order coefficient is γj for K=0 and γj/4 for K=3. This matches the global weight and normalization convention.
These results support the full extension beyond the specified K=0 control, evaluating the combined moment supervision and readout rather than isolating each component. The submitted no-cocycle scores, 4.01/4.07, further motivate the combined method. Center-versus-active addresses the complementary question of how the learned moment outputs contribute at inference.
2. Paired training seeds at approximately matched budgets.
The supplementary comparison uses the same independent confirmation protocol. We used the original GPU-hour totals as approximate targets.
Both seeds improve at both target budgets. All runs use eight H100 GPUs, FP32, and batch 1024. Supplementary timing includes synchronized training computation, optimizer/EMA updates, and communication; startup, checkpoint I/O, and evaluation are excluded. Thresholds are fixed before FID evaluation, and the first checkpoint reaching each threshold is selected. q is not retuned.
For seeds 0 and 1, we paired native MeanFlow and the full model by matching their initialization seeds and training random streams. Each reported FID averages two evaluations of the same checkpoint.
The submitted scores are preserved. Full-model seed-1 FIDs 3.68 and 3.70 use the same 100k checkpoint under original and new evaluation protocols; 3.72 in the compute table uses the earlier 98915-update checkpoint.
3. Fixed and selected readouts survive independent confirmation.
The original seed-0 final evaluation shared noise with screening. Our records cover only part of the original search and do not show when we fixed the readout.
We hold the originally reported q=-1+0.5i fixed before the new confirmation. Separately, we screen 35 points with Re(q) in {-2,-1.5,-1,-0.5,0,0.5,1} and Im(q) in {0,0.25,0.5,0.75,1}. Only seed-0 screening selects q*=-1+i. Its coefficients are frozen before independent confirmation and transferred unchanged to seed 1; seed-1 grid evaluations do not select another winner.
The fixed readout improves over MeanFlow by 0.28/0.21 and over K=0 + cocycle by 0.15/0.10. Readout selection adds only a small gain. Thus, the main improvement remains with a fixed q, independent evaluation noise, and no per-seed retuning. These controls strengthen the CIFAR-10 evidence while keeping the ImageNet result separate from matched-baseline claims.