- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Mass Forcing, a probability-mass-aware on-policy distillation framework. Given multiple student continuations sampled from a shared generated prefix, it estimates their relative teacher-to-student density ratios by integrating teacher–student score differences along latent-space paths. Experiments on MovieGen and VBench show improvements in aggregate quality and Dynamic Degree over several autoregressive and distilled video-generation baselines. The method does not modify the four-step inference pipeline or introduce additional inference-time computation.
Critical strengths
-
The paper identifies an important limitation of current autoregressive DMD pipelines. The observation that improved initialization does not prevent temporal dynamics from degrading during continued DMD training is practically important. The training trajectories across Self Forcing, Causal Forcing, and Causal-rCM provide useful evidence that initialization alone may not resolve the problem.
-
The proposed method contains a meaningful objective-level contribution. Unlike methods that only modify student initialization, Mass Forcing changes the training signal throughout on-policy optimization. Estimating relative density ratios from existing teacher and fake-score networks, and combining local mass weighting with set-level matching, is technically interesting. The method is also practical at inference because it preserves the original generator, sampler, and latency.
Critical weaknesses
-
The paper does not establish that the observed decline in Dynamic Degree corresponds to mode-coverage collapse. Dynamic Degree measures whether a video contains noticeable motion, but it does not measure conditional sample diversity, mode recall, or agreement with the teacher’s mode probabilities. A model can achieve high Dynamic Degree while generating only one type of motion, excessive camera movement, or unstable visual changes. Therefore, the central explanation that reverse-KL causes conditional mode collapse remains plausible but insufficiently validated.
-
A critical baseline is missing, preventing clear attribution of the gains to mass-aware supervision. Mass Forcing changes not only the loss but also the training data path: it samples (K) independent continuations from a shared prefix and applies conditional-chunk DMD, whereas Self Forcing uses a holistic video path. The paper does not report the corresponding uniform-weight baseline with (K=4), (=1), and (=0). Consequently, it is unclear whether the improvements come from density-ratio weighting and MMD or simply from grouped multi-rollout conditional training.
-
The reliability and limitations of the density-ratio estimator are insufficiently validated. The estimator integrates approximate score differences along straight paths in a high-dimensional latent space. These paths may cross low-density regions where both teacher and fake-score networks are unreliable. Moreover, because all (K=4) candidates are sampled from the student, the method cannot reliably identify a teacher-supported mode that is absent or extremely unlikely under the current student. The current ablations show that weight assignment matters, but they do not demonstrate that the estimated weights accurately represent teacher-to-student probability ratios.
-
The experimental evidence is incomplete for the claimed streaming-video setting. The main evaluation focuses on short videos and automatic VBench metrics. The paper lacks long-horizon rollout evaluation, human assessment of motion realism, uncertainty estimates across training runs, and training-cost analysis. These omissions are important because higher Dynamic Degree may reflect excessive or low-quality motion rather than improved temporal diversity.
Questions for authors
-
Density-ratio validation: Can the authors directly validate the estimated relative density ratios, for example, through a controlled Gaussian-mixture experiment or by comparing their rankings with an independently trained density-ratio discriminator?
-
Missing baseline: What are the results of an unweighted grouped-rollout baseline using the same sampled chunk, shared prefix, (K=4) continuations, training budget, and replay procedure, but with (=1) and (=0)?
-
Mode-coverage evaluation: Can the authors report direct conditional-diversity or mode-recall metrics across multiple seeds for the same prompt, rather than using Dynamic Degree as the main proxy for mode coverage?
-
Teacher–student discrepancy: In Table 1, Mass Forcing achieves substantially higher Dynamic Degree than Wan2.1. Is the reported Wan2.1 model the same 14B teacher used during training? If so, how should a student that exceeds the teacher’s dynamic frequency be interpreted as better matching the teacher distribution?
-
Estimator stability: How sensitive are the estimated ratios to the integration path, number of quadrature points, noise timestep, medoid anchor, and fake-score estimation error? The endpoint-only ablation does not fully establish that the line integral provides a reliable density-ratio estimate.
3 comments
Answers for Reviewer UuFe (2/2)
Q4. Teacher vs. Table 1. No. The Wan2.1 row in Table 1 is the 1.3B model, not the 14B teacher. We will label it Wan2.1-1.3B in the table. We also do not read a higher DD as closer matching to the teacher. DD is a thresholded motion rate, not a distance between distributions, and the training target includes CFG (scale 3.0). The relevant test is the teacher-relative comparison in W1/Q3, where Mass Forcing is the closest student to the teacher on all three metrics.
Q5. Stability. On our model, we change one factor at a time for 96 groups of samples in active cells (8 prompts × 2 chunks × 2 prefixes × 3 noise levels) and compare with the default estimator:
| Change | Spearman rank correlation ↑ | L1 change in weights ↓ |
|---|---|---|
| 3 → 9 Simpson points | 0.954 | 0.016 |
| Rotated anchor | 0.929 | 0.030 |
| Resampled query noise | 0.935 | 0.019 |
The median rank correlation is 1 in all three cases, and in at least 90% of groups the ranking of the four samples changes by at most one adjacent swap. A two-segment path through another sample matches the rotated-anchor values to within nats.
The ratio at each is between -smoothed densities, so its value depends on by design. What matters is that the ordering is correct at each , which the mixtures confirm at all three levels (W3/Q1). For fake-score error, the mixtures show that a learned fake score still orders 77-94% of pairs correctly (chance 50%) and keeps the weights near uniform when q = p. Its effect on each update is also bounded (W3/Q1).
W4. Long videos. We add 60-second results on VBench-Long with the standard VBench prompts. Reward Forcing is itself a long-video method and uses its native inference. The others use Infinity-RoPE.
| VBench-Long (60 s) | Self Forcing | Causal Forcing | Reward Forcing | Mass Forcing |
|---|---|---|---|---|
| Quality | 79.31 | 83.95 | 79.97 | 84.03 |
| Semantic | 69.05 | 71.20 | 74.70 | 78.95 |
| Total | 77.26 | 81.40 | 78.92 | 83.01 |
Mass Forcing is best on all three. In the last 5 s window (20 prompts × 2 seeds), its DD is 78% vs. 9% for Self Forcing, while its imaging quality only drops from 69.9 to 67.8.
W4. Human assessment. We ran a blind user study. 116 participants each ranked 10 sets of four videos (8 short, 2 long, from 100 prompts) on motion naturalness, dynamic degree, and imaging quality, with video order randomized. Share ranked first (%, chance 25):
| Ranked first (%) | Self Forcing | Causal Forcing | Reward Forcing | Mass Forcing |
|---|---|---|---|---|
| Short videos | ||||
| Motion naturalness | 1.2 | 14.0 | 5.0 | 79.8 |
| Dynamic degree | 1.2 | 29.5 | 3.4 | 65.8 |
| Imaging quality | 2.4 | 7.8 | 10.2 | 79.6 |
| Long videos | ||||
| Motion naturalness | 1.7 | 24.1 | 9.5 | 64.7 |
| Dynamic degree | 1.3 | 45.3 | 4.7 | 48.7 |
| Imaging quality | 2.2 | 10.3 | 22.4 | 65.1 |
Mass Forcing leads on naturalness and quality as well as dynamics (Friedman p < 0.001), so its extra motion is not judged excessive. Side-by-side 5 s and 60 s comparisons are also in the supplementary demo video.
W4. Training runs. We trained Mass Forcing again with a different training seed (300 GPU-hours per run). Total is 83.54/84.80 (MovieGen/VBench) vs. 83.38/84.98 for the reported run, and DD is 82.36/88.77 vs. 83.35/88.89. The two runs differ by at most 0.18 in Total and 1.0 in DD, and both exceed every baseline in Table 1 in Total and DD on both benchmarks. We will add this run to the revision. The effect is also consistent across the other separately trained runs. All four runs without mass weighting (Self Forcing, Causal Forcing, and Causal-rCM in Figure 1, and the uniform baseline) end at 11-32% DD, while the runs with it end at 65-83% (W2/Q2).
W4. Cost. Mass Forcing costs 2.6× the FLOPs of Self Forcing per generator update. Ratio estimation and MMD add only 1% over the uniform baseline, because the Simpson midpoint needs one extra 1.3B residual call rather than a 14B teacher query. Inference is unchanged.
Presentation. We will add a four-step overview of the estimator to Section 2.2 and keep the gating details in Appendix C.
Paper Revision Uploaded
Thank you again for your review. We have uploaded a revised version of the paper. All changes are highlighted in blue.
- W1/Q3 (DD vs. mode coverage). Appendix G reports conditional diversity, precision, and recall against the 14B teacher in Table 13. Section 3.1 now states that we treat DD as a measure of temporal dynamics and not of mode coverage.
- W2/Q2 (matched baseline). Section 3.4 now opens with this baseline, and Appendix D.5 gives the full comparison in Table 12.
- W3/Q1 (estimator reliability). Appendix H.1 reports the Gaussian-mixture study in Table 14. It also reports the magnitude error, which is why the claim is restricted to the ordering of the weights.
- Q4 (teacher vs. Table 1). The row is now labeled Wan2.1-1.3B.
- Q5 (stability). Appendix H.2 reports the one-factor-at-a-time study in Table 15.
- W4 (long videos). Appendix I, Table 16 and Figure 9.
- W4 (human assessment). Appendix J, Table 17.
- W4 (training runs). Appendix K.1 compares the two training seeds in Table 18.
- W4 (cost). Appendix K.2.
- Presentation. Section 2.2 now includes a four-step overview of the estimator, and the gating details remain in Appendix C.2.
- Limitations. Section 5 now states that modes the student has already lost cannot be recovered.
The attachment contains a demo video with side-by-side comparisons at 5 and 60 seconds.
If any concerns remain, we would be glad to address them before the discussion period ends.
Answers for Reviewer UuFe (1/2)
Thank you for the detailed and insightful review, and for recognizing a "meaningful objective-level contribution." All new results below will be added to the revision in blue.
W1/Q3. DD vs. mode coverage. We now measure conditional diversity and mode recall directly, across seeds for the same prompt. For each of 32 prompts, we generate 32 videos with different seeds and compare them, in VideoMAE feature space, with 32 videos from the 14B teacher for the same prompt. Diversity is the mean pairwise L2 distance within a prompt. Precision and recall use k-NN with k=3 and the teacher videos as reference.
From the same initialization, Self Forcing loses diversity (0.687 → 0.556), which supports the reverse-KL explanation, while Mass Forcing gains it (0.787). A single type of motion would lower diversity, and excessive camera movement or unstable changes would lower teacher-relative precision. Instead, both rise over Self Forcing (diversity 0.556 → 0.787, precision 0.351 → 0.455). Recall is near zero for every 1.3B student, including the initialization, and Mass Forcing is the only one above zero. In the blind user study (W4), Mass Forcing is also most often ranked first on motion naturalness and imaging quality. We treat DD only as a dynamics metric.
W2/Q2. Matched baseline. We trained the baseline you describe. It uses the same sampled chunk, shared prefix, K=4 continuations, training budget (1,000 updates), and replay as Mass Forcing, and also the same initialization, critic, optimizer, and seed. Only hk=1 and γ=0 differ.
Total and DD use the official checkpoint for Self Forcing, the best checkpoint (update 400) for the uniform baseline, and update 800 for w/o MMD. The last column is from our own training runs.
The uniform baseline collapses like Self Forcing (DD 65% → 11%) and does not improve Total even at its best checkpoint. Grouped multi-rollout conditional training alone therefore explains neither gain. Mass weighting halts the decline and adds +0.85/+1.83 to Total (MovieGen/VBench). MMD then lifts DD to 83% and adds another +0.98/+1.17.
W3/Q1. Estimator reliability. We ran the controlled Gaussian-mixture experiment you suggested, with 4 components in 2 and 32 dimensions and known density ratios. Teacher weights are uniform and student weights are [0.70, 0.20, 0.09, 0.01]. As in training, ratios are estimated at σ ∈ [0.20, 0.65] with K=4 groups. We report how often two samples of a group are ordered correctly (%, chance 50), with exact scores (a perfect fake score) and with a fake score learned as in Mass Forcing.