- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Elastic Forcing, which keeps Self-Forcing's few-step autoregressive rollout but replaces DMD with a squared-MMD objective computed in frozen self-supervised feature spaces. The target distribution is a fixed collection of ~8,000 reference videos, so neither a diffusion teacher nor an online fake-score network is needed during post-training. Two estimators make this practical: a hybrid reference kernel mean that mixes a precomputed Nyström summary of all references with a Monte Carlo minibatch, and "estimation–differentiation decoupling", which evaluates MMD on 256 rollouts but back-propagates through a uniformly sampled subset with Horvitz–Thompson rescaling and segment replay. On Wan2.1-1.3B the VBench Total goes from 83.80 to 84.64. The paper also shows adaptation to monochrome style, a cartoon character and panoramic composition from reference videos alone.
Critical strengths
- The idea is timely and useful. Removing both score networks is a real systems win and reduce training costs.
- Decoupling estimation from differentiation is a neat, correct observation: MMD's cross-sample interactions need joint access to features, not joint computation graphs. The unbiasedness and covariance derivations are clear.
- Learning from references rather than from a teacher opens a genuinely new use: post-training a distilled streaming model toward a target style or concept without first adapting a teacher.
Critical weaknesses
- The "no teacher" framing is overstated. The 8,000 general-domain references are Wan-generated videos, so the teacher is still used, just offline. The cost of generating them is not included in the training-cost comparison.
- Gains on the main benchmark are small and unquantified for noise: +0.84 VBench Total for the two-encoder model and +0.45 for the three-encoder model used in all later experiments, from a single training run.
Questions for authors
- Which Wan model generated the references? If the 8,000 references come from Wan2.1-14B while Self-Forcing 1.3B distills from Wan2.1-1.3B, the 1.3B comparison mixes the objective change with a stronger implicit teacher. Please state the generator, its sampling steps, and the GPU-hours spent creating the references, and add a Self-Forcing baseline whose teacher matches.
- Variance and significance. Please report VBench over several training seeds (or at least several sampling seeds with confidence intervals). Differences such as Nyström-only 84.59 vs hybrid 84.64 are well within what one would expect from noise.
- Metric leakage. DINO-family features are used both as a training signal (DINOv3) and inside VBench's subject-consistency metric, and the VLM judge sees only 12–16 frames. Can you add an evaluation that shares no encoder with the training loss (e.g., FVD with I3D, or a larger human study)?
- Inconsistencies to resolve:
- Abstract says 14B training uses "eight H100 GPUs"; Fig. 1 and Sec. 5.1 say H200.
- Sec. 4 says the 1.3B model trains for 150 steps on 8 H200s; Table 6 says 4 H200s and 100/150 steps.
- Sec. 5.1 reports a human study with 15 participants; Appendix J describes 42 participants.
- Table 1/2 give 84.25 VBench Total for three encoders; Table 7 gives 83.81 for the same configuration.
- Table 8 reports VBench for 14B models although Sec. 5.1 argues VBench is unsuitable at 14B.
- "Figure ??" in Sec. 3.2; Sec. 3.3 evaluates "Eq. (13)", which lives in the appendix while the main text shows the same loss as Eq. (11); Appendices G and H are duplicates.
2 comments
Response to Reviewer BbpP, Part 2
[Q3] DINO overlap with VBench and evaluation using an independent feature extractor.
We agree that evaluation independent of the training encoders is important. Our two-encoder configuration does not use DINOv3 and achieves the highest VBench Total in Table 1, providing a direct check on whether the headline gain depends on DINO supervision.
We additionally evaluate FVD with I3D, comparing each student's outputs against the same evaluation reference collection:
| FVD evaluation | Value |
|---|---|
| Reference videos | 944 × 5 = 4,720 Wan-14B generations |
| Feature extractor | I3D |
| Self-Forcing FVD ↓ | 266.86 |
| Elastic Forcing FVD ↓ | 217.12 |
| Relative reduction | 18.6% |
The lower FVD supports the quality improvement beyond DINO-based subject consistency. These Wan-14B videos are evaluation references, distinct from the Wan-1.3B training collection. At 14B scale, the blind human study with 42 participants also favors Elastic Forcing (Table 5), providing complementary evidence independent of the training encoders and sparse-frame VLM scoring.
[Q4] Correcting the hardware, update counts, model labels, and cross-references.
We apologize for the reporting errors and clarify the settings below. All post-training experiments use H200 GPUs: the 1.3B model uses four GPUs, with 100 updates for two encoders and 150 for three; the 14B model uses eight GPUs and 80 updates, with five inference steps. The human evaluation involved 42 annotators, not 15.
Table 1 reports the selected endpoints, while Table 7 compares the encoder variants at 100 updates. Table 2 mistakenly copied the mixed-step endpoint results from Table 1; we will correct it to the common-update comparison. This explains the three-encoder scores of 83.81 at 100 updates and 84.25 at 150 updates. Table 8 concerns an early 1.3B exploratory experiment and was mislabeled as 14B. The final 14B result is:
| Model | Total ↑ | Quality ↑ | Semantic ↑ |
|---|---|---|---|
| Elastic Forcing 14B | 83.79 | 84.24 | 81.99 |
We will correct the affected captions, broken figure/equation references, and duplicated appendices. We will also report VBench alongside VLM and human evaluation, with each result clearly tied to its model and settings.
Response to Reviewer BbpP, Part 1
Thank you for recognizing the systems benefit, the selective-gradient analysis, and the flexibility of reference-driven adaptation. We now reply to comments and questions.
[W1, Q1] Reference-generator strength, offline teacher use, and reference preparation costs.
We clarify that Self-Forcing's real-score model is Wan2.1-T2V-14B, whereas our reference videos for the 1.3B comparison were generated by Wan2.1-T2V-1.3B. By all means, we are using a weaker implicit teacher than Self Forcing. The larger target model is therefore on the Self-Forcing side of the comparison, so the gain is not attributable to a larger reference generator.
We agree that “no teacher” was too broad. We mean that no online real/fake score models are used during post-training. We report reference preparation separately from post-training for the following reasons:
We agree that the preparation cost should nevertheless be disclosed separately. The requested details are:
[W2, Q2] Sampling variability and the size of the VBench and estimator gains.
We provide a matched multi-sample evaluation of the closest baseline. All reported evaluations use five samples for each of 946 expanded VBench prompts; the re-evaluation uses the same prompt/seed protocol for both models.
The improvement is present in all three aggregate metrics. These evaluations average sampling variability, but do not estimate variability across separate training runs. With respect to inference-seed noise, the standard error of the mean VBench score for a given model is 0.0935—far smaller than the 0.69 gap between our model (84.64) and Self-Forcing (83.95). We interpret the benchmark results together with the qualitative and independent evaluations, rather than treating the magnitude of the VBench Total difference alone as decisive.
For Hybrid, adding Monte Carlo comparisons reduces the finite-rank reference bias left by Nyström, while the persistent summary stabilizes the sampled estimate. Its best Total, Semantic, and VLM results in Table 3 support the design. The final Total difference from pure Nyström is modest; the broader contribution also includes video representation selection and estimation–differentiation decoupling.