- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper investigates the semantics–dynamics trade-off in video score distillation through temporal-frequency decomposition. Analyses of mode-mass drift and variance attenuation motivate TFRD, which assigns DMD-style updates to lower frequencies and SGMD-style updates to higher frequencies. Bandwise normalization and a post-Jacobian projection implement this division while preserving full-context forward computation. Experiments study four-step distillation of Wan2.1-T2V-1.3B against the corresponding full-band baselines.
Critical strengths
1. A meaningful conceptual contribution with a clear algorithmic consequence. The principal novelty is using the complementary sensitivities of the two objectives to determine where each should act. The mixture and variance analyses provide a substantive rationale for this assignment. Importantly, moving the cutoff produces the predicted semantic–dynamic trade-off, giving the perspective empirical content rather than leaving it as an illustrative explanation. This combination of insight and actionable design is my strongest reason for acceptance.
2. An elegant realization with demonstrated practical value. The two-sided projection addresses a genuine complication: a high-frequency discrepancy need not produce a high-frequency gradient after the fake-model Jacobian. TFRD resolves this without changing inference. The projector ablation supports the design, while the blinded preference study provides evidence that the improvements matter perceptually, beyond aggregate benchmark scores.
Critical weaknesses
The respective contributions of routing and adaptive scaling are not yet clearly distinguished.
TFRD changes both frequency assignment and sample-dependent normalization. Sweeping a constant does not isolate the latter, so the conclusion that the gains arise from where the objectives act rather than their effective strength is premature. This matters for identifying the method’s transferable design principle.
Relatedly, Section 5.2 argues that interpolating the objectives would place performance between the two baseline endpoints. This does not follow: nonlinear optimization and evaluation need not preserve such an ordering. A direct full-band combination is the relevant comparator for that particular argument.
Questions for authors
-
How much does independent band normalization contribute when routing is held fixed? A comparison using a shared full-band RMS scale would help distinguish frequency assignment from residual-dependent reweighting.
-
Have the authors evaluated a full-band combination of the same DMD-style and SGMD-style updates with comparable normalization? Its behavior would materially inform the assessment of selective routing relative to ordinary objective combination.
The divergence analysis should be validated on both image and video generation tasks, because its implications extend beyond temporal effects.
DMD is widely used in industry because it is simple and effective across image, audio, and video generation. Higher scores on video benchmarks don't necessarily indicate an improvement over DMD, since the metrics can diverge from human assessment. SGMD, one of the baselines, illustrates this issue. It reports gains over DMD on some metrics, yet in my assessment, DMD produces much better results.
This discrepancy points to a flaw in the theoretical analysis and the flaw will be apparent in image generation. Without validation on image generation tasks, it's unclear whether the method is genuinely effective.