- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper investigates why additional privileged information does not necessarily improve student performance in few-step video generation. The authors introduce Privilege-Induced Teacher Variance (PITV), an offline metric measuring the variability of teacher corrections across reference continuations, and show that higher PITV correlates with lower distillation gains. To address this, they propose Mode-Calibrated Privileged Distillation (MCPD), which adaptively weights teacher corrections based on directional agreement and normalized displacement. Experiments on Wan2.2 and LongCat-Video demonstrate improvements over several distillation baselines.
Critical strengths
The paper addresses an important limitation of privileged distillation for efficient video, and the motivation for the work is sound.
The methodological contribution is well motivated, and Section 3.3 provides a clear derivation of the calibration mechanism.
The experimental section is detailed and includes comparisons against multiple relevant baselines.
Critical weaknesses
I have almost no experience in this specific field, and this paper is generally far from my domain of expertise. However, although the paper is generally well organized, some parts are difficult to follow without substantial familiarity with privileged distillation and few-step video generation. Several technical concepts are introduced in rapid succession, making it challenging to understand the central intuitions behind PITV and MCPD. A more accessible explanation of the problem and the proposed solution would improve readability.
While MCPD preserves the computational cost of inference, its calibration mechanism requires additional teacher evaluations during training, and although the performance improvements are consistent, their magnitude is relatively modest against the strongest competitors.
Overall, as I said, this paper is very far from my domain of expertise. Therefore, I will carefully read the rebuttal of the authors also to the other reviewers to clarify my assessment and possibly update my score.
Questions for authors
Given the additional training cost introduced by MCPD, could the authors comment on whether the observed performance improvements justify this overhead in practical applications?
3 comments
Dear authors,
I took some time waiting for the other reviewers to follow-up on their review, but I still can't see their new comments. As I already stated previously, my expertise is very far from this domain. However, I trust the judgment form the other reviewers, who responded positively to the paper. I also reviewed the rebuttal form the authors, to both my questions and the questions from the other reviewers. I believe these rebuttals added clarifications and new evidence to the original document.
Overall, I decided to raise my score to 3 -- Weak Accept.
Once again, I would like to repeat that this paper is very far from my expertise. I invite again the AC and the other reviewers to take this into account for their final decisions.
Best regards, Reviewer Ae5A
Thank you for the follow-up
Thank you for taking the time to read our responses and reconsider your assessment. We noticed that the rating field in the Official Review still shows 2 on our end. When you have a chance, could you please check whether it reflects the 3 (Weak Accept) you mentioned in your follow-up?
Best regards
Practical trade-off between post-training cost and video quality
Thank you for asking when the additional training compute is worthwhile. For a checkpoint that will be used repeatedly at a fixed sampling budget, we would choose MCPD when the resulting quality and preference gains matter to the application and the post-training budget can accommodate an additional 23 GPU-hours on Wan2.2 or 40 GPU-hours on LongCat. STEP-SCALAR is a reasonable choice when the post-training budget is tight or frequent retraining is required.
Why one extra teacher prediction? A prompt and an opening frame can allow several plausible camera movements. The teacher sees the recorded continuation, which shows one of them. At the same partly denoised video state produced by the student, STEP-SCALAR uses the difference between the teacher’s predictions with and without continuation evidence and applies a scalar weight for that denoising stage. MCPD makes one additional prediction using a smaller subset of the same continuation. For each spatiotemporal latent position, it retains more of the full correction when the two evidence budgets produce corrections with consistent directions and limited normalized displacement.
Ordinary MCPD training therefore uses one paired continuation and three teacher predictions per supervised student state, compared with two for STEP-SCALAR. PITV and the eight-reference comparisons are offline diagnostics, not additional components of ordinary MCPD training or deployment.
Measured cost and benefit. Table 3 and Appendix F.4 report one timed post-training allocation per configuration on eight H800 GPUs. The I2V gains summarize five paired training runs from a shared initialization per backbone, with quality evaluated at each run’s validation-selected checkpoint.
Timing includes data loading, forward and backward passes, and optimizer updates. It excludes validation search and checkpoint serialization; these percentages therefore describe matched post-training runs at the selected configurations, not the full model-development cost. On Wan2.2, the stronger four-step PER-STEP-SCALAR schedule in our additional control reduced MCPD’s advantage to +0.40 I2V points [0.20, 0.60].
The automatic-score gains are accompanied by a perceptible difference in the direct blinded comparison. Across the two backbones, 586 of 866 non-tie judgments favored MCPD over STEP-SCALAR: 67.7% [95% CI 62.8, 72.3], with 134 ties among 1,000 judgments. Each backbone contributed 50 condition-matched video pairs from the methods’ Run 1 validation-selected checkpoints. Intervals resample complete pairs within each backbone, retain all ten raters’ judgments for each pair, and are conditional on this rater panel and checkpoints. This comparison establishes preference over STEP-SCALAR; it does not make a human-preference claim about DFD.
Deployment invokes only the student, using its native sampler and the same four or eight denoising steps. No teacher prediction, PITV computation, multi-reference construction, or calibration module is used at deployment. Reusing a checkpoint spreads the additional post-training cost across the videos it produces, although the cumulative training-cost difference remains 23 or 40 GPU-hours. The reported comparison evaluates the specified training protocols rather than establishing which method would be optimal if both were assigned exactly the same total GPU-hour budget.
Readability. We will open Section 3 with the camera-motion example above and explicitly state that the student reaches each noisy state through its own sampling steps. We will relabel Figure 2 to distinguish training-only continuation inputs and the three teacher queries. Before introducing the equations, we will separate the two questions in plain language: PITV measures how a teacher correction varies across possible continuations at fixed states; MCPD measures how strongly one training continuation supports a correction across nested evidence budgets. We will also streamline the notation leading into Section 3.3 while retaining the derivation and estimator details in the appendices.