- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates temporal drift in autoregressive video generation under changing event prompts. The proposed method adjusts DMD supervision according to the feature displacement of consecutive teacher predictions. When this displacement becomes unusually large, a student momentum loss receives greater weight to preserve the recent trajectory. The experimental results show improved subject and background consistency while maintaining competitive prompt alignment.
Critical strengths
The proposed momentum loss encourages consistency between consecutive feature displacements, allowing temporal continuity to be maintained without directly forcing adjacent frames to remain similar. This design is appropriate for interactive generation, where the scene should remain consistent while the requested action changes.
Critical weaknesses
- The attribution of drift to teacher conditional bias rests on one qualitative example (Fig. 1 right) and the PCA plots in App. A. Sec. 3 argues that early onset rules out error accumulation, but that does not show the jump originates in the teacher. The reliability probe in Eq. 4 is built from the student's own chunk (Alg. 1, line 19d), so the displacement in Eq. 5 already contains the student's displacement, and the gate cannot tell a teacher mode change from a student jump. Lower drift after gating is consistent with either explanation.
- The sensitivity sweep in Fig. 4 (right) shows that gating more often or weighting the fallback more lowers Dynamic Degree, and App. B concedes that motion starting at the prompt boundary is temporarily downweighted. Long-CLIP in Table 1 is averaged over ten-second windows, so a short delay in realizing the new prompt would be invisible, and no reported metric measures action onset.
Questions for authors
- The Design 1 and Design 2 removal experiments in Fig. 4 (left) provide qualitative comparisons, but their effects are not quantified using the VBench metrics. Please report Table 2 metrics for those variants and for a constant gate weight, and give the values of the EMA rate, warm-up length, clip factor, and probe level in Alg. 1, which are not stated anywhere.
- Please report the action-onset delay relative to LongLive and MemFlow, for example the first chunk at which Long-CLIP favors the new prompt over the old one. Please also show a measured trace of the gate weight around a prompt switch to back the recovery claim in App. B, and clarify whether the descriptor caches are cleared at sequence boundaries, as this is not explicitly specified in Alg. 1.
2 comments
Thank you for the detailed rebuttal and the revised manuscript.
My first remaining concern on W1 is the evidence that the drift originates in the teacher. As I understand it, the claim of the paper is that the teacher output is prompt-consistent yet trajectory-inconsistent. The counterfactual experiment shows that a shift arises on the teacher side even when the student is unchanged. However, a change in the teacher output under a different prompt is expected by construction, so it remains unclear to me whether this shift is trajectory-inconsistent. It would be helpful if you could show how much of the change in the output is requested by the prompt and how much is not. For example, one could measure how much the subject and background that are described in both prompts differ between the two teacher outputs.
My second remaining concern on W1 is that the student displacement is contained in the gate signal. The Fast 25% analysis confirms that the gate decreases less than at a prompt switch. Looking at the numbers, however, it seems difficult to say that the gate is unchanged. A statistical test on the difference between Steady and Fast 25% would be helpful. Also, as I understand it, the Switch Gate is measured at chunks where both the prompt and the student chunk change. It would be helpful to see, as a control, the gate weight under the condition where the student is fixed and only the prompt is changed (Same (x, ε)).
Regarding Q1 and Q2, the ablation experiments have been extended well. I would like to ask for one confirmation. Table 7 is reported at 1,000 steps, whereas the experimental setting in the main text describes 3,000 steps. Was the setting changed for the ablation table? The numbers for Ours appear to be identical to those in Table 3. My other concerns have been well addressed.
As my concerns on W1 remain, I will keep my score for now. Thank you again for your thoughtful responses.
Thank you for your time and feedback - happy to discuss further
Dear Reviewer h1iz,
Thank you very much for your time and thoughtful feedback on our work. As the discussion period is nearing its end, we would be grateful if you could take a look at our rebuttal when you have a chance. Please let us know if there is anything we can clarify or elaborate on; we would be happy to discuss further.
Thank you again for your time and consideration.
Best regards, Authors of Submission #3673