- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
LongTake uses longer video prefixes during teacher-forcing initialization, followed by 5-second DMD training. It improves the motion–quality tradeoff on 30- and 60-second videos, with optional Hybrid DMD adding supervision for later chunks.
Critical strengths
-
A useful initialization result. LongTake improves long-video dynamics while keeping the subsequent DMD recipe at 5 seconds. The benefit is already present without Hybrid DMD.
-
A better motion–quality tradeoff. It produces substantially more motion than SGF with a modest drop in aesthetic quality, and better aesthetic quality than RF†. The supplementary examples help show what these gains look like.
Critical weaknesses
-
The source of the gain is unclear. Long TF changes the data, adds 3,000 updates, and uses longer prefixes. I'd like to see short-window TF trained on the same data for the same budget; Figure 5 does not separate these factors.
-
Action quality needs a closer look. The videos show encouraging examples, but Dynamic Degree does not tell us whether the prompted actions continue late in the rollout. A targeted human evaluation would help.
Questions for authors
- Was λ=0.2 selected on a separate validation set?
- What are the total GPU-hours for each variant, including TF initialization?
3 comments
Thanks for the additional experiments, especially the short-window comparison, which clarifies the benefit of long-horizon training. I maintain my weak accept rating.
We thank the reviewer again for their insightful questions and suggestions. We are glad that our additional experiments helped clarify our contribution, and sincerely appreciate their support of our work.
Answer to Reviewer NMi7
We sincerely appreciate the reviewer's interest in our research and acknowledgment of its significant contributions. We have provided detailed responses below.
1. Source of the gain.
We appreciate this valuable suggestion. To address the reviewer's concern, we ran the short-window TF on top of Short TF, denoted additional Short TF, that can isolate the source of the gain.
Additional Short TF is identical to Long TF in every setting and differs only in training on the first 81 frames of each video without a video prefix (i.e., s = 0 in Algorithm 1).
The table below shows that, with the same data and updates, the long video prefixes raise dynamic degree well above that of additional Short TF at comparable subject consistency and aesthetic quality. The added data and updates also help, but additional Short TF still stays below Short TF + CD in dynamic degree.
This supports our claim that supervising the later frames conditioned on long video prefixes, rather than the added data and updates alone, brings the gain. We have added these results to the Ablation Study in Section 5.1 and the training details of additional Short TF to Appendix C.1.
Table R1. Initializations followed by the same 5s joint DMD and evaluated on 30s rollouts as in Figure 5.
2. Prompted actions in later frames.
We measured whether later frames still depict the prompted action, which dynamic degree alone does not show, using a VLM judge in place of a human evaluation.
The judge uses the same model and settings as our VLM exposure metric. For each 60s rollout, it sees the first and last 10s with the text prompt and judges whether the subject performs the prompted action, without knowing the method or which clip comes first.
The table below shows that, in the last 10s, LongTake shows the prompted action about as often as the strongest baselines and as often as in its own first 10s, while keeping the high dynamic degree in Table 1. This suggests that the dynamics LongTake sustains still depict the action described in the prompt.
We have added these results and the judge instruction to Appendix D.4.
Table R2. Share of videos (%) in which the VLM judge finds the prompted action in the first and last 10s of 60s rollouts for the 72 dynamic-degree prompts.
3. Selection of λ = 0.2.
Thank you for this question. We clarify that λ was chosen by comparing the settings in Table 2 on the 30s prompts, without a separate validation set.
Every λ in Table 2 also keeps LongTake on the Pareto front of dynamic degree and aesthetic quality against the baselines on 30s rollouts, so this conclusion does not depend on the choice of λ.
4. Total GPU-hours.
We count every stage of each variant in the table below, including Short TF, which all variants share, and we have added this table to Appendix C.1.
Long TF takes the place of CD, so LongTake with either joint or Hybrid DMD costs less in total than Short TF + CD. This is because CD requires two additional networks, a frozen teacher and an EMA target, alongside the trained student, whereas TF trains a single network.
Table R3. B200 GPU-hours of each variant.