- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper targets at training-free multi-event text-to-video generation. To achieve this, it designs the following two interventions on the top of pretrained video DiT:
- Cross-event prompt fusion: it conditions every temporal segment on the first event's prompt for the first couple of steps. After that, each segment gets its own prompt.
- Event-partitioned mask: it restricts video self-attn and video-text cross-attn to event-matched blocks. At event boundaries it adds "transition bands" whose width shrinks linearly to zero.
These two gates and the band ratio are per-backbone hyperparameters.
To verify, the authors implement TunerDiT on Open-Sora 1.2/2.0 and Wan2.1/2.2 and compared with MEVG, DiTCtrl, FreeNoise and SwitchCraft. The authors show that TunerDiT adds 11.5% relative text-alignment over the base models on average.
Critical strengths
[S1]
It is a cheap & training-free method and the authors show the gains can be transferred into different backbones. TunerDiT is purely an inference-time schedule: a prompt swap plus attention masks. If the evidence holds up, this is a drop-in improvement for current open models.
[S2]
I like the design of the gates (i.e., two tau hyperparameters) and the band ratio. It can serve as explicit and characterized control knobs. The authors provide several supporting analysis (e.g., sensitivity curves, component ablations) and also discuss failure modes at both extremes. This makes the trade-off between text alignment and consistency something a user can tune, rather than an accident of the backbone.
Critical weaknesses
[W1]
My major concern is that two of the three listed contributions are mostly from the cited prior work [1]. Specifically:
- A prompt suite called MEve, with the same five categories, the same prompt counts (two events per prompt), and the same three sources.
- The same P1 => P2 switching sweep over x in [0, 0.1, …, 1.0] with the finding that the turning point falls within roughly the first 30% of steps, followed by a plateau.
The probing paragraph (Sec 3.2) and the benchmark description (App. A) closely mirror that paper's text. The real additions seem to be four-event prompts, Wan backbones, and TunerDiT itself.
Moreover, the coarse-to-fine premise is established in T2I, and the mechanisms resemble existing event-wise masking (Mask2DiT) and attention control (DiTCtrl, SwitchCraft). So the novelty rests on the specific PF+EM schedule, which raises the bar for the empirical evidence.
[1] Liao et al., "When and Where do Events Switch in Multi-Event Video Generation?", ICCV 2025
[W2]
Several empirical evidences are not reliable as reported. For example:
- In Algorithm 1, you pick the gates by maximizing TA, the turning point is located on MEVE, and no held-out split is described. The per-backbone settings in Table 3 therefore appear tuned on the evaluation benchmark, while baselines run at default settings.
- Some numbers also look contradictory. E.g., TVA is defined as a Sentence-BERT cosine similarity, yet values range from 1.0 to 2.25. The human study has 18 participants in Section 5.1 but 14 in Appendix.
- Some comparisons are confounded. Specifically, methods differ in backbone, resolution, length and frame rate. MEVG and FreeNoise run at 256x256 with visible stock-footage watermarks; TunerDiT-Wan2.1 runs at 832×480 with 81 frames. So "highest TA" and the human-preference wins largely reflect backbone quality.
Questions for authors
[Q1]
I am wondering what exactly is new in MEVE and section 3 relative to [1]? Please revise the contribution list and discuss that work explicitly.
[Q2]
On which prompts were two tau and r selected? You should report results with settings chosen on a disjoint split, or with one shared setting across backbones. Did any baseline receive comparable tuning?
[Q3]
I am also not sure how is EM implemented on Wan and on Open-Sora 1.2? Is video self-attention fully block-diagonal from tau onward? If so, different events never attend to each other for 70–90% of the steps. Given that prompts are zero-padded, which text tokens fall inside a band, and could a band contain only padding?
[Q4]
I notice that PF conditions every segment on P1 early, and section 3.2 shows that even 10% of steps on P1 imprints its layout. Does this suppress later events? Could you report TA by event index, and separately for scene-change prompts like the bird example in Fig. 2.
[Q5]
Also, I found TA rises with event count for nearly every method, including the base models. But, TA does not grow (Wan2.2: +0.016/+0.007/+0.010). What supports the "boundaries as anchors" explanation in section 5.5?
Response to Reviewer ga7b (1/2)
We thank the reviewer for the careful reading and for appreciating the gates as explicit control knobs.
W1 / Q1. [1] is a non-archival (No Proceedings track) ICCV 2025 workshop paper, presented for work-in-progress discussion as stated in the preprint. It is an early exploration of diagnosing multi-event generation and an early attempt to identify potentially influential topics, including both the position (“where”) and the timing (“when”) of the video diffusion model with a P1→P2 prompt-switch sweep.
Relative to [1], this submission adds:
We will revise the contribution list to attribute the benchmark and the probe to [1] and revise §3.2 and App. A. What distinguishes TunerDiT is the determination of the working factor proposed by [1], the fact that timing matters more than position, and a simple and effective scheduling steering method for longer event settings. Fig. 6 shows that each piece matters: EM drives alignment, and adding PF recovers part of the consistency that EM costs, and discusses its trade-offs.
W2 / Q2: hyperparameter selection. The gates were selected by the TA on MEve in general, and no held-out split was described; we agree this is a weakness of the protocol. Although in our inference-time method the turning point is a tunable value that applies to the same base model, three facts limit the risk of overfitting:
W2: TVA. We sincerely apologize: the Sentence-BERT definition is an unfixed leftover from an earlier, failed version that could not distinguish among complex event descriptions. The final TVA uses a VLM as a judge (Gemini): the generated video's frames are first described chronologically, and the judge then compares this description with the input prompt and outputs an integer score from 1 (differs a lot) to 5 (same meaning). TVA is the mean score, hence the 1.0–2.25 range. We will correct §5.1 and give both judge prompts in the appendix.
W2: human study. Sorry, it is a typo; we recruited 18 people in total, with 14 valid responses, and will make §5.1, Table 1b, and App. C consistent.