- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
In this work, the authors target the cost of conditioning video diffusion transformers on dense video signals: depth, pose, scribbles, or a reference video supplying camera motion, style or effects. EasyVideoControl has two parts. ASC-MoT adds a conditional branch, a frozen copy of the backbone with LoRA, sharing self-attention under a mask that lets video tokens attend to condition tokens but not the reverse; with the branch's timestep modulation set to zero, its keys and values are computed once and cached across denoising steps. RCC compresses the condition tokens 8× using local attention over 2×2×2 groups, rescales their positions onto the video grid, and adds a reconstruction loss. On Wan2.2-TI2V-5B the method adds 5–8% latency over unconditioned generation; on VACE's own Wan2.1-1.3B backbone it runs 4.9× faster at a tenth of the trainable parameters.
Critical strengths
- The efficiency result is large and controlled. Table 2 retrains the method on VACE's backbone: latency falls from 51.0 s to 10.5 s, trainable parameters from 100% to 10%, and depth MAE from 0.026 to 0.023, while the seven VBench dimensions split three apiece with one tie. Dense conditioning becomes nearly free: 17.7 s against 16.9 s unconditioned for T2V.
- The component ablations are matched and informative. Causal masking accounts for most of the saving and compression for the rest; the reconstruction loss lowers MAE at every compression ratio; and learned compression beats average pooling on MAE at identical latency.
- The authors anticipate the backbone-fairness objection themselves, and the limitations section is candid about the 480p, 49-frame scope and the memory wall beyond it.
Critical weaknesses
- Control adherence is quantified for depth only, although the framework advertises pose, scribble, camera, style and effect control. The semantic I2V half has no adherence metric at all: its VBench scores do not measure whether the reference's motion or style actually transferred.
- Imaging quality is the method's consistent weak spot: lowest in Table 1, 3.6 points behind VACE on the shared backbone, and below all eight of its own T2V ablation rows.
- RCC's motivating regime is untested. At the one configuration evaluated it contributes 3.0 s and 2.5 GB, and the paper itself notes that beyond 8× the backbone dominates (l. 796–798), so its value for long, high-resolution video is argued rather than shown.
Questions for authors
- Can you measure adherence for at least one further structural control (pose or scribble) and for the semantic I2V tasks, for example camera-trajectory error or a style-similarity score against the reference?
- What is the unconditioned Wan2.1-1.3B latency under the Table 2 settings, and do VACE and Ours (1.3B) use the same sampling steps, guidance and hardware?
- Can you report RCC's effect at one longer or higher-resolution configuration, together with the training time and memory it saves?
- Sec. 3.1.1 places LoRA in the conditional FFN while Fig. 2 places it at the conditional QKV projections. Which is implemented?
- Is a single model trained for all control types, and is the VAP benchmark disjoint from the VAP-data training videos?