- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents SEAE, a structural pruning framework for few-step video diffusion transformers. It combines module-specific attention-head pruning with static block removal. Head budgets are derived from the spectra of projected head contributions, followed by CSS-inspired selection and scalar refitting. Blocks are scored by the final latent error caused by skipping them at individual solver timesteps, and low-error candidate sets are intersected across timesteps. The resulting compact model is recovered through distillation and evaluated on four-step Wan2.2-TI2V-5B Turbo.
Critical strengths
- The pruning criteria account for both module heterogeneity and timestep sensitivity. MHA-CSS distinguishes between determining head budgets and selecting individual heads, while evaluating candidate deletions by their worst-timestep reconstruction error. Table 3 provides useful evidence for the selection mechanism: with the same module-wise budgets and scalar refitting, CSS-based selection achieves 0.825 on VBench-I2V mini100, compared with 0.730 for random selection. Evaluating block importance through downstream endpoint error is also well motivated, since local feature similarity need not reflect the effect on the final generation.
- The method produces a genuinely smaller model with a fixed execution graph, rather than relying on runtime routing or feature caching. After recovery training, parameters decrease from 5B to 3.73B, reported DiT latency decreases from 1.20 s to 0.88 s, and peak VRAM decreases from 21.21 to 18.84 GiB, while the VBench-I2V total score changes from 0.8719 to 0.8702 (Table 1). The higher total score than the evaluated structural pruning baselines, together with the parameter and latency reductions, makes this a useful practical result.
Critical weaknesses
- The nearly unchanged aggregate score masks a substantial reduction in motion. In Table 4, dynamic degree decreases from 0.5276 for the teacher to 0.1537 for SEAE. The aggregate Quality score also decreases, while the I2V score improves. These results do not establish uniform preservation of generation quality and raise a concern that some appearance or consistency gains may accompany less dynamic outputs. This trade-off deserves explicit analysis, given the importance of motion in video generation.
- The block-pruning component is less thoroughly isolated than the head-pruning component. The direct comparison between endpoint Ablation Error and cosine similarity in Figure 9 is qualitative and covers two examples. There is no corresponding quantitative comparison at a matched block budget and recovery schedule. Consequently, the final combined result does not clearly establish how much the proposed block-selection criterion contributes beyond the attention-head pruning.
Questions for authors
- What accounts for the large dynamic-degree decrease in Table 4? Can intermediate results before and after recovery help distinguish whether this primarily arises from head pruning, block removal, or recovery training?
- At the same number of removed blocks and with identical recovery training, how does endpoint Ablation Error compare quantitatively with cosine-similarity-based selection? Please also specify the per-timestep candidate budgets used to obtain the final static block mask.
Thank you for the detailed responses and additional experiments. I appreciate the authors' efforts to address my concerns.
The new results help clarify the source of motion degradation, showing that it already emerges during attention-head pruning and can be partially mitigated through recovery training. The additional quantitative comparison between Ablation Error and Cosine Similarity also provides stronger evidence for the effectiveness of the proposed block-selection criterion under matched settings.
I have also reviewed the authors' responses to the other reviewers and found no additional concerns that would change my overall assessment. The motion-quality trade-off remains an important limitation to acknowledge. I will maintain my original score of 3 (Weak Acceptance).