- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
FIS-DiT reduces per-step computational cost via latent-frame sparse computation within denoising steps. It computes full spatial token on selected anchor frames, reconstructs omitted module outputs through local linear interpolation, rotates anchor phases across sparse blocks, and retains dense computation in sensitive blocks and steps identified through calibration.
On an evaluation subset of 100 prompts, FIS-Fast reports measured end-to-end speedups of 2.09–2.41× across 4-step Wan 2.2 text-to-video and 8-step HunyuanVideo 1.5 image-to-video setups, accompanied by minor variations in aggregate VBench scores. Ablation studies support the contributions of the interleaved scheduling and block/step protection mechanisms.
Critical strengths
-
Clear Motivation: The paper clearly identifies the diminishing effectiveness of timestep-based acceleration in few-step video DiTs and motivates latent-frame sparsity as a complementary acceleration direction.
-
Good Analysis: The authors provide systematic empirical analysis of intra-step temporal redundancy, including adjacent-frame dynamics, block-wise heterogeneity, and interpolation errors, which directly motivates the proposed design choices.
-
Practical Method: FIS-DiT is training-free, lightweight, compatible with existing DiT inference pipelines, and preserves dense spatial layouts for efficient kernels such as FlashAttention.
-
Comprehensive Experiments: The experiments cover two different video DiT backbones, multiple resolutions and few-step settings, diverse acceleration baselines, as well as targeted ablations on interleaving and risk-aware deployment.
Critical weaknesses
Limited Evidence of Quality Preservation Evidence of quality preservation is confined to aggregate automated metrics on a relatively small evaluation subset. The matched comparison across 100 prompts neither reports paired uncertainty nor results from repeated seeds, and it omits detailed breakdowns of motion or temporal sub-metrics.
Insufficient Execution Details for Independent Implementation The sparse execution details are insufficient to support an independent implementation. Generic module descriptions and block-level execution overviews leave ambiguities regarding the attention, FFN, and residual paths in the actual evaluation, how non-frame conditioning/text tokens are handled, and how temporal positional indices are managed after frame subsampling. Although the high-level execution flow is understandable, these nuances can simultaneously affect both outputs and computational costs.
Questions for authors
see weakness.