- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MSA (Mixed Sparse Attention), a training-free mixed sparse attention inference scheduling framework for causal video diffusion. Without fine-tuning the model, the method dynamically selects sparse attention strategies during autoregressive video generation via offline head behavior calibration, runtime gated routing, global budget auditing, and incremental history statistics to accelerate long-video inference. The authors conduct experiments on the Causal-Forcing causal variant of Wan2.1‑1.3B and verify speed gains against multiple sparse attention baselines. They also introduce a real density auditing mechanism to address the issue of inflated speedup ratios in prior sparse methods. However, multiple limitations exist in the experimental evaluation that undermine the reliability of conclusions.
Critical strengths
- This work proposes global real density auditing, which measures the actual computational cost across all denoising steps, cache updates, and dense fallback operations. It resolves the common issue in prior sparse attention works that only report nominal sparsity and overestimate acceleration performance, bringing practical value to the evaluation paradigm of this field.
- For causal video diffusion scenarios, the authors systematically observe the behavior of different attention heads in the Transformer and design a gated dynamic mixed sparse scheduling scheme. The approach is plug-and-play at inference time and requires no parameter fine-tuning of the pre-trained model, achieving considerable inference speedup for long-video CF-long settings.
Critical weaknesses
- Insufficient experimental evaluation and weak generalization. All experiments are validated solely on a single AR model obtained via Causal-Forcing distillation of Wan2.1‑1.3B. Evaluation uses only a subset of VBench prompts, and main experiments adopt a single random seed, making it impossible to rule out metric bias introduced by sampling noise. Baselines lack representative recent bidirectional sparse attention methods for video, leading to incomplete comparisons.
- Counterintuitive experimental observations lack rigorous explanation. In the RF‑5s experiment, multiple quality metrics of MSA exceed those of dense Full Attention, while dense attention is generally the performance upper bound for sparse approximation methods.
Questions for authors
- Why does the evaluation not adopt the full set of VBench prompts and report the performance of all evaluation metrics?
- Some metrics of MSA outperform dense full attention, which is generally regarded as the theoretical upper bound of sparse attention methods. What are the potential explanations for this counterintuitive phenomenon?
- Will the authors consider incorporating more state-of-the-art bidirectional sparse attention methods (e.g., VSA, SLA) as additional baselines for comprehensive comparison?
- All experiments are only conducted on the AR model of Wan2.1-1.3B, which leads to limited generalization and insufficient persuasiveness. Could the authors supplement experimental results on other models to validate the effectiveness of the proposed MSA?