- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
To address the limitations of current block-sparse attention mechanisms, this work introduces the SparsePR framework, which consists of two main components: Response-Coupled Partitioning and Probe-Fitted Residual Reconstruction. Experiments conducted across four different video generation models demonstrate the effectiveness of the proposed approach.
Critical strengths
- This method was tested on four video generation models, and the results are quite convincing.
- This work includes a comprehensive set of ablation studies, effectively avoiding the pitfall of conflating the model's fit on the training data with its generalization performance.
Critical weaknesses
- The presentation of the core end-to-end acceleration results lacks clarity. Could you clarify whether the time measurements for these acceleration results include the time spent on initial clustering, initial eigendecomposition, and weighted ridge regression?
- The independent value of the key new contributions, relative to the most relevant existing methods, has not been fully articulated. Given that this approach is plug-and-play and requires no training, I suggest that the authors conduct additional ablation studies by integrating their module into existing methods to demonstrate the performance gains achieved by their proposed approach.
Questions for authors
- Clarify which parts the acceleration results include and report the time consumed by each part.
- Conduct additional ablation studies by incorporating your proposed module into existing works to demonstrate the performance gains achieved by your method.
3 comments
I thank the authors for their response. Their explanations have addressed my concerns. I therefore maintain my recommendation to accept the paper. I hope the authors will retain these revisions in the final version.
Dear Reviewer jFUL,
Thank you for taking the time to read our rebuttal and follow up. We’re glad our response addressed your concerns, and we’ll retain these additional experiments and ablations in the final version.
Response to reviewer jFUL
We thank the reviewer jFUL for their comments. We appreciate the reviewer's recognition of our results, evaluation, and generalization performance. We address all concerns below:
The Dense and SparsePR totals in Fig. 4(b) (p. 9) are directly measured end-to-end wall-clock times for Wan2.2. The measured times are 1,650 s and 917 s, respectively. We run both methods in the same H100 allocation, with one untimed warm-up generation followed by one synchronized timed generation per method. In a separate run, we profile the components using CUDA events and apply their shares to the measured wall-clock total. The probe-repair time includes exact probe attention, weighted ridge fitting, and application of the fitted correction. The speedups in Table 1 are based on end-to-end generation times relative to dense attention.
Fig. 4(b) (p. 9) breakdown:
Table R8 further provides a complementary comparison of per-head attention latency across correction methods with the routed blocks held fixed
Table R8. Median latency for one full-sequence attention head (ms).
To test partitioning and repair of SparsePR in an existing method, we start from SVG2 [2]. We (1) replace SVG2’s semantic clustering with response-coupled partitioning, (2) add probe-fitted residual reconstruction to the original SVG2, and (3) apply both changes together under SVG2 selection rule. All variants retain SVG2’s top-(p) block selection rule, and we compare them at matched density. Tables R9 and R10 report both attention output error and generation fidelity (PSNR and LPIPS) for HunyuanVideo-13B and Cosmos-Predict2.5-14B, respectively:
Table R9. SparsePR components in SVG2 on HunyuanVideo-13B.
Table R10 . SparsePR components in SVG2 on Cosmos-Predict2.5-14B.
More ablations related to this question:
[1] Zhou, Xuanyi, et al. "SVG-EAR: Parameter-Free Linear Compensation for Sparse Video Generation via Error-aware Routing." European Conference on Computer Vision. Cham: Springer Nature Switzerland, 2026.
[2] Yang, Shuo, et al. "Sparse videogen2: Accelerate video generation with sparse attention via semantic-aware permutation." Advances in Neural Information Processing Systems 38 (2026): 96965-96991.
[3] Li, Haopeng, et al. "Sol-attn: Accelerating video generation inference via on-the-fly attention sparsification." arXiv preprint arXiv:2607.24027 (2026).