- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes BASA, a backend-agnostic sparse attention mechanism for accelerating high-resolution image and video generation with Diffusion Transformers (DiTs). The method combines shifted local-window attention across layers and denoising steps with pooled global K/V representations to enable cross-window communication while reducing attention computation. For video generation, it additionally introduces content-adaptive window routing to preserve fine-grained information. The approach uses standard attention backends without requiring customized sparse kernels, but requires LoRA-based dense-teacher distillation to maintain generation quality.
The authors evaluate BASA on FLUX.1-dev for image generation and Wan2.1-1.3B for video generation, comparing against Swin, CLEAR, and STA. Experiments show up to 2.68× and 4.52× attention-level speedups for image and video generation, respectively, while largely preserving generation quality. Ablation studies further examine the contributions of window shifting, global pooling, and routing.
Critical strengths
BASA achieves substantial measured attention speedups using standard SDPA backends, reaching up to 2.68× on FLUX and 4.52× on Wan, and the method is claimed to be backbone agnostic.
Critical weaknesses
As stated above, I have two main concerns. First, the method requires additional fine-tuning through dense-teacher distillation, but the paper does not compare against training-free sparse attention methods. This makes it difficult to assess the practical advantages of BASA, especially when considering the additional adaptation cost. Second, I am not fully convinced by the novelty of the proposed window-shifting mechanism. Similar ideas, including shifting attention windows across denoising steps, have already been explored in previous works such as HiDiffusion. I would like to see a clearer discussion of how BASA differs from these approaches and what improvements come specifically from its proposed shifting strategy.
Questions for authors
- How does BASA fundamentally differ from previous sliding window attention works, why it might yield better results?
- Could you compare BASA with existing training-free sparse attention methods under the same generation settings?