- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Grid Compressed Attention (GCA), a training-free acceleration method for video Diffusion Transformers based on query-aware key–value compression. It formulates linear KV compression as constrained entropy-regularized attention optimization, equivalent to minimizing reverse KL from the effective compressed attention distribution to dense attention. For fixed disjoint merge groups and weights, this yields a closed-form attention rule with the logit correction . Representative queries guide non-uniform KV merging separately for each query-group/key-block cell. Experiments on Wan2.1-14B T2V and I2V, with 50-step and four-step inference, report favorable quality–latency trade-offs at higher attention speedups against training-free sparse and structured baselines.
Critical strengths
1. Theoretically grounded KV compression.
The paper derives an entropy-corrected attention mechanism from a constrained optimization objective (Eqs. 8–12), providing a principled way to preserve attention mass under non-uniform KV compression. The substantial performance degradation without entropy correction (Table 2) supports its effectiveness, although its advantage over simpler group-size correction remains unverified.
2. Competitive quality–efficiency trade-offs.
GCA achieves the highest PSNR and SSIM among the compared methods at approximately 3× attention speedup on both T2V and I2V (Table 1), with up to 6.13× attention and 3.03× end-to-end speedups (Figure 1). The quality–latency curves and ablation studies further demonstrate the effectiveness of query-guided KV compression.
Critical weaknesses
1. Gap between theoretical optimization and practical implementation.
Although GCA is motivated by reverse-KL minimization (Eq. 8), its implementation relies on several heuristic approximations, including disjoint key assignment, representative queries replacing optimal attention-weighted queries, and greedy Fisher-based sampling. These approximations are not guaranteed to minimize the original objective. Moreover, the connection between local grid-cell optimization and global attention fidelity remains insufficiently validated.
2. Limited practical benefit of Fisher-guided representative selection.
Despite the theoretical analysis in Theorem 1, Fisher-guided sampling improves PSNR by only 0.21 dB over random representative selection (Table 2). The paper lacks statistical analysis across different compression ratios and denoising steps, as well as runtime ablations demonstrating whether this relatively complex selection mechanism justifies its overhead.
3. Substantial fidelity degradation relative to full attention.
Although GCA outperforms competing methods at high speedups, its absolute fidelity remains limited. At approximately 3× attention speedup, PSNR reaches only 14.59 dB for T2V and 17.08 dB for I2V, with SSIM values of 0.52 and 0.56 (Table 1). Furthermore, the reported VBench metrics cover only subject consistency and imaging quality, leaving motion consistency, temporal stability, and text-video alignment insufficiently evaluated.
4. Limited experimental generalizability and statistical validation.
Experiments are limited to Wan2.1-14B and its step-distilled variants, without validation on other video DiT architectures such as HunyuanVideo. Moreover, T2V and I2V evaluations include only 20 inputs each, and the reported VBench metrics cover only limited aspects of generation quality. This narrow evaluation makes it difficult to reliably assess overall video quality and establish the robustness of the reported improvements.
Questions for authors
-
How do GCA's heuristic approximations relate to the reverse-KL objective (Eq. 8), and how does local optimization affect global attention fidelity?
-
Does the modest 0.21 dB PSNR gain from Fisher-guided sampling (Table 2) justify its computational overhead?
-
Could the authors report additional VBench metrics, including motion consistency, temporal stability, and text-video alignment?
-
Could the authors evaluate GCA on other video DiT architectures and larger prompt sets to demonstrate generalizability?