- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper identifies an interesting phenomenon: existing KV-cache quantization methods introduce noticeable temporal flickering in visual world models, despite causing minimal degradation in conventional video generation models. Motivated by this observation, the authors investigate the effects of quantizing Keys and Values in Transformers and find that Key quantization has a more pronounced impact on model performance than Value quantization. Further analysis attributes this degradation to attention shifts arising from the interaction between quantized Keys and Queries.
To alleviate this issue, the authors propose Quantization-Sensitivity-Aware Clustering (QSAC), which selects Key centroids by jointly considering historical Query sensitivity and residual quantization difficulty, thereby minimizing attention-logit perturbations. They further introduce Principal-Subspace Attention Compensation (PSAC), which identifies dominant Query subspaces through eigendecomposition and applies low-rank compensation to Key quantization errors, reducing attention shifts and improving video quality and temporal consistency.
Experiments on three world models (LingBot-World-v2, HY-World 1.5, and Matrix-Game-2) and two video generation models (LongCat-Video and Causal-Forcing) demonstrate consistent improvements in video fidelity and temporal consistency while substantially reducing KV-cache memory consumption.
Critical strengths
-
The paper is well organized and presents a clear motivation. The analysis highlights the different impacts of Key and Value quantization on model performance and identifies attention shifts induced by Key quantization as a major source of performance degradation, providing valuable insights into the challenges of low-bit KV cache quantization.
-
The proposed QSAC and PSAC are straightforward, with clear connections to the identified attention-shift problem. Their designs are easy to understand and can be applied without additional model training, making the framework practical. Most importantly, the framework demonstrates strong practical engineering value, as it requires no additional training and can be readily integrated into existing video generation architectures.
-
The paper provides extensive experiments across three video world models and two video generation models, covering different resolutions and generation lengths. The comparisons with existing methods, ablation studies, and efficiency analyses provide solid empirical evidence for the effectiveness of the proposed approach.
Critical weaknesses
-
The proposed QSAC and PSAC share substantial conceptual similarities with existing approaches, particularly Query-aware quantization and low-rank attention error compensation. Prior works, including MixKVQ [1] and KQ-SVD [2], have already explored closely related principles. Therefore, the methodological novelty of the proposed approach remains unclear. The authors should better differentiate QSAC and PSAC from these existing methods and clarify the unique technical contributions beyond established techniques.
-
Although the paper is positioned as a KV cache quantization method for video world models, it remains unclear how the proposed QSAC and PSAC specifically address challenges unique to world modeling. Unlike conventional video generation, interactive world models typically require action-conditioned state prediction and consistent responses to user actions. However, both proposed components rely on general attention statistics without explicitly considering action-conditioned dynamics. Moreover, the experiments also include conventional video generation models, while the evaluations primarily focus on visual quality rather than action fidelity or environment consistency. The authors should clarify what makes the proposed approach particularly relevant to world models and provide corresponding evaluations to better justify the paper's positioning and title.
-
Although QuantWM achieves substantial KV cache compression, PSAC introduces additional storage overhead for INT8 compensation coefficients and BF16 principal-subspace bases. While the paper reports memory consumption, it remains unclear whether the proposed method maintains its advantages over alternative quantization strategies under equivalent memory budgets, such as QVG with higher bit widths or different quantization configurations. Additional comparisons under matched memory constraints would provide stronger evidence that the performance gains stem from the proposed techniques rather than the use of additional storage.
[1] MixKVQ: Query-Aware Mixed-Precision KV Cache Quantization for Long-Context Reasoning. ACL 2026.
[2] KQ-SVD: Compressing the KV Cache with Provable Guarantees on Attention Fidelity. AISTATS 2026.
Questions for authors
My major concern is the relation between the method and world models.
Reply to the Authors
We thank the authors for the reply, however, this does not address my concerns on how specifically QSAC and PSAC are designed for world models. It is more like a general design for video generation models.
The additional experiments in W2 provide useful evidence that action-conditioned generation changes the Query statistics and that updating these statistics improves the preservation of action-conditioned responses. However, I believe this does not fully resolve my original concern regarding the world-model-specific design of QuantWM. As your title specifically narrow your scope in world models, I do think it is a huge problem.
In particular, QSAC and PSAC still operate on generic Query statistics and attention sensitivity, without explicitly modeling actions, world states, state transitions, or other structural properties unique to interactive world models. The proposed mechanisms therefore appear applicable to general conditional autoregressive video generation models, where different conditioning signals can similarly induce changes in Query distributions.
The comparison between standard QuantWM and its fixed-Query variant demonstrates the benefit of dynamically updating Query statistics under changing actions. Nevertheless, this primarily establishes the effectiveness of condition-adaptive quantization, rather than demonstrating that the underlying quantization mechanisms are specifically designed for challenges unique to world models.
I would appreciate further clarification on what makes action-conditioned attention in interactive world models fundamentally different from conditional attention in general video generation, and which aspects of QuantWM explicitly exploit this distinction. Otherwise, I believe the contribution would be more accurately characterized as a general KV-cache quantization method that is particularly beneficial for interactive visual generation model, rather than a world-model-specific quantization framework.