- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper aims to investigate how well training-free sparse attention methods transfer their performance across domains. The authors evaluate two modifications of XAttention, based on EntropyInfer and DynSparse, on RULER and Video-MME. The results show that both methods underperform the original XAttention on RULER, with EntropyInfer showing the largest degradation. On Video-MME, the results are mixed: EntropyInfer performs slightly worse than XAttention, while DynSparse achieves comparable performance.
Critical strengths
None
Critical weaknesses
-
The paper looks like low-effort work. The paper is built around a single main finding, which is repeated multiple times throughout the manuscript without adding much new analysis. This makes the paper look artificially extended. Additionally, the legend in Figure 3 and the presentation of Tables 3 and 4 look poorly edited and give the impression that they were generated without careful human review.
-
The experimental setup does not convincingly address the main research question. The paper claims to investigate whether training-free sparse attention methods transfer their performance across domains. However, the authors only test modifications of XAttention, specifically replacing its block-selection mechanism with those from EntropyInfer and DynSparse, rather than evaluating the original methods. Moreover, both modifications perform worse than XAttention on RULER, while on Video-MME, EntropyInfer performs slightly worse and DynSparse achieves similar accuracy. This raises questions about the validity of the experimental setup and whether it is suitable for answering the main research question.
Questions for authors
None