- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper revisits visual token compression for Video LLMs and proposes SimpleCluster, a simple training-free approach based on position-aware cross-frame clustering. The method groups visual tokens using spatiotemporal information and represents each cluster by averaging its original visual features. Experiments on four video understanding benchmarks and three Video LLMs demonstrate competitive performance, particularly under aggressive token compression. The paper further analyzes feature-space preservation through local approximation fidelity and global coverage to explain the effectiveness of the proposed approach.
Critical strengths
- I think this paper is generally well written.
- The organization is logical.
Critical weaknesses
- One of my main concerns is that the proposed semantic feature aggregation strategy seems conceptually similar to AOT, as both methods aim to reduce visual redundancy by aggregating semantically related tokens. Although their implementations differ, the authors should better clarify the key differences and the technical novelty of SimpleCluster compared with AOT.
- While the paper reports improvements in inference latency, cross-frame clustering itself may introduce considerable computational cost as the number of visual tokens increases. The authors should provide a clearer breakdown of clustering time, memory consumption, and end-to-end latency, particularly for longer videos and different token budgets.
Questions for authors
Please see the Critical Weaknesses section.