- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper revisits the necessity of visual token compression in modern VideoLLMs with native-resolution processing and built-in token reduction. It compares V-CAST against random token dropping, input downsampling, and a simple dynamic-resolution baseline across four VideoLLMs and four video benchmarks under 12.5% and 5% token-retention budgets. The paper finds that V-CAST does not consistently outperform simpler alternatives and argues that adaptive input-resolution allocation may provide a better accuracy--efficiency trade-off. It further analyzes backbone-dependent token geometry and selection behavior to explain why post-encoding compression can be less effective in these architectures.
Critical strengths
-
The paper studies an important and timely question regarding the efficiency of modern VideoLLMs.
-
The paper is well written, clearly organized, and easy to follow, which makes the empirical findings accessible.
Critical weaknesses
1. The paper substantially overgeneralizes from a narrowly defined experimental regime.
The main experiments consider only 12.5% and 5% retention, with the retention ratio defined after each model's native visual processing. These correspond to extremely aggressive additional-compression regimes, while moderate settings such as 80%, 60%, 40%, and 20% are not evaluated at all.
The architecture coverage is also too narrow to justify a general conclusion about "modern VideoLLMs." All four evaluated backbones are native-resolution architectures with built-in token reduction mechanisms, leaving other architectural regimes untested. Therefore, the evidence supports a much narrower conclusion: additional post-encoding compression may exhibit diminishing returns on already-compressive native-resolution architectures under extremely low token budgets. It does not support the broader implication that visual token compression itself is no longer necessary.
2. The empirical evidence is insufficient to support a general conclusion about sophisticated token compression methods.
The main cross-architecture evaluation effectively relies on a single compression method, V-CAST. KiToke, FlashVID, MMTok, EchoPrune, and TTF are evaluated only in a preliminary experiment under a single model/benchmark/ratio setting (Qwen3-VL-4B, VideoMME, 12.5% retention), after which V-CAST is selected as a "strong representative" and used as the sole sophisticated compression method in the main four-model evaluation. At the same time, several relevant methods discussed in the paper's own related work, including DyCoke, PruneVid, FastVID, and HoliTom, are not included in the main evaluation, while other recent methods such as FastV, VisionZip, UniComp, and SURGE are not considered.
Consequently, the experiments establish at most that V-CAST is often uncompetitive with simple baselines under the evaluated settings. They do not provide sufficient evidence to conclude that sophisticated visual token compression methods are broadly ineffective or unnecessary.
Questions for authors
-
Can the authors provide results over a broader range of retention ratios, including moderate settings such as 80%, 60%, 40%, and 20%?
-
Why is V-CAST used as the sole representative of sophisticated token compression in the main cross-architecture evaluation?
-
Does the main conclusion remain valid when evaluated with a broader set of recent compression methods beyond V-CAST?