- Rating
- 1(−1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
To enable efficient video token compression in video large language models, this paper introduces TeQCo (Temporal Quota Consistency), a training-free framework with a two-stage compression pipeline. In the first stage, temporal feature changes guide token budget allocation, while spatial tokens are aggregated into representative candidates. The second stage selects task-relevant tokens using prior-corrected attention scores, subject to a temporal quota consistency mechanism that preserves frame-level allocation proportions. Evaluations across four video understanding benchmarks and four model backbones show that TeQCo can reduce time to first token (TTFT) while incurring relatively modest accuracy degradation in several settings.
Critical strengths
- Across four video understanding benchmarks and multiple model architectures, including Qwen3-VL, InternVL3.5, and LLaVA-OneVision, the proposed training-free framework achieves meaningful reductions in time to first token (TTFT) while maintaining competitive accuracy in several settings. These extensive evaluations highlight its practical value for efficient video understanding.
Critical weaknesses
-
Limited Methodological Novelty. The extent to which TeQCo advances beyond existing techniques remains unclear. Its main components—content-adaptive token allocation, feature aggregation, and task-aware token selection—follow principles previously explored in V-CAST [1] , VidCom2 [2] , and PriorTR [3]. As currently formulated, the central contribution of temporal quota consistency appears to impose a relatively straightforward proportional constraint on frame-level token budgets during the second compression stage. A clearer explanation of what is methodologically new, beyond the integration of these components, would strengthen the paper.
-
Insufficient Validation of the Core Contribution. Establishing the effectiveness of temporal quota consistency requires a controlled comparison between global Top-K selection and quota-constrained selection, with candidate representations, relevance scores, and final token budgets held fixed. Such a comparison is currently missing, despite the mechanism being positioned as the paper’s central contribution. Instead, the existing ablations vary multiple components or compression budgets simultaneously, leaving the source of the observed improvements unclear. Experiments that isolate the quota constraint are therefore needed to substantiate the proposed mechanism and its underlying motivation.
-
Inconsistent Accuracy–Efficiency Trade-offs and Insufficient Budget-Matched Comparisons. The practical advantages of TeQCo remain difficult to establish because comparisons with existing methods use different operating points rather than matched token budgets. Although TTFT is consistently reduced, these gains are accompanied by substantial accuracy losses on some benchmarks, particularly LongVideoBench and MVBench. Faster TTFT also does not uniformly yield lower end-to-end inference latency; on Video-MME, total latency increases slightly. Evaluating accuracy–latency trade-offs at matched token budgets and equivalent compression ratios would provide a clearer basis for assessing the method’s practical benefits.
-
Poor Figure Quality and Unprofessional Visual Presentation. The overall visual quality of the paper needs substantial improvement, particularly Figure 1, which appears rough and insufficiently polished. The excessive use of irregular, wavy lines and hand-drawn-style elements makes the figure visually cluttered and distracting. These wave-like patterns are visually jarring and can even make the figure uncomfortable to look at, rather than helping readers understand the proposed framework. As the main methodological illustration, Figure 1 should be redesigned with cleaner lines, consistent alignment, and a more professional visual style to improve readability and presentation quality.
[1] V-CAST: Video Curvature-Aware Spatio-Temporal Pruning for Efficient Video Large Language Models. NeurIPS 2026
[2] Video Compression Commander: Plug-and-Play Inference Acceleration for Video Large Language Models. EMNLP 2025
[3] Accelerating Multimodal Large Language Models with Prior-Corrected Token Reduction. ECCV 2026
Questions for authors
The paper is far below high level conference bar.