- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces ContextTom, a training-free method for accelerating video vision-language model inference. It performs early temporal compression using lightweight visual descriptors, preserves complete spatial features through the early DeepStack prefix in Qwen3-VL, and subsequently applies query-guided spatial selection with multi-level visual similarity. The method reuses retained hidden states to reduce later decoder computation. Experiments are reported on Video-MME, EgoSchema, LongVideoBench, and MVBench across several model backbones.
Critical strengths
-
A reasonable compression strategy. Combining early temporal reduction with delayed spatial selection is a meaningful design direction for reducing inference cost while preserving early multimodal context.
-
Broad experimental coverage. The paper evaluates multiple video benchmarks and model backbones and includes component ablations and latency profiling.
Critical weaknesses
-
Insufficient experimental comparability and reproducibility. Table 1 reports 76.22% accuracy and 123.5 ms TTFT on Video-MME Short, whereas the development experiment in Appendix D reports 76.89% accuracy and 472.52 ms TTFT. Although the paper acknowledges differences in execution paths and budgets, it does not adequately map these differences to the reported results. Moreover, the paper states that baseline budgets, dates, and evaluation sets may differ while still making strong cross-method comparisons. The reported evidence is therefore insufficient to fully verify the central efficiency claims.
-
Insufficient validation of the technical contribution and an internal inconsistency. The component ablations are concentrated on Qwen3-VL-8B and Video-MME Short, leaving the independent contribution over existing compression methods insufficiently established. The adaptation of the DeepStack-oriented design to InternVL3.5 and LLaVA-OneVision is also unclear. Furthermore, the AI-use statement refers to a frame-wise score-calibration property and its proof, but I could not locate a corresponding explicit result in the main text or appendices. This discrepancy requires clarification.
Questions for authors
-
What exactly is the frame-wise score-calibration property mentioned in the AI-use statement, and where are its formal definition and proof?
-
What explains the differences in accuracy and TTFT between Table 1 and Appendix D? Please specify the evaluation subset, subtitle setting, execution backend, and timing protocol.
-
Were all baselines evaluated with consistent model versions, input sampling, resolution, evaluation sets, and timing conventions? What specific differences are covered by the table notes?
-
How is ContextTom implemented for InternVL3.5 and LLaVA-OneVision? Which components depend on Qwen3-VL-specific DeepStack behavior, and how is cross-backbone comparability maintained?
-
Can the authors provide controlled comparisons under matched budgets and execution paths to isolate the contribution of each component? What are the method's limitations under rapid motion, occlusion, and abrupt scene changes?