- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies a training-free visual-token compression before LLM prefill. PreViC selects temporally novel anchor frames, reconstructs each non-anchor token using local ridge regression, and retains tokens with large residuals alongside an anchor allocation. Across three VLMs, e.g., Qwen2.5,PreViC showed better accuracy with faster efficiency, along with some interesting evidence that this helps multi-question QA better.
Critical strengths
- Useful training-free temporal compression, likely useful for readers who want to try it out
- Experiments on multiple VLMs and several benchmarks suggest better performance and efficiency
- Careful paired accuracy analysis, sensitivity tests, and separate prefill and TTFT measurements show the wide usability of the method.
Critical weaknesses
-
How generalizable are the hyperparameters and the method? A common issue with training-free methods (and this paper is no exception) is that they use varied hyperparameters. This suggests that there is room for hyperparameter tuning to get better performance on different benchmarks. I appreciate the authors discuss the sensitivity of hyperparameters in Table 15, but I am wondering whether we need different sets of hyperparameters on different benchmarks?
-
Given that this is a training-free method, I highly encourage the authors to try this on more recent VLMs, which are believed to have better training on long videos, e.g., Qwen3, Gemma.
-
The three parts of the methods (R1, R2, R3) seemingly form a heuristic pipeline of selecting tokens, but the mehanisms are still fragmented, e.g., some parts are based on novelty, some parts are based on the heuristic of hierarchical allocations, etc. These further weakens the generalization of the methods and how other people in the community would like to practice the methods. I recommend the authors better clarify how the R1, R2, R3 could be combined. I would also encourage the authors to explore a very lightweight learnable way to combine the three parts, if possible. But this is not required if the authors have limited rebuttal time.
Questions for authors
See above
Response to Authors
Thanks for the authors’ clarifications and additional experiments. The controlled comparisons help clarify the relationship to ApET, although the main source of improvement remains insufficiently. The largest gain still combines several changes, and some skills show relatively small improvements. My concern about the clarity of the novel contribution therefore remains. W2 and W3 are also only partially addressed.
Nevertheless, this work has relatively comprehensive evaluation, competitive empirical performance, and practical value of a training-free, prompt-agnostic compression method. Overall, I consider the paper borderline, with a slight lean toward acceptance.