- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes RecastPrune, a training-free visual token compression method for vision-language models (VLMs). The method combines query-aware relevance calibration, coverage-aware token selection, restricted local exchange, and saliency-aware selective absorption to preserve task-relevant visual information under a fixed token budget. Experiments on three VLMs across a range of benchmarks show that RecastPrune achieves competitive performance under different token budgets.
Critical strengths
- The paper studies training-free visual token compression, an important direction for reducing the computational cost of VLM inference.
- The method is evaluated on multiple VLMs, token budgets, and diverse benchmarks. The paper also reports compression overhead in addition to downstream task performance.
Critical weaknesses
- Limited methodological novelty. The proposed method appears to combine and extend existing ideas, including query-aware token relevance, set-coverage-based selection, local token swapping, and token merging. The methodological advances over existing approaches, particularly SCOPE, are not sufficiently clear.
- Modest and inconsistent improvements over strong baselines. The reported performance gains of the proposed method are generally small. For example, on LLaVA-NeXT, RecastPrune improves average retention over SCOPE by only 0.2–0.4 percentage points, while on Qwen2-VL it does not consistently outperform.
- Insufficient evidence for the individual contributions of the proposed components. In Table 5, query-aware calibration improves NES from 0.1667 to 0.1800, whereas adding Restricted Local Exchange slightly reduces both OCRBench score and NES. After incorporating SASA, the full method achieves the highest OCRBench score, but NES decreases. The results do not clearly substantiate the claimed benefits of each component, particularly the effectiveness of Exchange and SASA.
Questions for authors
- The ablation experiments are conducted only on OCRBench with 64 visual tokens. Could the authors provide ablation results on more benchmarks and token budgets to demonstrate the robustness and generality of the proposed components?
- The proposed method achieves only modest performance gains over existing baselines while introducing additional compression overhead. How do the authors justify this trade-off, and under what circumstances does the proposed method provide sufficient benefits to outweigh the additional overhead?