- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes ReCo, a training-free visual token pruning method for LVLMs. Its motivation is that the multimodal projector reshapes how visual tokens relate to one another: about a quarter of each token's nearest neighbors change after projection. ReCo therefore measures token similarity in three ways (before the projector, after the projector, and how each token's relations change across the projector), combines them into a single similarity matrix, and greedily selects the subset of tokens that best "covers" all the others. Experiments on LLaVA-1.5-7B, LLaVA-NeXT-7B and Qwen2.5-VL-7B show that ReCo retains 95.48% of full-model performance on LLaVA-1.5-7B with 64 tokens (88.9% pruned), 96.00% on LLaVA-NeXT-7B with 320 tokens (88.9% pruned), and 91.02% on Qwen2.5-VL-7B with 10% of tokens.
Critical strengths
Simple and cheap to deploy. On LLaVA-1.5, its pruning stage takes about 10–24 ms, far less than ZOO-Prune (about 73–88 ms), giving lower time-to-first-token than the compared methods.
Ablation of the selection objective. With the similarity matrix fixed, the coverage-based selection beats both independent Top-K ranking and k-center selection at every budget and on every dataset (Table 8), showing that the selection objective itself contributes.
Critical weaknesses
Gains on LLaVA are within noise, and the new "relation change" component contributes little. On LLaVA-1.5, ReCo beats ZOO-Prune by only 0.06–0.28 points (Table 1); on LLaVA-NeXT it is worse than ZOO-Prune at 320 and 160 tokens (Table 2).
Gains on Qwen relies on a insufficient baseline. Strong diversity baselines are missing on Qwen.
Questions for authors
Significance on LLaVA. Please report mean ± std or paired bootstrap confidence intervals against ZOO-Prune on LLaVA-1.5 and LLaVA-NeXT, to show whether the 0.06–0.28 point gains exceed noise.
ZOO-Prune on Qwen. Why does its TextVQA collapse to 32–46? Also add DivPrune and VisionZip on Qwen2.5-VL under the same pipeline.