- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes ReConV, a reconstruction-guided framework for visual token compression. A learnable Summary Bank aggregates visual features through cross-attention, and a position-conditioned decoder reconstructs individual token features from their assigned summary slots. Orthogonal reconstruction residuals determine which original or residual tokens are retained alongside the summary tokens. The model is trained with task and contrastive reconstruction objectives. Experiments cover ImageNet classification and LLaVA-based multimodal understanding, including multi-turn evaluation, token-budget ablations, and latency measurements.
Critical strengths
-
Coherent combination of summaries and explicit details. The framework combines a compact summary representation with tokens carrying information that is poorly explained by that representation. Its prompt-independent compression allows the same image representation to be reused across questions, making the design relevant to repeated-query and multi-turn applications.
-
Evidence of practical feasibility across tasks. The experiments include both image classification and multimodal understanding, together with component and token-budget ablations. The reported results suggest that the framework can substantially reduce computation while preserving a useful fraction of the original model’s capability.
Critical weaknesses
-
The novelty relative to closely related reconstruction-guided compression is insufficiently established. ApET: Approximation-Error Guided Token Compression for Efficient VLMs (CVPR 2026) already reconstructs visual tokens from a small basis and uses approximation errors to retain poorly explained tokens. Its scores are conditioned on the selected basis, which also weakens the manuscript’s broad distinction between existing independent scoring and its own summary-conditioned selection. ReConV introduces architectural differences, including a learned Summary Bank, a position-conditioned decoder, and residual representations. However, the paper does not discuss this close prior work or establish the additional capability or benefit of these changes over the existing reconstruction-guided principle. The current component ablations provide partial support but do not isolate this incremental contribution relative to a linear reconstruction baseline.
-
The experimental comparisons do not sufficiently isolate the benefits of the proposed compression design. Table 2 uses 79.8% as the uncompressed ImageNet baseline, whereas Table 5 reports 80.61% for the authors’ locally trained vanilla model. Appendix B.1 also specifies 300 training epochs for vanilla models and 500 for compressed models, while the main compressed models use distillation. These differences complicate the claim of matching or exceeding uncompressed accuracy with 48% fewer GMACs. In the multimodal experiments, comparable training and adaptation conditions across methods are not clearly established. Table 7 additionally reports dev-set results for ReConV on MMB/MMB-CN while giving different uncompressed baseline values in its caption and first row and incorporating literature results. Relative normalization does not by itself establish comparability across these settings. These issues limit attribution of the reported gains to the compression mechanism.
Questions for authors
-
What is the substantive contribution beyond reconstruction-error-guided compression as exemplified by ApET? Please explain what the learned summary bank, decoder, and residual representation add, and provide a controlled comparison or existing evidence that isolates this benefit at a fixed total token budget.
-
Which uncompressed ImageNet baseline corresponds to the models in Table 2: 79.8% or the locally trained 80.61% model? How do the different training durations and distillation settings affect the claim of matching or exceeding the baseline with 48% fewer GMACs?
-
For Tables 3 and 7, which methods use comparable model checkpoints, training data, and adaptation budgets? Please clarify the evaluation splits and corresponding uncompressed baselines for MMB/MMB-CN, and explain whether the conclusions hold when these conditions are aligned.
-
The comparisons provide limited coverage of recent state-of-the-art visual token compression methods, particularly learned compression approaches.