- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes MedR2R, a training-free visual-token compression framework for medical MLLMs. It first constructs an encoder-side candidate pool using global relevance and marginal feature-coverage gain. After an intermediate LLM layer, it retains a compact reference basis and candidates with large normalized reconstruction residuals, then consolidates discarded candidates into retained representatives. Experiments cover five medical VQA benchmarks and three backbones. In addition to task quality and measured latency, the paper evaluates instance-level output changes and correct-to-incorrect regressions, with the main stability results reported for LLaVA-Med.
Critical strengths
1、The two-stage design is coherent and supported by substantial analysis. The paper includes component ablations, candidate-budget sensitivity, consolidation ablations, and controlled token-removal experiments, making the roles of the proposed components reasonably clear.
2、The reported stability improvements are promising. At 128 final tokens, MedR2R reduces average DR/NDR from 23.00/2.36 for MMTok to 13.57/1.20 across five benchmarks on LLaVA-Med, while achieving a measured 1.54× speedup over the full-token model. Task-quality evaluations on additional backbones provide useful evidence of broader applicability.
Critical weaknesses
1、The methodological novelty is insufficiently distinguished from closely related work. ResPrune already uses residual-guided token selection, while LRCP combines residual-based selection, token merging, and compression at both encoder and intermediate LLM stages. Although MedR2R differs in candidate construction and basis selection, the substantive advance over these closely related approaches remains unclear.
2、The specific benefit of residual selection remains unclear. In Appendix C.3, low-residual deletion and feature-norm-based deletion yield the same quality-decrease rate of 2.00%. Although the complete pipeline performs well, this comparison does not establish what additional benefit residual selection provides over the simpler alternative.
Questions for authors
1、What is the substantive methodological advance over LRCP and ResPrune?
2、With other steps fixed, what advantage does residual selection offer over attention, feature-norm, or diversity-based selection?
3、How were the layer, basis size, and expansion factor chosen? Was test-set performance used?
4、Why is DR/NDR reported only for LLaVA-Med, despite evaluating MedVLM-R1 and Qwen3-VL elsewhere?
11 comments
1. For Weakness 1 and Question 1
Methodological Differences and Additional Comparisons
We thank the reviewer for this important comment. Our substantive advance lies in decoupling representative candidate recall from final evidence retention, rather than introducing another residual metric.
ResPrune [1] greedily expands a text-conditioned reconstruction subspace, while LRCP [2] relies on PCA-based projection residuals for token selection. In contrast, MedR2R separates two complementary objectives:
(1) Representative candidate recall. Under a relaxed budget , we employ the saliency-weighted marginal representation gain (Eq. 3):
This criterion constructs a broadly representative candidate pool by jointly considering global relevance and marginal representation gain, mitigating the premature exclusion of underrepresented visual evidence.
(2) Contextualized evidence retention. After LLM contextualization, we measure normalized reconstruction residuals (Eq. 7):
\qquad \hat{H}=W^*D.$$ We retain the basis $A$ and the $k-r$ non-basis tokens with the largest residuals (Eq. 8), which optimally minimizes the fixed-dictionary reconstruction-error surrogate (Appendix F.2): $$J(R)=\sum_{i\notin R}e_i, \qquad A\subseteq R,\quad |R|=k.$$ The key methodological advance is assigning representative coverage and contextualized reconstructability distinct, complementary roles across representation levels. **(3) Controlled comparison with LRCP and ResPrune.** To further substantiate the methodological differences and practical advantages of MedR2R, we add controlled comparisons with LRCP and ResPrune across three backbone models. Since publicly available official implementations of these two methods were unavailable at the time of our experiments, we independently reimplemented both methods based on the algorithms described in their respective papers. All methods were evaluated using matched backbone models, datasets, preprocessing pipelines, decoding settings, and final visual-token budgets to ensure a fair comparison. **LLaVA-Med v1.5** | Tokens | Method | SLAKE | VQA-RAD | VQA-Med | PathVQA | PMC-VQA | |---:|---|---:|---:|---:|---:|---:| | 128 | LRCP | 38.94 / 14.68 / 4.70 | 51.84 / 27.50 / 10.68 | 43.75 / 14.14 / 4.63 | 57.51 / 5.64 / 1.90 | 24.50 | | 128 | ResPrune | 37.98 / 14.84 / 4.69 | 50.37 / 27.14 / 10.25 | 43.75 / 13.47 / 4.51 | 58.10 / 5.98 / 1.89 | 26.80 | | 128 | **MedR2R (Ours)** | **40.87 / 15.93 / 5.10** | **54.78 / 29.48 / 11.34** | **56.25 / 15.14 / 4.93** | **59.72 / 7.42 / 2.09** | **29.15** | **MedVLM-R1** | Tokens | Method | SLAKE | VQA-RAD | VQA-Med | PathVQA | PMC-VQA | |---:|---|---:|---:|---:|---:|---:| | 128 | LRCP | 49.04 / 14.88 / 14.95 | 56.25 / 18.96 / 19.92 | 51.56 / 18.46 / 18.89 | 53.38 / 3.27 / 3.40 | 43.20 | | 128 | ResPrune | 47.84 / 14.95 / 15.11 | 55.15 / 19.77 / 21.00 | 50.00 / 19.49 / 20.12 | 53.38 / 3.43 / 3.57 | 40.85 | | 128 | **MedR2R (Ours)** | **52.88 / 16.22 / 16.61** | **63.24 / 21.91 / 22.76** | **62.50 / 21.15 / 21.72** | **56.27 / 4.44 / 4.64** | **45.45** | **Qwen3-VL-8B-Instruct** | Tokens | Method | SLAKE | VQA-RAD | VQA-Med | PathVQA | PMC-VQA | |---:|---|---:|---:|---:|---:|---:| | 128 | LRCP | 53.61 / 11.61 / 11.76 | 66.91 / 28.14 / 29.44 | 65.62 / 25.97 / 26.56 | 59.75 / 5.01 / 5.12 | 50.40 | | 128 | ResPrune | 53.85 / 11.89 / 12.05 | 65.07 / 29.13 / 30.90 | 65.62 / 25.73 / 26.15 | 59.36 / 5.05 / 5.24 | 50.95 | | 128 | **MedR2R (Ours)** | **57.45 / 13.36 / 13.27** | **72.06 / 31.62 / 33.28** | **79.69 / 28.29 / 29.01** | **63.96 / 5.53 / 5.73** | **54.95** | For all three backbones, the reported metrics are ordered as Accuracy / Recall / ROUGE-1, while PMC-VQA reports Accuracy only. Overall, the results show that MedR2R consistently outperforms both reimplemented baselines across all five medical VQA benchmarks and all three evaluated backbones at the same 128-token budget. These findings provide empirical evidence that combining saliency-weighted representative candidate construction with contextualized residual-based evidence retention offers practical advantages over existing residual-guided compression approaches. **References** [1] Li X, Zheng Y, Liang Y, et al. ResPrune: Text-Conditioned Subspace Reconstruction for Visual Token Pruning in Large Vision-Language Models[J]. arXiv preprint arXiv:2603.21105, 2026. [2] Lu H, Zhang F, Jin W, et al. LRCP: Low-Rank Compressibility Guided Visual Token Pruning for Efficient LVLMs[J]. arXiv preprint arXiv:2605.15621, 2026.2. For Weakness 2 and Question 2
Controlled Residual Selection Ablation
We thank the reviewer for this important suggestion. We agree that the comparison in Appendix C.3 alone does not fully establish the practical advantage of residual-based selection over simpler alternatives. To address this concern, we conducted an additional controlled residual ablation on the SLAKE test set, isolating the second-stage selection criterion while keeping all other components identical.
Specifically, we fix the same 256-token candidate pool, contextualized features after layer 16, 10 basis tokens, feature-consolidation rule, and final budget of 128. Only the selection criterion for the remaining 118 non-basis tokens is varied. We compare Encoder Attention, contextualized Feature Norm, Random selection, and MedR2R's normalized residual selection.
Controlled Residual Ablation on SLAKE
| Stage-2 Selection Criterion | ROI Token Retention Rate ↑ | Accuracy ↑ | Recall ↑ | ROUGE-1 ↑ | DR ↓ | NDR ↓ |
|---|---|---|---|---|---|---|
| Encoder Attention | 43.31 | 40.38 | 15.48 | 4.89 | 16.40 | 1.51 |
| Random | 22.13 | 38.94 | 14.46 | 4.45 | 21.30 | 2.26 |
| Feature Norm | 41.01 | 39.90 | 15.12 | 4.73 | 17.62 | 1.70 |
| Residual (MedR2R) | 46.84 | 40.87 | 15.93 | 5.10 | 12.16 | 1.13 |
The results demonstrate that residual-based selection achieves the best performance across all six evaluation metrics. Compared with Feature Norm, residual selection improves ROI token retention from 41.01% to 46.84% (+5.83 percentage points), while reducing DR from 17.62% to 12.16% and NDR from 1.70% to 1.13%.
Because all methods use the same candidate pool and downstream processing, the improvements directly reflect the second-stage selection criterion. Unlike feature norm, which only measures feature magnitude, residual selection identifies tokens that are poorly reconstructed by the shared basis. These results demonstrate its advantage in preserving medical regions and improving prediction stability.
Summarize
We sincerely thank the reviewer for the thoughtful comments and positive evaluation. We greatly appreciate your recognition of MedR2R's two-stage design as "well-motivated" and its stability improvements as "encouraging." We are also grateful for your acknowledgment of the comprehensive component analyses and the importance of evaluating instance-level prediction stability in medical MLLMs.
Your constructive feedback has helped us further clarify the methodological contributions of MedR2R and strengthen the supporting experimental evidence. We have carefully addressed each comment point by point and will incorporate the corresponding clarifications, additional analyses, and experimental results into the revised manuscript. We hope these revisions adequately address your concerns.