- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MedScissor, a visual token compression framework for medical VLMs. This method is based on the local structural changes and global visual deviation of medical images. It combines semantic similarity and neighborhood consistency to progressively group redundant tokens, and then selects the original representative token according to the degree of local centrality and global deviation to retain representative and complementary visual information. Experiments on 2D and 3D medical imaging benchmarks show that MedScissor can reduce the visual token by 50-70% while retaining about 99% of the original performance and reducing reasoning overhead.
Critical strengths
-
Sufficient comparative and ablation experiments has conducted in this paper, which show the performance of the proposed method in different scenarios and verifies the actual role of the modules.
-
The methods proposed by this paper utilized the token similarity without additional attention score calculations, which are different with most previous medical VLM token pruning methods.
-
The pipeline illustrated in Figure 2 is clearly to show how the methods work in a vision language model, and the algorithm section further describes the details of the methods.
Critical weaknesses
-
The score of the token has a mathematical meaning, but it seems that it cannot be directly derived that the key medical information is retained. Normal anatomical boundaries, artifacts or other non-target areas may also have a high deviation score.
-
The paper only provides a visualization result, and it is suggested that the author provide more comparisons of visualization results under different scenarios/different problems/modalities to further confirm the reliability of the proposed method in practical application.
-
The discussion of related works on medical VLM and token pruning/compress omits some relevant studies, including them would make the paper more comprehensive: SeVeR[1], Photon[2]. In addition, the Introduction section uses too much boldness, which reduces the readability to a certain extent.
[1] SeVeR: Selective Visual Exposure and Retrieval for 3D Medical Image Question Answering [2] Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Models
Questions for authors
-
Is the method proposed in the article still effective for lesions with a large range, diffuse changes, low contrast or uniform internal texture?
-
It seems that the experimental results of this method under different settings do not have consistent advantages compared with other methods. Can the author further analyze the attribution?
If the authors addressed my concerns in weaknesses and questions, I will be happy to improve my rating. I will be active in the discussion period.
7 comments
Sincere reply to reviewer HrFK (part2/2)
Q3: Related Work on SeVeR and Photon (Weakness 3)
A3: We appreciate the reviewer's recommendation to consider SeVeR [1] and Photon [2]. We agree that both studies are closely related to our work. The full implementations of both methods involve additional training. In particular, we have not identified a publicly available official implementation of SeVeR, making reliable reproduction under identical settings difficult.
For the publicly released Photon model, we consider adapting MedScissor to the trained Photon-S2 checkpoint by disabling the original ITS compression mechanism during inference and applying MedScissor for training-free visual token compression. The following table summarizes the reference comparison.
Table R1. Comparison on 3D Medical Imaging Benchmarks.
| Method | M3D-VQA | 3D-RAD |
|---|---|---|
| Photon-S2 (w/o Compression) | 79.4 (0%) | 72.7 (0%) |
| Photon-S2 (ITS) | 81.2 (89.1%) | 74.6 (94.4%) |
| Photon-S2 + MedScissor | 77.8 (90%) | 72.3 (90%) |
Values in parentheses indicate visual token compression ratios. These are provisional reference values and have not yet been validated as results from a controlled evaluation under identical settings.
The reference comparison suggests that the jointly trained Photon compression mechanism can achieve higher task performance, while MedScissor offers distinct advantages of its own. Specifically, MedScissor requires no additional training and can be directly integrated into different pretrained models, reducing adaptation and deployment costs. Furthermore, while Photon primarily targets 3D medical volumes, MedScissor supports both 2D and 3D medical imaging, offering broader applicability, as demonstrated across six 2D and two 3D benchmarks.
We will cite and discuss SeVeR and Photon in the camera-ready version and reduce unnecessary bold formatting in the Introduction to improve readability.
Reference
[1] SeVeR: Selective Visual Exposure and Retrieval for 3D Medical Image Question Answering.
[2] Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Models.
Q4: Performance Variations Across Experimental Settings (Question 2)
A4: Thank you for raising this point. We acknowledge that MedScissor does not achieve the best result on every individual dataset and compression ratio. This may be attributed to differences in imaging modalities, visual structures, and image characteristics across medical datasets, which can affect how different compression strategies perform.
Importantly, our evaluation covers eight medical imaging benchmarks, including six 2D and two 3D datasets, representing diverse medical imaging types and visual understanding tasks. Despite minor variations in individual settings, MedScissor achieves the highest average performance across all three compression ratios on the 2D benchmarks and remains best-performing or highly competitive on the 3D benchmarks.
These consistent aggregate results demonstrate the effectiveness and generalizability of MedScissor across diverse medical imaging scenarios, rather than relying on a single dataset or task. We will further discuss these dataset-dependent performance variations in the camera-ready version.
Sincere reply to reviewer HrFK
Dear Reviewer HrFK,
Thank you again for your valuable comments and suggestions. Following your recommendations, we have completed the additional experiments and analyses (Q1–Q4) and provided detailed clarifications to address your concerns.
As you mentioned in your original review that addressing these issues would lead to a higher evaluation, we hope that our additional results and responses have sufficiently resolved your concerns. We would greatly appreciate it if you could take these improvements into consideration in your final assessment.
Thank you very much for your time and consideration.
Best regards, Authors
Sincere reply to reviewer HrFK (part1/2)
Dear Reviewer HrFK,
Thank you for your careful review and valuable constructive feedback. We have consolidated your three weaknesses and two questions into the following four issues and address them individually. We also commit to incorporating the relevant experimental results, implementation details, and clarifications into the camera-ready version.
Q1: Relationship Between Token Scoring and the Preservation of Critical Medical Information (Weakness 1, Question 1)
A1: Thank you for this important observation. We agree that global deviation scores do not directly correspond to lesion importance, as normal anatomical boundaries and imaging artifacts may also receive high scores. Importantly, MedScissor does not rely on a single score to identify lesions. Instead, it combines local semantic redundancy reduction with global information complementarity to preserve representative visual tokens.
Specifically, MedScissor first groups redundant tokens based on semantic similarity and neighborhood consistency, and then selects representative tokens by jointly considering within-group centrality and global deviation, balancing dominant semantic information and distinctive visual features. For large, diffuse, low-contrast, or internally homogeneous lesions, information preservation depends on the distinguishability of their visual features rather than lesion morphology alone.
Our experiments across six 2D and two 3D medical imaging benchmarks further support the effectiveness of this strategy at the downstream-task level. In particular, MedScissor achieves the best or highly competitive average performance across different compression ratios while maintaining high performance retention relative to the uncompressed models. These results provide indirect evidence that our method can effectively preserve task-relevant medical visual information despite substantial visual token reduction. Nevertheless, this does not constitute a strict guarantee that every lesion detail is fully preserved. We will further clarify this distinction in the camera-ready version.
Q2: Sufficiency of Visualization Experiments (Weakness 2)
A2: Thank you for this suggestion. Although the current manuscript provides limited visualization examples, our experiments cover six 2D and two 3D medical imaging benchmarks, spanning diverse imaging scenarios and medical visual question-answering tasks. These extensive quantitative evaluations provide evidence of the method's effectiveness.
We agree that additional visualizations would offer a more intuitive understanding of token preservation. Therefore, we will include further visualization comparisons across different imaging modalities, task scenarios, and compression ratios, alongside representative compression baselines, to better illustrate the practical behavior and reliability of MedScissor.