- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
In this work, the authors focus on PEFT methods for medical image classification. They propose ScopeMix and TelescopeMix, which use convolution-based adapters. The utility of these methods is demonstrated primarily on the HAM10000 dataset, while eight additional medical datasets are used to compare TelescopeMix with full fine-tuning in an ablation study.
Critical strengths
The authors focus on an important and highly relevant problem with direct implications for medical AI practitioners. Overall, the paper is clear, well-structured, and easy to read.
Critical weaknesses
Below I list my main concerns:
-
Limited novelty: The proposed methods appear to offer only incremental improvements over existing approaches, which may not be sufficient to meet the novelty threshold for an ICLR publication.
-
Narrow scope of related work: The related-work section focuses primarily on convolution-based PEFT methods, which represent only a relatively small subset of the broader PEFT literature. The discussion should be expanded to include a wider range of relevant approaches.
-
Insufficient comparison with relevant baselines: Comparisons with relevant SOTA, such as [1], are missing. In particular, [2] appears to follow a similar underlying philosophy and should be included. More critically, these comparisons are conducted only on HAM10000, limiting the strength and generalizability of the conclusions.
-
Limited task scope: The evaluation focuses exclusively on classification tasks.
-
Limited evidence for the telescoping component: In Tables 3 and 4, the performance differences between the telescoping and non-telescoping variants are consistently small across all model variants. This raises questions about the practical contribution of the telescoping component.
-
Incomplete efficiency analysis: Parameter efficiency alone does not fully characterize computational efficiency. The authors should also report metrics such as memory footprint, training time, and inference wall-clock time to provide a more comprehensive assessment of the proposed methods.
References
[1] Chen, S., Ge, C., Tong, Z., Wang, J., Song, Y., Wang, J., & Luo, P. (2022). Adaptformer: Adapting vision transformers for scalable visual recognition. Advances in neural information processing systems, 35, 16664-16678.
[2] Mishra, U., Shukla, V., Hambarde, P., & Shukla, A. (2026, March). Improvise, Adapt, Overcome—Telescopic Adapters for Efficient Fine-tuning of Vision Language Models in Medical Imaging. In 2026 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) (pp. 7605-7615). IEEE.
Questions for authors
In Table 2, although ScopeMix outperforms full fine tuning on three metrics by approximately 1-1.5% at best, it also shows a substantial 4% decrease in macro-precision and a smaller decline of more than 1% in macro F1. What might explain this variability across the evaluation metrics?