- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes ClinKD for fine-grained medical visual question answering. It introduces Modality-aware Cross-modal Gap Rotary Position Embedding (MCG-RoPE) to distinguish image-text boundaries and confidence-margin curriculum distillation to reduce unreliable teacher supervision. Experiments on Med-GRIT and external medical VQA datasets demonstrate improvements over existing baselines.
Critical strengths
-
Interesting combination of modality-aware encoding and distillation. The paper combines a lightweight modification to positional encoding with confidence-guided knowledge distillation. Both components address relevant challenges in fine-grained medical image understanding.
-
Encouraging multi-task experimental results. ClinKD achieves substantial improvements across four Med-GRIT tasks and eight medical imaging modalities. Additional evaluations on external medical VQA datasets suggest potential generalization benefits.
Critical weaknesses
-
Lack of fair and architecture-matched comparisons. The main performance improvements are reported against BiRD, which uses a different backbone. Although a Qwen2-VL SFT baseline is provided, the comparisons do not adequately control for backbone and training differences.
-
Insufficient ablation and reproducibility. The experiments do not fully isolate the contributions of MCG-RoPE, curriculum distillation, reflective correction, and semantic reranking. Furthermore, key implementation details, including the teacher checkpoint and several training configurations, are missing.
Questions for authors
-
Can the authors provide architecture-matched comparisons using identical backbones, training data, and computational budgets?
-
Can the authors provide a complete ablation separating MCG-RoPE, curriculum distillation, reflective correction, and semantic reranking?
-
How sensitive is MCG-RoPE to the boundary gap size, given that only (g=2) is evaluated?
-
Can the authors provide the teacher checkpoint and evaluate confidence weighting, margin weighting, and curriculum scheduling separately against standard knowledge distillation?
-
Can you enlarge the font size of the text in your figures?