- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes an on-policy self distillation method for continue learning of medical MLLMs, MedKgSD. It uses biomedical knowledge graphs to construct privileged knowledge, and performs OPSD based on this knowledge. An entropy-based criterion is proposed to select tokens for OPSD training. Experiments on two models show that MedKgSD improves the adaptation-retention trade-off over the baselines.
Critical strengths
- MedKgSD is a reward-free and external-teacher-free framework, which saves costs compared to RL-based methods. And self-distillation is easy to expand to other tasks.
- Using structured knowledge graphs as the knowledge source makes sense.
- The presentation is fair and easy to follow
Critical weaknesses
- Limited improvement: The performance improvement of MedKgSD is not sufficient, especially on the MedVLThinker model. And all the baselines reduce performance, why? Are they suitable for the setting?
- Two important baselines are missing: GRPO and standard OPSD. The method is based on OPSD, so standard OPSD should be included as a baseline.
- The training and evaluation settings are not convincing. The max token is 4096, which limits the model's capabilities. For example, the QoQ model is trained under 8k token budget. Also, evaluation uses greedy decoding, which limits the model's reasoning.
- Both QoQ-Med-7B and MedVLThinker-3B are based on Qwen2.5-VL, is it possible to provide more results on newer, stronger models, or models from other families?
Questions for authors
- The paper 'Qoq-med: Building multimodal clinical foundation models with domain-aware grpo training' is published on Neurips 2025. Why is the reference Neurips 2026?