- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
MedSkill derives five visual skill families from clinical standards, uses Qwen3.8-Max to convert medical captions into 18,888 skill QA instances, and trains Qwen3-VL-8B through a five-stage pipeline, reporting gains on VQA-RAD, SLAKE, and PathVQA along with higher judge-scored skill ratings.
Critical strengths
-
The representation study offers practical guidance: concise, operation-focused skill QA transfers to VQA more effectively than raw captions, which degrade performance relative to direct VQA fine-tuning.
-
The method introduces no additional inference cost: skills are learned during training, so the model answers directly from image and question without retrieval, tools, or prompts.
Critical weaknesses
-
In the Table 2 experiment, the training data, the judge model, and the reference answers all come from Qwen3.8-Max, which risks data overlap and evaluation bias. The reliability of the judge is never assessed.
-
In Table 1, no original Qwen3-VL baseline is included, LLaVA-Med lacks equivalent fine-tuning, and several baselines report incomplete results, rendering the comparison unfair.
-
The five-stage training pipeline lacks stage-wise ablations, and no single-stage joint-training baseline is provided to show that this complexity is necessary.
Questions for authors
-
In the Table 2 experiment, the training data, the judge model, and the reference answers of the evaluation set all originate from Qwen3.8-Max, which may introduce data overlap and evaluation bias. Can the results reliably reflect actual performance? I recommend that the authors conduct evaluation using alternative models. Additionally, how is the reliability of Qwen3.8-Max’s scoring assessed?
-
The comparison in Table 1 is unfair. The authors do not include results from the original Qwen3-VL, which would help clarify the actual contribution of MedSkill. Moreover, the authors further fine-tune on the training data of the three benchmarks (VQA-RAD, SLAKE, and PathVQA), whereas the compared model LLaVA-Med is evaluated without equivalent fine-tuning. In addition, results for several methods in Table 1 are incomplete. These issues undermine the fairness of the comparison between MedSkill and existing methods.
-
The authors introduce a complex five-stage training pipeline. Has the contribution of each stage been sufficiently validated? If the external data, the target VQA data, and the skill corpus data were combined for single-stage joint training, could comparable or superior results be achieved?