- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces InfiMed2, a family of 4B and 27B generalist medical multimodal foundation models developed through stage-aware design. The authors construct a 55.68B-token corpus from medical e-books, biomedical literature, web documents, and general multimodal data. The training pipeline combines vision-encoder adaptation, continued pretraining (CPT), and evidence-focused learning-rate decay. For post-training, the authors propose stability-aware response regeneration to improve answer-consistent explanatory supervision, followed by reinforcement learning with verifiable rewards (RLVR) for the 4B model. Experiments across five medical multimodal benchmarks demonstrate competitive performance against general-purpose and domain-specific models.
Critical strengths
- Comprehensive medical data curation and training pipeline
The paper presents a systematic approach to organizing heterogeneous medical evidence across different training stages. Its source-specific processing, context-rich multimodal data construction, and stage-dependent mixtures provide a practical framework for developing medical foundation models.
- Broad Evaluation with Informative Ablations
The paper evaluates InfiMed2 across five medical multimodal benchmarks with both 4B and 27B models, demonstrating competitive performance and improvements over their respective backbones. More importantly, the matched SFT baselines, CPT comparisons, and response-target ablations provide useful insights into the effects of different training stages. Although some improvements are modest, these evaluations offer empirical support for the overall training pipeline.
Critical weaknesses
- Minor Contribution Of CPT
Although the paper motivates stage-aware CPT and evidence-focused learning-rate decay, their individual contributions are not sufficiently isolated. Table 2 compares different CPT token budgets, but all CPT variants retain the same vision-adaptation and decay-stage design. Moreover, the improvements over SFT-only baselines are relatively modest. Without controlled comparisons against static data mixtures or alternative stage configurations, it remains unclear which aspects of the proposed training strategy account for these gains.
- Insufficient Stability Validation
The proposed stability-aware regeneration improves answer consistency, but its effectiveness in producing more faithful and informative medical explanations remains insufficiently validated. The reported 94.10% answer-reconstruction accuracy primarily measures answer recoverability rather than explanation correctness or visual grounding. Furthermore, Table 3 shows only a 0.58% average improvement over randomly generated responses, with mixed results across individual benchmarks. More direct evaluation of explanation quality would strengthen the justification for stability-aware supervision.
Questions for authors
- Concerns on Stage-Aware CPT
Table 2 examines different CPT token budgets, but the benefit of the proposed evidence-focused decay mixture remains unclear. Could the authors compare it with the original CPT mixture under the same training budget and learning-rate schedule?
- Insufficient Gain of Stability-Aware Supervision
Section 3.2.2 combines answer stability, correctness-constrained filtering, and entropy-based selection to construct training responses. Given the limited gains over random selection in Table 3, could the authors further isolate the contribution of stability-aware selection, for example, by comparing against randomly selected answer-correct responses under matched training conditions?