- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes mDINO, a self-supervised pretraining framework for medical imaging that follows a sequential 2D-to-3D training strategy. The model first learns from 113 million CT slices, then transfers its Transformer parameters to a 3D model for continued pretraining on 1.13 million CT volumes. To accommodate volumetric data, the authors adopt Hilbert ordering so that consecutive tokens correspond to spatially adjacent patches, together with 3D positional encoding that shares frequency settings across the three spatial axes. Experiments cover various 2D and 3D segmentation tasks, CT classification, and report generation, with analyses of initialization, token ordering, positional encoding, and backbone architecture.
Critical strengths
-
The broad downstream evaluation provides useful evidence of transferability. The experiments cover different organs, imaging modalities, and tasks. Although pretrained exclusively on CT, the model also achieves good results after downstream fine-tuning on ultrasound, dermoscopy, and MRI segmentation. In Table 2, the average DSC across five datasets is 89.43%, compared with 88.56% for VoCo-SSL, with more substantial improvements on several MSD tumor segmentation tasks. These results constitute a valuable empirical contribution.
-
This paper proposes mDINO, a self-supervised pretraining framework for medical imaging that follows a sequential 2D-to-3D training strategy. The model first learns from 113 million CT slices, then transfers its Transformer parameters to a 3D model for continued pretraining on 1.13 million CT volumes. To accommodate volumetric data, the authors adopt Hilbert ordering so that consecutive tokens correspond to spatially adjacent patches, together with 3D positional encoding that shares frequency settings across the three spatial axes. Experiments cover various 2D and 3D segmentation tasks, CT classification, and report generation, with analyses of initialization, token ordering, positional encoding, and backbone architecture.The paper provides reasonably thorough analyses of its main design choices. Table 6 examines 2D pretraining initialization, different token orderings, positional encodings, and backbone architectures. Given the substantially larger pretraining dataset used by mDINO, the inclusion of a VoCo control using the same data and ViT-S backbone is particularly useful. These ablations help explain the contributions of individual components, although the initialization settings still require clarification.
Critical weaknesses
-
Limited methodological novelty The methodological advance remains unclear. 3DINO and TAP-CT already perform native 3D self-distillation, while SPECTRE uses DINOv3 with shared-frequency 3D RoPE. These directly relevant methods are neither discussed nor compared. The additional value of sequential 2D-to-3D training and Hilbert ordering is therefore insufficiently established.
-
Unclear benefit from the larger pre-training scale mDINO uses roughly seven times as many pre-training volumes as VoCo, yet Table 2 reports only a 0.87-point average DSC gain. Its smaller backbone is a strength, but data and compute efficiency remain unclear. The data-matched ablation covers only one epoch on BTCV. Results across data subsets and fine-tuning seeds would help establish the value of this larger-scale training.
-
Incomplete comparison with recent pre-training methods The VoCo comparison needs clarification. Table 2 reports 89.45 DSC on AMOS, while the extended VoCo paper reports 90.86 for Swin-B. The authors should explain checkpoint and supervision differences, particularly self-supervised versus omni-supervised training. Other relevant SSL baselines, such as MiM, are also missing.
Questions for authors
-
What are mDINO’s main methodological and performance advantages over 3DINO, TAP-CT, and SPECTRE?
-
The main text specifies five training epochs per stage, while Table 9 lists ten warm-up epochs and the initialization ablation in Table 6 uses only one epoch. Could the authors clarify the training schedules? Does the benefit of 2D initialization persist after the full five epochs of 3D pretraining, or mainly reflect faster early convergence?
-
In Table 2, mDINO uses substantially more pretraining data than VoCo but improves average DSC by only 0.87 percentage points. How do the authors interpret this modest gain? Does it exceed variability across fine-tuning random seeds?
-
Which VoCo checkpoints and supervision settings were used, and why do the results differ from the extended paper?
-
Beyond the BLEU gains in Table 5, do the generated reports improve in clinical accuracy or completeness?