- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
MedVision-X adapts SenseNova-Vision to six medical imaging task families using a shared image-generation pathway. Segmentation masks are encoded as RGB images, while restoration, translation, staining, and editing produce image targets directly. Training consists of broad medical adaptation followed by balanced joint training on benchmark training folds. The paper reports results on 14 benchmarks, with particularly strong reported performance in CT restoration and cross-modal synthesis. Ten non-segmentation benchmarks use one checkpoint, while segmentation uses dataset-specific checkpoints or ensembles.
Critical strengths
Table 2 lists body HU MAE of 39.11 on LDCT projection and 55.2 on SynthRAD2023, both substantially below the strongest listed baselines at 99.0 and 83.11.
Critical weaknesses
- Section 6 states that the Stage-A data were not checked against the benchmark test splits. Earlier exposure to test data therefore remains possible. Table 2 also gives no evaluated sample counts. Appendix H does not show whether the updated scores were computed on the same cases across methods.
- The training recipe is not tested with controlled ablations. There is no direct comparison of broad medical adaptation, balanced joint training, and single-task adaptation from the same initialization. It is therefore unclear which part of the training strategy brings the gain. Restormer is also tested on LoDoPaB-CT with an out-of-domain checkpoint rather than a target-adapted model.
- MVG and UniMedVL are discussed as related medical generalists, but neither is evaluated. The advantage over existing medical generalist models is therefore unclear.
- The segmentation results use dataset-specific checkpoints or checkpoint ensembles. ISIC also uses test-time augmentation. The paper does not show that one checkpoint can reach the reported performance across all six task families.
Questions for authors
- Did any benchmark test images or patients appear in the Stage-A data? If no overlap audit was done, what evidence shows that Stage A did not expose the model to the test sets?
- How many test cases were evaluated for MedVision-X and each comparator in Table 2? Were all rankings computed on exactly the same cases?
- What results does the single Stage-B checkpoint achieve on the four segmentation datasets without checkpoint selection, ensembling, or test-time augmentation? Which claims in the paper are based on one checkpoint?
3 comments
Thank you for the detailed response. The new results help, but possible test-set overlap in Stage A and the lack of comparisons with other medical generalists still concern me. I am keeping my original score.
Response and Followup : the score in light of the full-cohort and single-checkpoint results
Dear Reviewer 665p,
Thank you for clarifying your remaining concerns. We agree that a complete audit of Stage A exposure and direct comparisons with MVG and UniMedVL would strengthen the evaluation. We respectfully ask you to reconsider the evaluaiton in light of the evidence addressing two other questions in your original review: whether the gains hold on the complete test cohorts and whether they require checkpoint selection or ensembling.
1. Stage A exposure and test-cohort coverage
We identified AAPM as exposed because its source includes test patient L333, and we excluded it from the 14 primary benchmarks. Stage A exposure remains unverified for those 14 benchmarks. For Stage B, we audited the training folds using exact pixel hashes and a calibrated near-duplicate detector. The audit identified three overlapping ISIC images among 379 test images, with a maximum effect of 0.008 on mean Dice (§4.4).
The stage-wise evaluation answers a separate empirical question. On all 36 SynthRAD subjects, body HU MAE fell from 276.5 after Stage A to 66.2 after Stage B, compared with 83.1 for the strongest evaluated baseline. On all 57 IXI subjects, PSNR rose from 15.74 to 22.99 dB, compared with 22.43 dB for the strongest evaluated baseline. Both Stage B results use the same fixed checkpoint and one generation per case, without ensembling or test-time augmentation (§§2, 4.1). These results establish that the gains hold on the complete frozen cohorts under a common inference protocol. Whether individual test patients appeared in Stage A remains an open provenance question.
2. What the baseline comparisons establish
The relative ranking of MedVision-X, MVG, and UniMedVL remains open. Our revised claim is narrower: one checkpoint with a shared decoder across six task families achieved better primary-endpoint values than the strongest evaluated baselines on SynthRAD and IXI under single-generation inference. We report results with benchmark-specific inference strategies separately. For those configurations, we corrected the overall lead count to 5 of 14 benchmarks and withdrew the LDCT superiority claim after identifying a stronger target-trained comparator (§1).
Given that the rebuttal directly answers the questions about cohort coverage and checkpoint selection, we ask you to reassess the evaluation. If either remaining limitation calls a specific revised conclusion into question, could you identify the benchmark and claim you consider unsupported? This would allow us to address the precise disagreement before the discussion closes.
Kind regards,
The Authors
Thank you for the review. Section numbers (§) refer to our General Response (Parts 1–3).
Correction of the headline numbers. Your strength cites 39.11 HU on LDCT projection against a 99.0 HU baseline. In re-auditing against the full result matrix we found complete baselines that the submitted tables omitted. On LDCT projection the strongest complete baseline is a target-trained text-guided unified model at 33.46 HU MAE (ours 39.11, bootstrap CI [24.2, 54.2] over 10 test patients), so that comparison is withdrawn. Against every complete baseline, MedVision-X leads on 5 of 14 benchmarks (SynthRAD2023 55.2 vs. 83.1 HU, IXI 25.58 vs. 22.43 dB, LoDoPaB-CT, MIST, BCI), and the revision limits claims of leading to those (§1).
Q1: did any test image appear in Stage A? The Stage-B training folds were audited image by image with exact pixel hashing and a calibrated near-duplicate detector: three ISIC test images are also listed in the training folder of the adopted split (0.79% of the split, effect ≤ 0.008 Dice), and four DRIVE validation eyes are in training while the test set is unaffected. Stage A draws on a large aggregate medical corpus that is not audited image by image. AAPM, whose source includes test patient L333, is marked as exposed and is not among the 14 main benchmarks, and the other benchmarks are described as not audited against Stage A. The stage-wise results bear on exposure: Stage A alone scores 0.358 / 0.658 / 0.088 / 0.011 Dice on ISIC / Kvasir / BUSI / DRIVE, 0.000 Edit Dice on ATLAS, 113.5 FID on BCI and 276.5 HU on SynthRAD, i.e. it does not reproduce test targets, whereas the final scores (0.881 / 0.775 / 0.774 / 0.772 Dice, 56.2 FID, 66.2 HU) arise after Stage B on the audited benchmark training folds (§4.1, §4.4).
Q2: test cases per method and matched cases. Every ranking uses the complete frozen test split, identical for every method and verified against the manifest digest. MedVision-X counts: ISIC 379, Kvasir 100, BUSI 78, DRIVE 20, BraTS-GLI 27, SynthRAD 36 subjects, IXI 57 subjects, AAPM 610, LoDoPaB 3,553, LDCT projection 2,461, fastMRI 8,852, SurgiSR4K 125, BraTS editing 363, ATLAS 21, MIST 4,000, BCI 977 (§2). The partial counts in Appendix H belonged to an earlier snapshot. 95% bootstrap CIs over patients/subjects: SynthRAD 55.2 [50.4, 60.6] HU, IXI 25.58 [25.15, 26.03] dB, Kvasir Dice 0.905 [0.869, 0.934], LDCT 39.1 [24.2, 54.2] HU.
Q3: single Stage-B checkpoint on the four segmentation datasets. The final Stage-B checkpoint, one generation, no checkpoint selection, ensembling or TTA, gives Dice 0.881 / 0.775 / 0.774 / 0.772 on ISIC / Kvasir / BUSI / DRIVE (§2). The claims resting on one checkpoint are the 16-benchmark table in §2, including the single-checkpoint leads on SynthRAD2023 (66.2 vs. 83.1 HU) and IXI (22.99 vs. 22.43 dB). The ensembled and TTA numbers are reported separately as an analysis of inference strategies. The dense segmentation adapter (§3) reaches 0.9396 / 0.9485 / 0.8616 / 0.82595 Dice, above the strongest complete baseline on all four datasets; it is a separate task-specific checkpoint and is not used to claim a single checkpoint across task families.
Recipe ablations. Stage-wise results under one protocol (§4.1): base model Dice 0.617 / 0.776 / 0.470 / 0.097, SynthRAD 2161 HU, IXI 6.26 dB; Stage A 0.358 / 0.658 / 0.088 / 0.011, 276.5 HU, 15.74 dB; Stage B 0.881 / 0.775 / 0.774 / 0.772, 66.2 HU, 22.99 dB. For joint vs. single-task, the segmentation adapter supervised on the four segmentation folds only reaches specialist-level masks on the same frozen backbone, while on continuous restoration and synthesis the jointly trained model leads without task-specific components (§4.2).
Restormer and generalists. The LoDoPaB-CT lead (37.99 vs. 35.53 dB) is against the text-guided unified baseline, not the out-of-domain Restormer checkpoint, and Table 2 includes target-trained CT and SR baselines (§5). MVG and UniMedVL differ from MedVision-X in task coverage, training data and output convention, and a numerical comparison requires identical frozen splits and benchmark-aligned prompts; outside that convention a generalist degenerates the way our own base-model rows do (DRIVE AUC 0.462, BUSI normal-FPR 0.999, SynthRAD 2161 HU).