- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper studies low-data myocardial segmentation in echocardiography by comparing two existing pretrained segmentation systems, Pixio-L with Mask2Former and EchoFM with UNETR, on CAMUS A4C myocardium segmentation. The authors evaluate two fine-tuning routes: direct fine-tuning on CAMUS MYO labels and an intermediate LV-supervised route that first fine-tunes on EchoNet-Dynamic LV cavity segmentation before adapting to MYO. Across five target-data fractions and three training seeds, Pixio-L achieves higher mean MYO Dice than EchoFM under both routes, while LV supervision improves both systems, especially in the lowest-data regime and particularly for EchoFM. The paper also includes a frozen-encoder ablation showing that the effect of encoder updates depends on the system and initialization route
Critical strengths
- Studying whether LV supervision helps MYO segmentation is well motivated, especially in echocardiography where annotation types often differ across datasets.
- The paper separates absolute final MYO performance from gain due to LV supervision.This avoids the common mistake of claiming that a method is superior simply because it has a larger transfer gain.
Critical weaknesses
- The technical contribution of the paper is limited. The paper does not introduce a new model, loss, adaptation method, pretraining objective, or theoretical insight. Its main contribution is an empirical comparison of two existing pretrained systems under direct and LV-supervised fine-tuning.
- The benchmark scope is narrow. Only two systems are compared, but they differ in architecture, decoder, input format, temporal context, resolution, and optimization setup. As a result, the study cannot isolate the effects of pretraining, architecture, or domain specificity. Key baselines are missing, including nnU-Net, training from scratch, ImageNet-pretrained models, architecture-matched controls, and other ultrasound or foundation models.
- The evaluation uses only one CAMUS A4C split and one nested subset draw, which is especially concerning in the low-data setting where patient selection can strongly affect results. The study lacks external validation and does not evaluate other views or datasets.
Questions for authors
- Why are only two pretrained systems evaluated? How should readers generalize from this study beyond the specific Pixio-L + Mask2Former and EchoFM + UNETR pipelines?
- Why is there no strong non-foundation-model baseline such as nnU-Net?
- Could the advantage of Pixio-L be due to Mask2Former rather than Pixio-L pretraining? Have the authors tested EchoFM with Mask2Former or Pixio-L with UNETR-style decoding?
- Can the authors verify whether CAMUS or EchoNet-Dynamic patients/images were included in the released pretrained checkpoints?
- Have the authors considered parameter-efficient fine-tuning methods such as LoRA, adapters, or partial-layer fine-tuning? Since the target setting is explicitly low-data myocardial segmentation, these methods may be more appropriate than full fine-tuning.
7 comments
Response to reviewer 4XTF (part 2/5): W2
W2: "The benchmark scope is narrow. Only two systems are compared … Key baselines are missing, including nnU-Net, training from scratch, ImageNet-pretrained models, architecture-matched controls, and other ultrasound or foundation models."
We added two of the missing baselines, nnU-Net and an ImageNet-initialized EchoNet (Appendix A.2, below). We agree that the original two systems cannot isolate pretraining, architecture or domain, and the revision attributes no difference between systems to any of them. The LV gain does not need that isolation, because it is measured with the system held fixed.
- nnU-Net v2 2D, trained from scratch for 100 epochs. On the original CAMUS split, with both trained directly, it was not clearly different from Pixio-L at 5% (+0.73 [−0.30, +1.72]) and scored higher at 10–100% (+1.40 to +1.55) (Section 4.4, Table 9). Its LV gain was +1.39 [+0.76, +2.07] at 5% and +0.60 [+0.13, +1.12] at 10%, and not resolved at 25–100% (Table 2).
- EchoNet, an ImageNet-initialized DeepLabV3-ResNet50 trained at 112×112 with an EchoNet-derived recipe. With both trained directly, it scored lower than Pixio-L at every fraction on this split (−8.87 [−10.85, −6.94] at 5% to −1.60 [−2.52, −0.79] at 100%; Table 9), and its mean Dice was above EchoFM's (Table 7). The LV stage raised its mean MYO Dice at 5% (+6.12 [+4.84, +7.41]), and the intervals were above zero at the other four fractions too.
The items still missing are listed in part 1/5.
Response to reviewer 4XTF (part 3/5): W3
W3: "The evaluation uses only one CAMUS A4C split and one nested subset draw … The study lacks external validation and does not evaluate other views or datasets."
One additional split (Section 4.1, Appendix D). We ran one additional CAMUS patient split (360/90/50 patients; the 50 test patients are disjoint by patient ID from the original test set; new nested 5% and 10% subsets) for Pixio-L and EchoFM, both routes, three seeds; its eight contrasts were fixed before any of its test scores existed. All eight kept the direction reported on the original split, with 95% intervals excluding zero (Table 15): Pixio-L minus EchoFM, Direct, 5%: +13.00 pp [+10.96, +15.19]; Pixio-L minus EchoFM, LV, 5%: +5.46 pp [+4.20, +6.78]; LV minus Direct, Pixio-L, 5%: +1.96 pp [+1.35, +2.59]; LV minus Direct, EchoFM, 5%: +9.50 pp [+7.74, +11.43]; Pixio-L minus EchoFM, Direct, 10%: +10.29 pp [+8.37, +12.27]; Pixio-L minus EchoFM, LV, 10%: +5.34 pp [+3.93, +6.79]; LV minus Direct, Pixio-L, 10%: +1.80 pp [+1.17, +2.48]; LV minus Direct, EchoFM, 10%: +6.76 pp [+5.27, +8.26].
nnU-Net and EchoNet, outside these 8 contrasts, also had LV gains above zero at 5% and 10% on this split (Table 16).
HMC-QU (Section 4.3, Appendix F). We added one external site, HMC-QU (109 patient IDs, 2,349 A4C frames, clinician-verified pseudo-labels covering the LV wall); all models were applied without retraining. Two results, kept separate. First, the LV gain held: under full fine-tuning, the LV gain of the original-split models was above zero in every system at every fraction; at 5% it was +3.66 [+3.05, +4.23] for Pixio-L and +12.58 [+11.58, +13.58] for EchoFM (Table 8). With the encoder frozen, it was also above zero in Pixio-L and EchoFM at every fraction (Table 31; at 5%, EchoFM +12.60 [+11.58, +13.65]). Second, four frozen-encoder comparisons between systems or adaptation modes, none of them an LV gain, reversed at 5% relative to CAMUS (Table 20): Pixio-L minus EchoFM, −9.88 [−11.14, −8.59] under Direct (also reversed at 50% and 100%) and −1.05 [−1.96, −0.09] under the LV-supervised route; frozen minus full fine-tuning after the LV stage, Pixio-L −1.75 [−2.45, −1.09] (CAMUS +0.76) and EchoFM +1.89 [+1.66, +2.13] (CAMUS −0.39). Our conclusions about system ordering and freezing therefore stay limited to CAMUS. For models trained on the additional split (Table 21), the LV gain was above zero in seven of eight cells; the exception was nnU-Net at 10% (−3.33 [−4.96, −1.77]). Absolute HMC-QU scores are not compared with CAMUS.
Other views. Only the four-chamber view is evaluated; other views are listed as not evaluated (Section 5).
Response to reviewer 4XTF (part 1/5): main result, what we added, W1
Main result. MYO labels in echocardiography are scarce, LV cavity labels are abundant, and the LV cavity border is the inner border of the myocardium. Training on LV before MYO (LV→MYO) raised MYO Dice on CAMUS when MYO labels were scarce, in every system we tested: with 5% of the training patients, by +2.29 pp [+1.40, +3.32] for Pixio-L, +9.15 [+7.80, +10.47] for EchoFM, +1.39 [+0.76, +2.07] for nnU-Net and +6.12 [+4.84, +7.41] for EchoNet, with intervals above zero at 10% as well and smaller gains as MYO labels grew (Section 4.3, Table 2).
What we added in response to your review.
Not evaluated in this manuscript (Section 5): architecture-matched controls, Pixio-L or EchoFM trained from scratch, other foundation models, adapters other than LoRA, selected-layer tuning, head reinitialization after LV training, freezing during the LV stage, and other views.
We agree that the paper introduces no new model, loss, adaptation method or pretraining objective, and we prove no theorem. Your reading of the main contribution as an empirical comparison of two systems matches how our submitted abstract read, and we have rewritten the abstract. The contribution is controlled, patient-paired evidence about the intermediate stage: within each system, the same target patients are trained with and without the LV stage. On insight, what we add is empirical: the gain is largest when MYO labels are scarce and is not confined to the border the two labels share. The rationale (item 5) notes that the myocardium is the band between the LV cavity border and the epicardial border, so LV labels supervise one of the two target borders and where the ventricle lies. Two results added after review bear on it (Section 4.3, Appendix E). Although the LV stage used no CAMUS image, all four LV-stage models already located the CAMUS LV cavity (LV Dice 0.91 for Pixio-L, 0.90 for EchoNet and nnU-Net, 0.85 for EchoFM; Table 19). In a boundary-wise analysis, the LV stage reduced error near both MYO borders in Pixio-L and EchoFM at 5% and 10%, more near the outer border for Pixio-L, so the gain is not confined to the shared inner border (Table 18). Together with the localization result, this suggests that the LV stage supplies the ventricle's position and overall shape rather than one border.