- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates whether ECG data from a small number of patients can be used to learn representations that transfer to other clinical tasks. The authors propose biomECG, which is pretrained to determine whether two ECG recordings belong to the same patient. They also compare different lead fusion methods and fine-tuning strategies. Experiments are conducted on MIMIC, CODE-15, and CPET, with a primary focus on mortality prediction, along with age and sex prediction. The results show that pretraining on only 1359 patients achieves performance close to ECGFounder on mortality prediction, while the benefits on other tasks remain limited.
Critical strengths
The paper directly examines whether large patient cohorts are necessary for learning effective ECG representations. Pretraining on a small cohort using patient identity verification achieves performance comparable to a large foundation model on two mortality prediction datasets. This finding makes the research direction worth exploring, especially for medical applications with limited data.
The authors use patient data from different sources for pretraining and evaluate transfer performance on MIMIC and CODE-15. Different pretraining sources produce similar results, and even CPET data enables effective transfer. This suggests that identity verification pretraining can capture ECG information that generalizes across datasets to some extent.
Critical weaknesses
Prior work has already explored ECG representation learning based on patient identity, and the Siamese architecture used in this paper largely follows existing methods. Although the paper shows that effective representations can be learned from a small cohort, it lacks direct comparisons with patient level contrastive learning or other common self-supervised methods under matched data sizes and model architectures. It is therefore difficult to determine whether the performance comes from the identity verification objective itself or from the combined effects of the ECG data, architecture, and training strategy. The comparison with ECGFounder does not resolve this issue, since the two methods differ substantially in pretraining data, supervision, and model capacity.
The main benefits are concentrated on mortality prediction, with no comparable gains on age or sex prediction. Mortality prediction also uses age and sex as additional inputs, but the paper lacks a baseline using only these clinical variables. This makes it difficult to isolate the contribution of the learned ECG representations. Notably, on the full MIMIC training set, the late fusion model trained from scratch achieves an AUROC of 0.838, slightly higher than the 0.835 achieved with frozen biomECG. In addition, a proportion of patients in MIMIC are censored before one year but are treated as negative cases. This further raises concerns about the reliability of the mortality prediction results.
The paper is also poorly written and difficult to follow. Adding one or two diagrams in the Intro or Method section would help readers understand the biomECG architecture and training procedure.
Overall, the paper includes a substantial amount of experimentation, but the experiments are poorly organized. Few directly address the central research questions, and the evidence is insufficient to support the main claims.
Questions for authors
- Does the identity verification objective offer a clear advantage over existing alternatives? Under matched pretraining cohort sizes, model architectures, and downstream training settings, does biomECG outperform existing patient level contrastive learning or other self-supervised methods?
- How much of the improvement in mortality prediction actually comes from the pretrained representations? How much additional predictive value does biomECG provide over a baseline using only age and sex? Do the main conclusions still hold when censoring is handled appropriately?
- Is the advantage of late fusion mainly due to model ensembling? After controlling for model capacity and ensemble size, does modeling each lead independently still outperform joint lead modeling?
If the authors can adequately address these questions and provide clear, focused experiments that support the main claims, I would be willing to raise my score.
5 comments
To Authors
Thank you for the rebuttal. I have reread the updated PDF. The new method figure and additional experiments help clarify the paper.
However, my second concern remains. Age and sex alone already achieve strong mortality prediction performance, while the additional benefit of biomECG features is limited, especially on CODE-15. The link between patient identification during pretraining and mortality prediction also remains unclear.
My main concern is whether the first two steps, biometric pretraining and representation learning, are really necessary for the final mortality prediction task.
For now, I maintain my rating.
Response to Reviewer NMkV - concern 1
Thank you for taking the time to read our rebuttal version and raising these concerns. We believe however that these concerns are already addressed by our results. We give more details below.
Concern 1: Age and sex alone already achieve strong mortality prediction performance, while the additional benefit of biomECG features is limited, especially on CODE-15.
Lukyanenko et al. (2025) [1] benchmarked ECG-based survival models and showed that combining learned ECG representations with age and sex improves mortality prediction compared with ECG-only or age-and-sex-only models. We adopt this evaluation framework: all ECG representations are systematically concatenated with age and sex for downstream mortality prediction, allowing comparison under matched downstream conditions.
The smaller incremental benefit of ECG features on CODE-15 than on MIMIC is also documented and discussed in Lukyanenko et al. (2025). Our results in Figure 3 remain consistent: adding biometric ECG representations to age and sex leads to a +0.04 AUROC increase in mortality prediction on CODE-15 with full downstream training. Despite the increase being modest, this observation should be distinguished from the question of how well biomECG compares with other ECG representations under matched conditions: this gain is among the largest obtained with the compared ECG representations.
Overall these observations does not diminish our claims:
- the representations that we obtained through pretraining an encoder on a very small subset of 1359 patients with the biometric technic and freezing it
- contains information useful to mortality prediction
We have updated the Figure 3 caption to emphasize that all ECG representations are concatenated with age and sex, and revised Section 5.1 text to begin with the demographic baseline and explain the additional contribution of ECG representations more explicitly, as these points may not have been sufficiently clear in the previous version. Thank you for the opportunity to emphasize these points.
For further details : For these models that take [ECG representation, age, sex] as input, performance depends on both:
- the quality of the ECG representation
- and the size of the downstream mortality training cohort. Figure 3 varies both: it compares different representations, including biomECG, across downstream training sizes. All ecg representations (not only biometric representation) are concatenated with age and sex under the same downstream protocol.
The results with very small downstream size (1000 or 8000) is shared across representation methods, rather than being specific to biomECG representations. It highlights that learning to extract prognostic information from ECG beyond age and sex requires more downstream training patients on CODE-15, rather than a limitation specific to biomECG :
- for MIMIC, benefit appears starting at 1000 downstream patients for MIMIC
- for CODE15, benefit appears somewhere in between 8000 patients (no benefit of any kind of ECG representation compared to age+sexe alone) and full training (63k patients, clear benefit when adding ecg representations to age+sexe). This information might be of importance for future applications.
[1] Platon Lukyanenko, Joshua Mayourian, Mingxuan Liu, John K. Triedman, Sunil J. Ghelani, and William G. LaCava. Deep survival analysis from adult and pediatric electrocardiograms: a multi-center benchmark study. BioDataMining, 19(1), December2025. ISSN1756-0381. doi: https://doi.org/10.1186/s13040-025-00510-4.
Response to Reviewer NMkV
Thank you for your careful reading and for suggesting concrete ways to strengthen the paper. The three reviews converged on the need for stronger baselines, clearer evidence about what drives mortality prediction, and a more focused presentation. Your feedback led us to substantially revise the study.
Overall changes compared to the previous version
The new experiments support three contributions:
We added the new baselines to the anonymous GitHub repository.
Q1. SSL and foundation baselines
We now compare with PCLR, JEPA, and CPC using the same pretraining patients and downstream protocol as biomECG. PCLR is the closest identity baseline. JEPA and CPC offer distinct predictive objectives. PCLR and JEPA share biomECG’s ResNet-18. CPC keeps its native multilead CNN–S4 given its temporal objective and higher training cost (Sec. 4.2, Appendix F).
We added ECG-JEPA and ECG-CPC alongside ECGFounder, the top three foundation models in Al-Masud et al.’s frozen mortality benchmark (2026, Tab. 4). With late fusion, biomECG matches JEPA and generally improves on adapted PCLR (Fig. 3). Local CPC scores highest among local methods on MIMIC, with a larger encoder.
\text{Method} & \text{MIMIC AUROC} & \text{CODE-15 AUROC} \\\\ \hline \text{biomECG} & 0.84 & 0.84 \\\\ \text{PCLR} & 0.83 & 0.81 \\\\ \text{JEPA} & 0.84 & 0.84 \\\\ \text{ECG-CPC, best foundation reference} & 0.86 & 0.85 \end{array}$$ **Q2a. Contribution of ECG features beyond age and sex** Fig. 3 compares age and sex with and without frozen ECG features using matched MLPs, training subsets, and checkpoint selection. Age and sex alone yield **0.77 on MIMIC** and **0.80–0.81 on CODE-15**. With full training, adding late-fusion biomECG yields **0.84 on both**. At small **downstream** budgets, adding ECG features lowers AUROC, likely because the MLP has too few examples for the higher-dimensional inputs. Full-training biomECG AUROCs (Appendix H.1): $$\begin{array}{lcc} \text{Inputs} & \text{MIMIC} & \text{CODE-15} \\\\ \hline \text{Age and sex only} & 0.77 & 0.81 \\\\ \text{biomECG features only} & 0.80 & 0.77 \\\\ \text{biomECG + age and sex} & 0.84 & 0.84 \end{array}$$ **Q2b. Sensitivity to early censoring** We agree that patients with less than one year of follow-up and no recorded death may have unknown one-year outcomes. We followed the convention of Lukyanenko et al. (2025). Their supplement discusses how excluding patients with short or zero follow-up changes the evaluated population and can increase the observed event proportion. Appendix C tests how this choice affects AUROC and model rankings. Both analyses retain observed deaths within one year. - **Test only.** Excluding early-censored test patients with predictions fixed barely changes AUROC on CODE-15 and modestly lowers it on MIMIC, with nearly unchanged rankings. - **With retraining.** We filter all partitions and retrain the heads with frozen encoders. Results are similar, with a few swaps between close models. Filtering without replacements reduces training sizes and may partly explain the MIMIC decrease. **Q3. Ensemble control** The early ensemble averages predictions from eight independently pretrained models, each using all eight leads jointly and the same patient cohorts. Late fusion uses one model per lead. Encoder capacity is similar (1.70M early vs. 1.69M late). Across biomECG, PCLR, and JEPA, late fusion beats single early fusion in 18/18 settings and the early ensemble in 15/18 (Fig. 3). **Frozen biomECG vs. training from scratch on full MIMIC** Training from scratch slightly outperforms frozen biomECG on full MIMIC with 1,359 pretraining patients. Increasing the pretraining cohort to 8,000 patients is enough for frozen biomECG to surpass the scratch baseline (Figures 4). **Presentation** We worked to make the study as clear and focused as possible. We simplified the prose, added two diagrams, and put the key experiments first.