- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes PULSE, a compact self-supervised framework for variable-lead ECG representation learning. It treats available leads as an unordered set and combines a shared intra-lead encoder with two branches: a Cross-Lead Branch for inter-lead interaction and an Anonymous Branch for subset-stable per-lead encoding. Pretraining predicts fixed morphology and rhythm descriptors from temporally masked, randomly sampled lead subsets. The model is evaluated on PTB-XL, CPSC2018, and PhysioNet2017 under linear probing, fine-tuning, reduced/random lead availability, and lead reordering. It has 0.43M encoder parameters and is also deployed on a Raspberry Pi 4B.
Critical strengths
-
PULSE addresses variable lead availability and ordering, which are common across clinical ECG systems, portable devices, and wearables.
-
Shared per-lead encoding, cross-lead interaction, and symmetric aggregation provide a principled way to support variable-size inputs and invariance to input ordering.
-
The linear-probe results are consistently strong relative to the selected self-supervised baselines, suggesting that the pretrained representation contains useful downstream information.
-
The 0.43M-parameter encoder and measured Raspberry Pi latency, memory use, and numerical consistency provide credible evidence of edge-deployment feasibility.
Critical weaknesses
-
The relationship between permutation invariance and lead identity needs stronger justification. Permutation invariance does not necessarily require removing lead identity: a set encoder can remain invariant to the ordering of lead–signal pairs while retaining a lead-ID feature. Since ECG leads correspond to distinct anatomical projections, it is unclear whether fully anonymous encoding is the most appropriate inductive bias.
-
Anonymous encoding may limit the preservation of clinically relevant spatial information. Lead identity can be important for interpreting regional ST–T changes, infarct location, electrical axis, hypertrophy, and conduction abnormalities. A comparison with an otherwise identical permutation-invariant model using lead-ID or anatomical embeddings would be important for determining whether the proposed design improves robustness without sacrificing spatially relevant information.
-
The central claim that one fine-tuned model handles arbitrary lead configurations without retraining is not yet sufficiently clear from the reported protocol. The paper should state explicitly whether the 12-, 6-, and 1-lead results use the same checkpoint, especially because the appendix distinguishes between “12-lead” and “variable-lead” models. If different configurations use separately fine-tuned models, the current evidence would not fully support this claim.
-
The PTB-XL splitting protocol requires clarification. The paper appears to use random stratified splits rather than the official patient-wise folds. Because PTB-XL may contain multiple recordings from the same patient, record-level splitting could introduce patient overlap between training and test sets and complicate comparison with prior work. Results using the official or another patient-disjoint split would strengthen the evaluation.
-
The construction of the single-label downstream tasks is insufficiently specified. PTB-XL and CPSC2018 may contain multi-label or multi-diagnosis records, whereas the paper states that every recording has one label. The filtering or label-reduction procedure should be described in detail. It would also be helpful to confirm that the quoted ST-MEM results use compatible labels and splits.
-
The baseline coverage does not yet fully isolate the source of the reported gains. Particularly informative additions would include supervised training from scratch, a simple DeepSets or mean-pooling encoder, a lead-ID-aware permutation-invariant model, and a recent channel-agnostic or variable-lead ECG method. These comparisons would help distinguish the contributions of set encoding, random lead sampling, and physiology-anchored pretraining.
-
More comprehensive ablations and statistical analyses would strengthen the conclusions. The current experiments do not fully examine cross-lead attention versus simpler pooling, the fusion/readout components, masking strategies, or the lead-sampling distribution. In addition, some fine-tuning differences are comparable to the reported standard deviations. Confidence intervals or paired significance tests would help determine whether these improvements are robust.
-
The construction of pretraining targets under variable lead subsets should be clarified. It is unclear whether shared morphology, rhythm, and global descriptors are computed from only the retained leads or from the complete 12-lead recording. In the former case, the target may vary across subsets of the same recording; in the latter, the model predicts information derived partly from unavailable leads. Clarifying this choice and providing an ablation would improve the interpretation and reproducibility of the objective.
Questions for authors
-
Lead identity and permutation invariance: Could the authors clarify why lead identity is removed rather than included as an element-level feature? Since symmetric set aggregation remains permutation-invariant when each signal is paired with its lead ID, could the authors compare PULSE with an otherwise identical model using lead-ID or anatomical/geometric lead embeddings?
-
Clinically relevant spatial information: How does Anonymous encoding affect diagnostic tasks that depend on lead location, such as regional ST–T changes, myocardial infarction localization, electrical-axis abnormalities, hypertrophy, or conduction disturbances? If possible, could the authors provide per-class results or a targeted evaluation comparing anonymous and lead-aware representations?
-
Single model across lead configurations: Do the reported 12-, 6-, 1-, and random-lead results all use the same fine-tuned checkpoint? Please clarify the lead-sampling procedure during pretraining, linear-probe training, fine-tuning, and testing, as well as the distinction between the “12-lead model” and “variable-lead model” in the appendix.
-
PTB-XL data splitting: Does the PTB-XL evaluation use the official patient-wise folds or otherwise guarantee patient-level separation between training, validation, and test sets? If the current evaluation uses record-level random splits, could the authors provide results using the official or another patient-disjoint protocol?
-
Single-label task construction: How are multi-label or multi-diagnosis recordings in PTB-XL and CPSC2018 converted into the reported single-label tasks? Please describe any filtering, label prioritization, or other reduction procedure, and clarify whether the quoted ST-MEM results use compatible label definitions and data splits.
-
Baseline coverage: Could the authors provide comparisons with the most informative missing controls, particularly (i) supervised training from scratch, (ii) a simple DeepSets or mean-pooling set encoder, (iii) a lead-ID-aware permutation-invariant model, and (iv) at least one recent channel-agnostic or variable-lead ECG method?
-
Ablations and statistical significance: Could the authors further isolate the contributions of cross-lead attention, pooling/fusion components, masking strategies, and the lead-sampling distribution? For improvements comparable to the reported standard deviations, could the authors provide confidence intervals or paired statistical tests?
-
Pretraining targets under variable lead subsets: Are the shared morphology, rhythm, and global descriptors computed from only the retained leads or from the complete 12-lead recording? How does this choice affect target consistency across different subsets of the same recording, and could the authors provide an ablation comparing the alternatives?