- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper revisits the ECG–language pretraining paradigm and asks whether the quality of text representations themselves — rather than the sophistication of cross-modal alignment mechanisms — constitutes a bottleneck for ECG representation learning. The authors propose to replace conventional jointly trained text encoders with a frozen large language model (Meta Llama 3.1 8B, with Qwen2-7B also compared) that directly encodes clinical reports, using its representations as fixed supervisory signals for ECG representation learning via a simple global contrastive alignment. To make this work, they introduce three targeted mechanisms: (1) Text-Space Rectification (TSR), which removes the top-4 dominant common components of the LLM text space to mitigate anisotropy; (2) a scale-aware ECG encoder that uses a lightweight FiLM branch conditioned on pre-standardization lead-level statistics to recover scale cues lost by per-lead standardization; and (3) a memory-efficient negative expansion strategy combining offline text caching/deduplication into a text bank with an online ECG feature queue to support out-of-batch negatives. The method is pretrained on MIMIC-IV-ECG (~761k ECG–report pairs) and validated on three public datasets (PTB-XL, CSN, CPSC2018) across linear probing (1%/10%/100% labels), cross-domain transfer, and zero-shot evaluation against 18 baselines (e.g., MERL, MELP, ECG2TOK, CLEAR). The authors report state-of-the-art results — best in 17 of 18 linear probing settings (average AUROC 88.49%, +2.71 over the runner-up MELP) and +2.55/+3.20 over MELP/MERL in zero-shot — and attribute these gains to the quality of the frozen LLM text supervision, with ablations showing TSR is the most critical component (−6.30 AUROC when removed), followed by FiLM (−0.47) and out-of-batch negatives.
Critical strengths
- A well-motivated reframing of the ECG–language bottleneck, validated by unusually clean gains. The paper shifts the community's attention from ever more elaborate alignment mechanisms to text representation quality, and the empirical evidence supports the claim: the method outperforms 18 baselines across 18 linear probing settings, cross-domain transfer, and zero-shot evaluation, despite using only a simple global alignment loss. The strong low-data results (e.g., 91.28% on PTB-XL-Super with 10% labels, beating all baselines at 100%) directly demonstrate the value of high-quality textual supervision, which is the paper's central thesis. This reframing is consequential because it offers the field a new, orthogonal axis of improvement rather than incremental alignment-design gains.
- The TSR analysis is thorough and convincingly explained. Beyond reporting a large performance drop when TSR is removed, the authors provide converging evidence — training loss curves (plateau ~6 without TSR vs. ~3 with TSR), mean pairwise cosine similarity, and the fraction of variance explained by top principal components — that the mechanism works precisely as motivated, by suppressing anisotropic dominant common components in the frozen LLM space. This diagnostic rigor makes the framework's behavior interpretable and gives the paper a solid engineering-science foundation.
Critical weaknesses
- Novelty relative to prior frozen-LLM-for-ECG work is not established, which is a core claim of the paper. The paper positions itself against "text-as-auxiliary-modality" methods (MERL and successors) but does not adequately differentiate from Li et al., "Frozen Language Model Helps ECG Zero-Shot Learning" (MIDL 2024), which already uses a frozen LLM's text representations to supervise ECG representation learning. Since the paper's principal contribution — using a frozen LLM as a fixed text encoder for ECG learning — overlaps substantially with this prior work, the paper must explicitly delineate the technical distinction (TSR, scale-aware encoding, negative expansion notwithstanding, what fundamental problem does it solve that the prior work does not?), provide head-to-head empirical comparisons, and benchmark the improvement. Without this clarification, the novelty claim is currently unsubstantiated, which is the main factor holding down my score.
- Ablations are reported under a non-optimal training configuration and at a single low-data setting, weakening the reliability of the component-level conclusions. The authors state that subsequent component ablations use the 1:1 loss-weight setting as baseline, even though their own hyperparameter analysis shows the model's optimum is at 20:1. This means the reported component effects (TSR: −6.30, FiLM: −0.47) are conditioned on a suboptimal configuration, and their rankings/magnitudes may not hold at the operating point the final model actually uses. Additionally, all ablations are run only at 1% labeled data. Combined with the statically fixed TSR hyperparameter k=4 and the absence of trainable-LLM comparisons, the experimental evidence does not fully support the generality of the design decisions. These gaps are consequential because the paper's value proposition rests heavily on its proposed mechanisms; if their benefits are configuration- or data-regime-specific, the engineering contribution is less transferable than claimed.
Questions for authors
How does the proposed framework fundamentally differ from "Frozen Language Model Helps ECG Zero-Shot Learning" (Li et al., MIDL 2024), which also uses a frozen LLM to provide text supervision for ECG learning? Could you provide a head-to-head comparison against this method under your evaluation protocol, and clearly articulate what specific, unresolved problems (beyond the TSR/FiLM/negative-expansion mechanisms) your work addresses that it does not?
Would the TSR and FiLM ablation conclusions remain consistent under the optimal 20:1 loss-weight setting and at 100% training data, rather than only at 1% data with the 1:1 setting? Given that TSR shows a very large effect, confirming it holds under the actual operating configuration would substantially strengthen the paper.
How sensitive is the method to the number of removed common components k in TSR? A sweep over k (e.g., k ∈ {1, 2, 4, 8, 16}) with performance reported would clarify whether the k=4 choice is dataset/LLM-dependent or robustly transferable.
Thank you for the rebuttal, The authors have addressed my major concerns. The response is sufficient to resolve my earlier doubts, and I will rase the soundness score to 3.