- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
ECG-EGR reformulates ECG interpretation as reasoning over a sparse, variable-cardinality set of waveform-supported Events. Each Event carries explicit lead-time support, an immutable semantic address, and a mutable reasoning state, separating evidence localization from contextual interpretation. Events are discovered competitively and aligned to weak clinical supervision via unbalanced optimal transport, then relationally composed to capture temporal and cross-lead dependencies. A language model accesses the ECG only through composed Event representations, while a finding-conditioned retriever links generated findings back to Event semantics, giving structured provenance to source waveform regions. Validation covers report generation and cross-task representation transfer.
Critical strengths
- The separation of an immutable semantic address from a mutable reasoning state is a genuinely clean architectural idea. It lets evidence localization stay fixed while contextual interpretation varies, which is a principled way to make grounding and reasoning coexist rather than compete. This design is what makes the provenance claim structurally possible at all, and it is the main reason I consider the paper above clear rejection.
- Tracing a generated finding back to a specific lead-time waveform region targets a real clinical need. Most ECG report generators produce text without evidence, so a mechanism that links findings to source waveform regions is consequential if it works, and the reported cross-task transfer suggests the representation is not overfit to a single benchmark.
Critical weaknesses
- Provenance faithfulness — the paper's central claim — is asserted but not validated. The headline contribution is that findings can be traced to source Events and waveform regions, yet no clinician-annotated evidence-location ground truth appears to be used. Without it, there is no way to tell whether an "immutable semantic address" denotes a diagnostically meaningful region or merely a stable learned cluster. Since the entire value proposition rests on traceability being genuine rather than nominal, this materially limits what the experiments can support.
- The relationship to fine-grained waveform-level ECG-text alignment is not clarified. The paper grounds semantics at sub-recording granularity, which sits close to a line of work on grounded and fine-grained ECG-text alignment. GEM and D-BETA are discussed, but the strand aligning localized waveform segments with individual clinical tags (e.g., FG-CLEP, Li et al., 2025) is not covered. As the Event-level grounding operates on the same waveform-to-finding correspondence, it is hard to judge what the relational composition contributes beyond what tag-level alignment already achieves. This is the point I would most want addressed, as it bears directly on the novelty assessment.
Questions for authors
- Is any clinician-validated evidence-location ground truth used to verify provenance? If not, could you report agreement between retrieved waveform regions and expert annotations on even a small subset?
- Do discovered Events correspond to interpretable morphological categories, or are they learned clusters? Is there a quantitative measure of Event semantic consistency across recordings?
- How does Event-level grounding differ from prior tag-level fine-grained waveform alignment — are there findings the relational composition produces that alignment-based methods cannot?
- BLEU-1 of 0.876 is the headline metric, but it is largely unigram overlap. Could you report clinical-entity-level metrics, e.g., finding-level F1? A convincing response to (1) and (3) would meaningfully improve my assessment, since both concern whether the core claim is substantiated rather than merely demonstrated.
6 comments
Author Response to Reviewer 8FY9 (2/4)
Dear Reviewer 8FY9,
Thank you for this important question. Discovered Events are learned, waveform-grounded evidence units, not predefined morphological classes or hard clusters with globally fixed identities. Their semantic Keys remain immutable during relational composition, but neither the Keys nor Event indices are universal labels shared across recordings. We therefore assess whether similar Event Keys exhibit consistent clinical associations across patients, rather than assume a one-to-one mapping to expert-defined morphologies.
Response to Q2: Do Events correspond to interpretable morphological categories, or learned clusters? Is their cross-recording semantic consistency measurable?
(1) Text-free Cross-recording Event Consistency (Appendix C.7.1).
Using the frozen Stage-I model, we construct a patient-disjoint PTB-XL retrieval benchmark (Gallery: folds 1–8; Query: fold 10; fold 9 excluded; one ECG per patient). Although Stage I was trained with report supervision, no clinical text is used at retrieval time: each Query Event ranks Gallery ECGs by its maximum cosine similarity to their active Events. We measure top-5 agreement using record-level SCP-label Jaccard similarity, positive-label recall, and prevalence-adjusted label lift. Results are averaged over Events within each Query ECG.
Table R3. Text-free cross-recording retrieval (PTB-XL).
| Representation | Jaccard@5 ↑ | Recall@5 ↑ | Lift@5 ↑ |
|---|---|---|---|
| Random | 0.3481 | 0.4566 | 1.006 |
| Geometry-only | 0.4482 | 0.5626 | 1.577 |
| Initial Value () | 0.4893 | 0.6061 | 2.003 |
| Pooled-Key | 0.5001 | 0.6195 | 2.132 |
| Semantic Key () | 0.5509 | 0.6674 | 2.326 |
Semantic Keys outperform all controls. Relative to Pooled-Key, they improve Jaccard@5 by 0.0508 and Recall@5 by 0.0479; their Lift@5 of 2.326 indicates substantially greater clinical-label agreement than expected from Gallery-label prevalence. This suggests that individual Event Keys retain cross-recording clinical information beyond support geometry or record-level pooling.
(2) Finding-conditioned Cross-recording Event Retrieval (Appendix C.7.1).
We additionally test concepts from the PTB-XL diagnostic, form, and rhythm categories (up to six per category; ≥80 positive Gallery ECGs). For up to 60 positive Query patients per concept, we select the Event Key most similar to the concept description encoded by frozen BioLORD-2023; the selected Event then ranks Gallery ECGs through Event-Key similarity. Gallery SCP labels, rather than Event-level annotations, define the retrieval targets. Results are macro-averaged over concepts.
Table R4. Category-wise finding-conditioned retrieval (PTB-XL).
| Category | Representation | AUROC ↑ | AUPRC ↑ |
|---|---|---|---|
| Diagnostic | Initial Value () | 0.752 | 0.370 |
| Semantic Key () | 0.781 | 0.379 | |
| Form | Initial Value () | 0.659 | 0.205 |
| Semantic Key () | 0.686 | 0.213 | |
| Rhythm | Initial Value () | 0.778 | 0.458 |
| Semantic Key () | 0.806 | 0.499 |
Semantic Keys improve both AUROC and AUPRC across all three clinical categories. Overall, they achieve 0.758 AUROC / 0.364 AUPRC, versus 0.730 / 0.344 for Initial Values; hard-negative AUROC also improves (0.703 vs. 0.676). Direct Text Event-Max performs better (0.808 / 0.432 overall); unlike Event-Key matching, it directly ranks Gallery Events using the target concept embedding.
These results show that ECG-derived Event Keys support quantifiable cross-recording clinical-label consistency without predefined Event categories or fixed slot identities. We have added the analyses to Appendix C.7.1 (Tables 17–19, lines 1809–1889).
Author Response to Reviewer 8FY9 (3/4)
Dear Reviewer 8FY9,
Thank you for highlighting the distinction between Event-level reasoning and fine-grained ECG–text alignment.
Response to Q3: How does Event-level grounding differ from prior tag-level fine-grained waveform alignment — are there findings the relational composition produces that alignment-based methods cannot?
(1) Distinction from FOCAL and direct comparison.
FOCAL (Li et al., 2026; formerly FG-CLEP) uses Semi-UOT to align clinical tags with localized ECG patches for contrastive representation learning. ECG-EGR instead discovers a variable-cardinality set of lead–time-supported Events (CED), aligns findings with multiple Events via UOT (CET), and explicitly composes temporal, cross-lead, synchrony, and overlap relationships through relation-aware message passing (REC). During composition, supports and semantic Keys remain fixed, while a lineage matrix approximates source-Event information routing for finding-to-waveform provenance.
To compare downstream representations rather than decoder capacity, we adapt FOCAL to ECG report generation and use the same Qwen3-8B decoder for both methods. FOCAL was not originally designed for this task; the comparison therefore evaluates task-adapted representations, not FOCAL's original classification setting.
Table R5. Same-backbone report generation (↑ higher is better; ↓ lower is better).
| Dataset / Model | B-1↑ | B-F1↑ | F-Pre↑ | F-Rec↑ | F-F1↑ | Hall.↓ | Omit.↓ |
|---|---|---|---|---|---|---|---|
| MIMIC-IV-ECG (In-domain) | |||||||
| FOCAL (adapted) | 0.441 | 0.935 | 0.677 | 0.642 | 0.659 | 0.129 | 0.358 |
| ECG-EGR | 0.876 | 0.962 | 0.849 | 0.829 | 0.839 | 0.045 | 0.171 |
| PTB-XL (Out-of-domain) | |||||||
| FOCAL (adapted) | 0.056 | 0.846 | 0.682 | 0.533 | 0.598 | 0.058 | 0.467 |
| ECG-EGR | 0.412 | 0.861 | 0.761 | 0.666 | 0.710 | 0.046 | 0.334 |
ECG-EGR improves Finding F1 by 0.180 on MIMIC-IV-ECG and 0.112 on PTB-XL, with better Finding Precision/Recall and lower error rates on both. We do not claim that tag-alignment models cannot predict particular findings; rather, ECG-EGR explicitly represents interactions among grounded evidence units. This comparison supports the full representation pipeline; the ablation below isolates REC's contribution. Full results are in revised Table 6 (lines 498-511).
(2) REC ablation.
We isolate REC by comparing the full model with w/o REC while keeping the remaining framework unchanged. Removing REC degrades report quality and clinical precision, increases hallucinations, and reduces both evidence-faithfulness metrics, supporting the contribution of relational composition beyond Event discovery and semantic alignment.
Table R6. Effect of relational composition.
| Setting | B-1↑ | B-F1↑ | F-Pre↑ | Hall.↓ | EG-Nec↑ | EG-Suf↑ |
|---|---|---|---|---|---|---|
| Full | 0.876 | 0.962 | 0.849 | 0.045 | 0.094 | 0.131 |
| w/o REC | 0.586 | 0.924 | 0.501 | 0.137 | 0.061 | 0.083 |
(3) Intervention validation (Appendix C.8).
We test whether lineage-retrieved evidence affects prediction, using teacher-forced NLL on the fixed target finding rather than relying on attribution visualization alone.
In C.8.1, we remove the highest-attribution pre-REC source Event and rerun REC and the decoder. Controls are matched on support mass, per-lead distribution, and temporal centroid. Target removal increases NLL by 0.2586, versus 0.0115 for controls. Across source-Event removals, mean per-finding Spearman correlation between attribution and NLL impact is 0.8282.
In C.8.2, we select positions covering 50% of attribution mass (capped at 15% of all positions), dilate by 5 samples, feather over 15, and attenuate to 10% amplitude. Three circularly shifted control masks preserve lead selection, coverage, and temporal structure. We rerun the ECG encoder, REC, and decoder. Target attenuation increases NLL by 0.0949, versus 0.0278 for controls.
Table R7. Intervention results (patient-level inference).
| Intervention | Target ΔNLL | Control ΔNLL | Paired difference (95% CI) | Positive patients | Adj. p |
|---|---|---|---|---|---|
| Source Event removal | 0.2586 | 0.0115 | 0.2471 [0.2294, 0.2669] | 94.5% | 0.0002 |
| Raw waveform attenuation | 0.0949 | 0.0278 | 0.0671 [0.0611, 0.0732] | 87.1% | 0.0002 |
Confidence intervals and positive-patient rates are patient-level; p-values are Holm-adjusted across both endpoints. Together, the task-matched comparison, REC ablation, and controlled interventions show that relational composition improves finding-level prediction and that retrieved source Events and waveform regions are prediction-relevant, without equating attribution with clinician-verified localization.
These analyses appear in revised Table 6 and Appendix C.8 (Table 20, lines 1935–2030).
Author Response to Reviewer 8FY9 (1/4)
Dear Reviewer 8FY9:
We sincerely thank the reviewer for raising this important concern. We fully agree that clinician-annotated, abnormality-specific evidence locations would provide the most direct ground truth for validating finding-level provenance. However, such annotations are currently unavailable in the ECG–report datasets used in our study. We are actively seeking collaborations with clinical institutions to establish a dedicated dataset with clinician-validated, diagnosis-specific waveform evidence annotations, which we believe would be a valuable resource for the community.
In the meantime, to provide independent quantitative evidence, we evaluate ECG-EGR on LUDB v1.0.1, a dataset comprising 200 twelve-lead ECG recordings with expert-delineated P-wave, QRS-complex, and T-wave boundaries. By comparing the learned Event supports against these expert annotations, we assess whether our representations capture clinically meaningful waveform structures without relying on Event-level supervision. The results have been added to Appendix C.3.
(1) Agreement with Expert-Annotated Waveform Regions (Appendix C.3.1).
We extract Event supports using the frozen Stage-I ECG encoder and CED; expert annotations are never used for training, parameter selection, or inference. For each recording, we aggregate the supports of all active Events into a lead-time localization map and compare it against expert annotations. AP and AUROC are computed on the 40-ms encoder grid (a bin is positive when at least 50% overlaps an annotated region), while soft Dice and soft IoU are computed at the original 500-Hz resolution. Mean instance coverage measures the aggregate Event support within each annotated waveform interval. All metrics are macro-averaged across recordings.
Table R1. Agreement between ECG-EGR Event supports and expert annotations on LUDB.
The strongest agreement is observed for QRS complexes (AP 0.61, AUROC 0.84, soft Dice 0.47), followed by T and P waves. These results provide independent expert-annotation-based evidence that the learned Event supports capture physiologically meaningful ECG waveform structures and exhibit consistent localization correspondence across different physiological components.
(2) Temporal Null-Control Analysis (Appendix C.3.2).
To assess whether the observed agreement depends on the original temporal alignment, we compare the Event supports against two within-record controls, each repeated 32 times. Circular Shift shifts all Event supports together in time, preserving support mass, lead composition, and temporal continuity. Time Permutation applies the same random temporal permutation to all Events and leads, disrupting temporal order while preserving their joint structure.
Table R2. Comparison of original ECG-EGR Event supports with temporal null controls on LUDB.
ECG-EGR consistently outperforms both temporal null controls across all three waveform components, demonstrating substantially stronger agreement with expert-annotated ECG regions. For QRS complexes, the original Event supports achieve 6.1–6.8 times the AP (0.61 vs. 0.10/0.09) and 7.8–9.4 times the soft Dice (0.47 vs. 0.06/0.05) of the controls. These substantial improvements provide strong evidence that ECG-EGR learns temporally grounded Event supports aligned with physiologically meaningful waveform structures, rather than relying solely on incidental overlap or the overall support distribution.
We also recognize the importance of rigorous clinical validation of finding-level provenance. The LUDB evaluation compares aggregate supports of all active Events with expert-annotated waveform regions, rather than finding-specific retrieved evidence with clinician-annotated diagnostic locations. Nevertheless, these results provide valuable independent evidence that our learned Event supports are meaningfully aligned with physiological waveform structures. We agree that diagnosis-specific expert annotations would enable a more comprehensive assessment of finding-level provenance, and regard such clinician-guided validation as an important next step in our efforts to strengthen the clinical reliability and interpretability of ECG-EGR.
We have added these analyses to Appendix C.3.1–C.3.2 (Tables 12–13, lines 1393–1457).