- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
PhysioTrace is a hierarchical explanation framework that makes zero-shot ECG predictions traceable from diagnosis to clinical observation to waveform evidence. Its central idea is to use task-agnostic clinical observations as a shared intermediate representation: a learnable projection maps both ECGs and diagnostic prompts into a common observation coordinate system, trained with matching and reconstruction losses, so that a diagnosis decomposes into observation-level contributions. Each observation is then grounded in the multilead signal via observation-conditioned counterfactual attribution, which ranks lead-time waveform regions by their evidence for that observation. Because the observation vocabulary is derived from real ECG reports rather than diagnosis labels, explanations are intended to transfer across diagnoses and datasets. The method operates on frozen ECG-language backbones and is evaluated on zero-shot classification retention, intervention experiments, and grounding.
Critical strengths
- Using a task-agnostic observation space as the intermediate layer is a well-chosen design. It makes explanations reusable across diagnoses and datasets rather than bespoke per label, which is what allows a single projection to serve multiple backbones and tasks. This is the element that gives the framework scope beyond a single-model interpretability trick, and it is the main reason I view the paper as above clear rejection.
- Joining semantic and signal-level explanation into one chain addresses a real gap. Attribution-only methods localize evidence on the waveform without saying what clinical observation it supports, while concept-based methods identify supporting observations without patient-specific localization. Connecting the two into an auditable diagnosis→observation→waveform path is a genuine contribution if the links hold.
Critical weaknesses
- The report-derived observation space may be systematically incomplete, and the risk is neither discussed nor mitigated. The vocabulary is parsed from real ECG reports, so it can only encode what reports happen to state. It has been reported that a substantial share of ECG reports omit detailed waveform descriptions (e.g., FG-CLEP, Li et al., 2025), and the natural remedy — supplying LLM-generated, retrieval-grounded cardiological text as additional supervision (e.g., ESI, Yu et al., TMLR 2024) — is not discussed. Since the paper itself notes that evidence outside the vocabulary may remain unrepresented, completeness directly bounds explanation fidelity: an observation absent from the vocabulary cannot be recovered by any downstream attribution. MERL, D-BETA, MELP, SGERA, and ZETA are all cited, which makes the omission of this particular strand conspicuous. This is the weakness I would most want addressed, as it bears on soundness rather than positioning.
- The evaluation does not establish that the explanation links are faithful. Counterfactual perturbation is applied to a frozen cross-modal encoder, and perturbed signals can readily fall outside the distribution that encoder was trained on, in which case attribution maps reflect out-of-distribution artifacts rather than true evidence; no diagnostic for this is reported. Compounding it, the central cost of the method — the change in zero-shot performance relative to the frozen backbone — is hedged as "largely preserves" rather than quantified per dataset and backbone, and the paper concedes that clinical validity of the observation space requires independent evaluation that is not provided. A framework whose contribution is explanation quality needs the price and the fidelity both stated numerically.
Questions for authors
- How do you ensure the observation vocabulary is complete, given that many ECG reports lack explicit waveform descriptions? Was any LLM-based or retrieval-augmented text enhancement applied to supplement the report corpus?
- How does your observation↔waveform grounding differ from prior fine-grained alignment between localized waveform segments and individual clinical tags? What does the counterfactual stage add beyond what such alignment already provides?
- Can you show that counterfactually perturbed ECGs remain in-distribution for the frozen encoder — e.g., via embedding-space distance, reconstruction diagnostics, or a comparison against in-distribution controls?
- Please quantify the zero-shot performance change versus the frozen backbone, per dataset and per backbone, rather than as an aggregate hedge.
- Was the observation vocabulary validated by clinicians, or checked against a curated cardiology ontology?