- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses structural failures in ECG delineation under noisy conditions. While point-level F1 scores for segmentation masks may appear acceptable, the outputs often contain fragmented or misordered P, QRS, and T waves, which renders downstream interval measurements unreliable.
The authors make two core contributions. First, they propose a sequence legality metric that directly evaluates whether output waveforms follow the physiological P → QRS → T order and satisfy the proposed structural ordering criterion. Second, they replace the conventional discrete one-hot mask target with a continuous phase-field representation, which embeds structural constraints into the label representation itself. A conditional diffusion model is then trained to map noisy ECG inputs to valid phase-field segmentations.
Experiments are conducted on the external QTDB test set across a 12-condition noise grid, systematically comparing a discriminative anchor model, traditional rule-based post-processing, one-hot-target diffusion, and the proposed phase-field diffusion. The paper further includes extensive ablation analyses: K-sample scans, mean aggregation behavior, wave-deletion audits, interval error quantification, multi-seed robustness, decoder control experiments, and cross-rhythm / cross-domain probes.
Critical strengths
- The paper raises a valid and important concern about evaluation practices in ECG delineation. Standard point-level F1 scores do not capture structural failures like fragmented or misordered waves, which directly compromise downstream interval measurements. The proposed sequence legality metric and beat-level audit complement conventional overlap-based metrics with a clinically relevant dimension.
- The empirical evaluation is comprehensive and well-controlled. The authors test on an external dataset across a 12-condition noise grid, and support their claims with extensive ablation studies including K-sample scans, mean aggregation behavior, wave-deletion audits, interval error quantification, multi-seed robustness, and decoder controls. This level of detail improves transparency and makes it easier to isolate the source of observed effects.
Critical weaknesses
- The headline 0.994 legality result is driven primarily by candidate selection rather than by the representation itself. At inference time, the method generates independent candidate outputs and selects the one with the fewest illegal grammar transitions. Since legality is exactly the primary metric used to report the improvement, the inference procedure effectively searches for outputs that score well on the evaluation criterion itself.
A breakdown of the gain sources makes this clear:
- Phase field, single draw (no selection): legality = 0.888
- Phase field, selected by legality: legality = 0.994
- Gain from candidate selection alone: ~10.6 percentage points
- Gain from one-hot to phase field at the same selection setting: only ~1.4 percentage points
The selection gain (+10.6 pp) is substantially larger than the representation step (+1.4 pp) at the operating point. This makes it difficult to attribute the headline 0.994 result primarily to the phase-field representation, and weakens the evidence for the paper's central claim that "structure lives in the representation."
- The legality metric has inherent limitations that are amplified by the selection mechanism. The grammar defines valid sequences as , making P waves optional. This means the metric does not penalize deletion of true P waves — in fact, deleting a true P wave can produce a more legal sequence. In addition, the grammar cannot express clinically real rhythms such as non-conducted P waves in second-degree AV block.
Critically, this same flawed grammar is used to select the best of candidates. The model is thus rewarded for grammar conformity even when the grammar itself does not match physiological ground truth. While the wave-deletion audit quantifies this behavior, it cannot fix the validity of the primary metric. In my view, this is a notable concern for a paper whose central claim is about structural correctness.
Questions for authors
- Please report results for single draw, mean aggregation, and legality-based selection side by side in the main comparison table. How much of the performance gain of phase field over one-hot remains when legality is not used to select among multiple samples?
- Could the authors use a selection rule that is completely independent of the legality metric (e.g., sorted by confidence or reconstruction error) and then report legality as an outcome? This would separate the structural robustness of the representation itself from metric-aligned search effects.
- How should the primary legality metric be interpreted for rhythms that cannot be expressed by the grammar (e.g., second-degree AV block)? It would be useful to report stratified results for grammar-compatible and grammar-incompatible ground-truth samples, to clarify the applicability boundary of the method across different rhythms.