- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper proposes a two-stage framework for ECG denoising under distribution shift. First, a memory is learned from clean ECGs only, and the decoder can reconstruct the signal only through this memory. Then, with memory and decoder frozen, the encoder bottleneck and the router are adapted so that noisy inputs access the memory as the corresponding clean inputs would (Memory Access Alignment).
Critical strengths
The overall idea of the paper is interesting, in particular, the separation between what the model knows about clean ECGs (stored in a memory curated from clean signals only) and how corrupted inputs access this knowledge. In principle, this method could be applied to other physiological signals and other restoration tasks.
Critical weaknesses
-
Clarity. The description of the memory-curation stage is imprecise, which makes the method difficult to understand. The notation is overloaded: denotes both the number of retrieved slots and the key dimension, both the signal length and the teacher, and both the number of slots and the noisy input. The temporal structure of the latent representation is also unclear. Several other essential details are missing, including the dimension of z_T, the router architecture, which ECG lead is used, and how the memory is initialized and trained through the top-k selection. Finally, the claims that the memory “curates” or “reflects clean ECG structure” are not supported by any analysis of the learned slots. Moreover, in the tables (which also lack a uniform style), values are highlighted in different colors without any guidance.
-
Definition of the OOD setting. The paper never clearly specifies what “out-of-distribution” refers to: a shift in the noise, in the population, or in the acquisition setting. On QTDB, the noise comes from the same NSTDB recordings used in training (only the channel differs). The shift is therefore mainly in population and acquisition, not in corruption. On SIMEMG, population, acquisition device, and contamination change simultaneously, and the EMG contamination is similar to the muscle-artifact noise already seen during training. As a result, the claim that MAA improves robustness to “shifts in signal and corruption characteristics” cannot be verified. It remains unclear which type of shift the method actually addresses.
-
Unclear comparison with previous approaches. The work is not clearly positioned and it is unclear where it stands in comparison to the baselines.
Questions for authors
-
Figure 1: The synthetic noise applied to MITDB and QTDB datasets is dependent on the ECG itself since it is scaled relative to each window's ECG power. Therefore, ECGs with different amplitudes receive different absolute amounts of noise. Moreover, noise and ECGs also share frequency bands, so how separable they are depends on the ECGs themselves. Moreover, MITDB and QTDB differ in sampling rate, acquisition settings, and clinical composition. In short, Figure 1 is presented as isolating a shift in the clean ECG under a shared noise source, but it actually mixes together different sources of variation between the datasets. Which of these factors explains the degradation?
-
Statistical significance: It is not clear whether the reported improvements are statistically significant. Several of the claimed gains fall within one standard deviation. Moreover, in Table 3, frozen access with the LUNet backbone (Stage 1 only, no adaptation) achieves an RMSE of 4.5787 and a CC of 0.9785 on SIMEMG. This outperforms LUNet + MAA and every baseline in Table 1. In other words, on the only dataset with real contamination, the proposed Stage 2 degrades performance. Nevertheless, frozen access is not included in Table 1, and Section 3.1 states that LUNet + MAA “achieves the best mean SIMEMG performance across all four metrics among the evaluated methods”. Could the authors include frozen access in Table 1, revise this claim accordingly, and explain why memory-access alignment hurts reconstruction under real contamination?
-
Disentangling the source of the shift: The evaluation mixes several factors: population, acquisition methods, noise type, and noise level. In the current state, it is impossible to determine what the document is robust to. Moreover, although the test sets include several SNR levels and artifact types, the reported results are averaged over all of them. An ablation study should vary one factor at a time:
- Varying the noise only, same population, but different noise between training and test (e.g., training on baseline wander and testing on electrode motion).
- Different populations for training and test, with the same noise configuration (same artifact type and SNR).
- Results reported separately for each SNR level and artifact type.
13 comments
Response to Question 2: Frozen access missing from Table 1 and MAA under real contamination and degradation analysis.
Frozen access missing from Table 1
We appreciate the reviewer's observation. We acknowledge that LUNet with frozen memory access outperforms LUNet + MAA on SIMEMG, as explicitly reported in Table 3. We would like to clarify the objectives of Table 1. Table 1 is designed to compare the complete MAA framework against the original backbones and existing ECG denoising methods, whereas Table 3 presents an ablation study of internal framework configurations to isolate the contribution of Stage 2 memory-access alignment. Accordingly, frozen memory access is reported in Table 3 rather than Table 1, reflecting the distinct evaluation objectives of these two tables. The statement in Section 3.1 that LUNet + MAA achieves the best mean SIMEMG performance across all four metrics refers specifically to the methods evaluated in Table 1, rather than all configurations considered in the ablation study. It does not imply that Stage 2 consistently outperforms frozen memory access. Nevertheless, to avoid ambiguity, we will clarify this distinction in Section 3.1.
Memory-access alignment under real contamination and degradation analysis
We agree that Stage 2 alignment does not universally improve frozen memory access under real contamination. On SIMEMG, alignment improves ImputeECG reconstruction but deteriorates LUNet performance. To investigate potential factors contributing to this difference, we examined the SIMEMG acquisition protocol and conducted a controlled experiment (Appendix A.17).
SIMEMG dataset characteristics: Unlike synthetic contamination, where noise is added to the same clean ECG waveform, SIMEMG records noisy ECGs from wrist/finger electrodes and simultaneous cleaner references from the shoulder/upper-arm region. The acquisition method assumes similar cardiac potentials along relaxed arms, with EMG contamination generated primarily in the hands (Atanasoski et al., 2023). During dataset preparation, reference recordings with excessive estimated EMG contamination were rejected; nevertheless, small residual EMG noise may remain in retained references and affect denoising-method comparisons.
Differences in electrode placement and potential residual contamination in SIMEMG references may contribute to LUNet's deterioration, since Stage 2 is trained on noisy–clean pairs sharing the same underlying ECG waveform. We therefore designed a controlled experiment to examine whether SIMEMG-derived contamination reproduces the deterioration when noisy inputs and clean targets share the same underlying waveform, using both LUNet and ImputeECG.
Controlled SIMEMG-derived contamination versus real SIMEMG: We extracted residuals from paired SIMEMG recordings, scaled them relative to clean QTDB ECGs, and added them to QTDB signals while retaining the original clean targets. We refer to this evaluation setting as QTDB with additive SIMEMG-derived residuals (controlled). For each backbone, we evaluated frozen-access and MAA models using their respective unchanged weights on both the controlled setting and real SIMEMG, without retraining or adaptation. The results are summarized below.
| Setting | Backbone | Frozen RMSE ↓ | MAA RMSE ↓ | Frozen CC ↑ | MAA CC ↑ |
|---|---|---|---|---|---|
| QTDB with additive SIMEMG-derived residuals (controlled) | LUNet | 0.2717 | 0.2258 | 0.7704 | 0.7888 |
| QTDB with additive SIMEMG-derived residuals (controlled) | ImputeECG | 0.6646 | 0.4088 | 0.6716 | 0.6767 |
| Real SIMEMG | LUNet | 4.5787 | 5.2883 | 0.9785 | 0.9730 |
| Real SIMEMG | ImputeECG | 8.2904 | 5.8433 | 0.9275 | 0.9602 |
Under controlled QTDB contamination, Stage 2 alignment reduces LUNet RMSE by 16.89% and improves CC by 0.0184 relative to frozen access. In contrast, on real SIMEMG, alignment increases LUNet RMSE by 15.50% and decreases CC by 0.0055. ImputeECG benefits under both settings, reducing RMSE by 38.49% and 29.52%, respectively.
These results show that LUNet's deterioration on real SIMEMG is not reproduced by transferring SIMEMG-derived residuals to clean QTDB signals. Thus, SIMEMG-derived residuals do not necessarily cause harmful alignment under the evaluated additive contamination setting. Moreover, this contrast is consistent with the possibility that differences in acquisition conditions and noisy–reference signal correspondence influence alignment effectiveness. However, because the controlled and real settings also differ in their underlying ECG signals and reference measurements, the experiment does not isolate the specific factor responsible for the contrasting outcomes.
Reference: Atanasoski, V., et al. (2023). A Database of Simultaneously Recorded ECG Signals With and Without EMG Noise. IEEE Open Journal of Engineering in Medicine and Biology, 4, 222–225. https://doi.org/10.1109/OJEMB.2023.3330295
Response to Weakness 2: Definition of the OOD setting
Definition of the OOD setting.
We thank the reviewer for highlighting the need to distinguish different sources of distribution shift. We agree that population, acquisition, and corruption shifts should not be treated interchangeably. We clarify that our evaluation considers two distinct OOD settings:
-
Cross-database ECG shift (QTDB). Models are trained on MITDB and evaluated on QTDB, which differs in recording cohort and acquisition characteristics. Both datasets employ the same NSTDB-based synthetic contamination protocol, using different noise channels for training and evaluation. Thus, QTDB evaluates cross-database ECG generalization under a shared corruption-generation protocol, rather than generalization to an entirely unseen noise source. Stage 2 MAA improves over frozen memory access across all seven evaluated synthetic noise conditions for both backbones (Appendix A15). However, these results do not independently isolate the effects of population and acquisition differences.
-
Composite real-world shift (SIMEMG). SIMEMG differs from the source setting in recording population, acquisition configuration, and naturally occurring contamination. Although its EMG contamination belongs to an artifact category represented during source training, the measured contamination characteristics differ substantially from those of the synthetic source noise. Thus, SIMEMG evaluates generalization under a composite real-world shift, rather than an entirely unseen artifact category. Under this setting, Stage 2 exhibits backbone-dependent behavior: it improves ImputeECG but degrades LUNet relative to frozen memory access. We acknowledge this limitation and investigate its reconstruction behavior in Appendix A17.
Scope of generalization. Our results demonstrate that MAA improves reconstruction on QTDB under a shared synthetic contamination protocol and across the evaluated synthetic noise conditions. They do not establish universal robustness to unseen corruption or independently isolate population, acquisition, and noise effects. Appendix A16 additionally evaluates cross-noise transfer during Stage 2 alignment. We will revise the OOD definitions and generalization claims throughout the manuscript to reflect these distinctions.
Response to Question 1: Clarification of Figure 1, and Additional Cross-Dataset Degradation Analysis of Figure 1
We thank the reviewer for the constructive feedback.
Clarification of Figure 1
We would like to clarify that Figure 1 aims to illustrate the cross-database generalization limitations of existing ECG denoisers. We acknowledge that comparing MITDB-trained and QTDB-trained models on identical QTDB test recordings under a shared NSTDB-based corruption protocol does not isolate differences in clean ECG characteristics. Instead, it reflects the composite distribution shifts that may occur in practical deployment, where patient populations, ECG morphology, acquisition conditions, and noise characteristics may vary simultaneously. To further investigate the observed degradation, we explore cross-dataset noise characteristics and examine amplitude-normalized reconstruction errors and performance gaps across ECG amplitude, SNR, spectral overlap, and artifact types. For the additional experiments, we retain the same MITDB training, validation, and test splits as in the main experiments. The 90 QTDB recordings used for zero-shot OOD evaluation are further partitioned at the recording level into training, validation, and test subsets, with 15 recordings held out for testing. LUNet and ImputeECG are trained separately on MITDB and QTDB and evaluated on identical corrupted QTDB test inputs across three seeds (42, 43, and 44).
Noise characterization across datasets
We analyzed noise characteristics across the MITDB, QTDB, and SIMEMG test sets. MITDB and QTDB exhibit nearly identical input SNR distributions (7.50 ± 5.59 dB), high-frequency noise power fractions (15.90% vs. 15.88%), and envelope coefficients of variation (0.5907 vs. 0.5901), but differ substantially in mean noise RMS (0.2290 vs. 1.5326). This indicates that the shared synthetic-noise protocol controls relative corruption severity, while signal-dependent scaling yields different absolute noise amplitudes across datasets. In contrast, SIMEMG exhibits a distinct contamination profile, particularly a substantially higher high-frequency power fraction (60.97%).
Cross-database degradation after amplitude-normalized evaluation
We compared MITDB-trained and QTDB-trained LUNet and ImputeECG models on the same 15 held-out QTDB recordings. Both models exhibit higher reconstruction errors when trained on MITDB, with paired RMSE differences of 0.2626 (95% CI: [0.0822, 0.4953]) for LUNet and 0.2054 (95% CI: [0.0597, 0.3954]) for ImputeECG. Importantly, the performance gap remains when reconstruction errors are measured relative to clean ECG amplitude using PRD, with differences of 5.05 percentage points (95% CI: [3.28, 6.87]) and 3.38 percentage points (95% CI: [1.78, 5.04]), respectively. The PRD gap also increases across clean ECG amplitude quartiles for both architectures. Thus, the degradation is not merely due to measuring absolute errors, although amplitude differences cannot be established as its cause.
Cross-database degradation across corruption characteristics
We further examined performance gaps across ECG–noise spectral overlap, input SNR, and artifact types using the same QTDB test set and three training seeds. Both architectures exhibit positive mean RMSE gaps across all evaluated noise types and SNR levels. The gaps increase under stronger corruption, from 0.0796 at 15 dB to 0.5310 at 0 dB for LUNet, and from 0.0566 to 0.4215 for ImputeECG. Degradation also persists across all evaluated artifact categories, with the largest gaps under baseline wander for LUNet (0.3595) and electrode motion for ImputeECG (0.2362). In contrast, the performance gap does not exhibit a consistent increasing relationship with ECG–noise spectral overlap. These results indicate that cross-database degradation is not restricted to a particular noise type or severity level, while stronger corruption is associated with larger performance gaps.
These analyses show that MITDB and QTDB share similar relative noise characteristics but differ in absolute noise amplitudes, while SIMEMG exhibits a different contamination profile. Cross-database degradation persists under amplitude-relative error evaluation and across the tested noise types and SNR levels, with larger absolute RMSE gaps under stronger corruption and no consistent relationship with spectral overlap. These findings clarify that QTDB represents a composite cross-database shift under a shared synthetic-noise protocol, whereas SIMEMG additionally involves naturally acquired contamination. Although SIMEMG shares characteristics with NSTDB muscle artifact, its higher high-frequency power fraction distinguishes it from the aggregate synthetic-noise test distribution, not necessarily from muscle artifact alone. These analyses do not isolate the individual causal contributions of ECG morphology, acquisition conditions, and signal-dependent noise scaling. We have revised the Figure 1 caption and accompanying discussion to clarify this interpretation, with additional analyses provided in Appendix A.15.