- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes QRAFT, a self-supervised framework for physiological time-series learning that uses local reliability estimates to determine which ECG and PPG patches should enter the encoder and which should become reconstruction targets. The method uses a weakly supervised quality estimator to generate patch-level reliability scores, followed by a shared encoder that combines information from ECG and PPG. It also uses temporal, spectral, and contrastive objectives for representation learning. The authors evaluate the method through reconstruction experiments, blood-pressure estimation, cross-dataset transfer, and quality-stratified comparisons. The experiments also include difficulty-matched random masking and factorial analysis to examine the contribution of reliability-conditioned masking and multimodal fusion.
Critical strengths
-
The paper proposes a clear local evidence selection idea. It uses a patch-level reliability proxy to determine which ECG and PPG patches may enter the encoder and which become reconstruction targets. I think this is a good contribution because the method explicitly considers local signal quality during representation learning.
-
Although there is a weakness regarding the use of coarse expert labels, as discussed below, the authors also report inter-rater agreement for those labels. This is a useful disclosure of annotation reliability and the uncertainty associated with weak supervision.
-
The experimental section is quite comprehensive. The authors compare the method with several baselines and provide clear quality-stratified blood-pressure performance results. They also include difficulty-matched masking and factorial experiments to examine the contributions of different components.
-
It is also nice to see that removing quality perception leads to worse performance in Table 3. This is consistent with the hypothesis that local quality information contributes to the model's performance beyond simply increasing model capacity.
Critical weaknesses
-
There is a little bit of overclaiming regarding patch-level reliability. The reliability estimator is not directly supervised with patch-level artifact annotations. Instead, the reliability scores are learned from coarse record-level expert labels and then used to select patches for masking. Therefore, the reported quality-estimation accuracy does not directly establish that the selected patches coincide with actual artifact intervals. I think it would be better if the authors provided patch-level annotations or a controlled corruption experiment with known artifact locations to evaluate the reliability of the selected patches. I understand that coarse labels may be the best available supervision during training, but from an evaluation perspective, a more direct ground truth would make the results more convincing. The difficulty-matched masking and factorial comparisons support the claim that the proposed selection policy contributes to performance gains. However, these experiments do not establish whether the gains come specifically from accurate artifact localization or from other properties of the selection policy. The paper already evaluates robustness under synthetic corruption, but that is different from directly measuring patch-level localization accuracy.
-
There is a potential problem around lines 209–211. The method masks low-reliability patches but computes reconstruction loss against the recorded waveform, which may contain the artifact that triggered the masking. The authors explicitly state that the reconstruction targets include any artifacts present in the original observations. Therefore, lower reconstruction error against the recorded patches does not necessarily mean that the model recovers the underlying clean ECG or PPG signal. There are several things the model could be learning through this loss, and it is difficult to distinguish waveform prediction from physiological restoration. It would be better if the authors included a controlled corruption experiment with a known clean signal, so that reconstruction performance could be evaluated separately from the recovery of physiologically correct waveforms.
-
Figure 2 is really difficult to read. It contains four panels, and each panel is extremely dense. The architecture and the relationships between components are hard to follow. I think the authors could improve the figure by simplifying the diagrams or separating some of the components. The presentation could be polished further to make the method easier to understand.
-
Regarding the experimental setup, the authors use 1,000 subjects from VitalDB for self-supervised pretraining. I would have expected a larger and more diverse subject pool for a general physiological representation-learning framework. However, the number of subjects alone does not establish that the dataset is insufficient, especially because each subject can provide multiple recording segments. My concern is whether the reported performance and generalization would remain stable with a larger and more diverse pretraining population. A dataset-size ablation or additional pretraining data could help clarify this.
-
I do not fully understand the purpose of Equation (9). The authors explicitly state that it does not introduce a mutual-information term into the training objective. Therefore, the equation appears to provide a theoretical interpretation rather than something directly optimized by the model. I understand that an interpretation can still be useful, but its relevance to the proposed method is not explained clearly enough. The authors could explain more directly how this information-theoretic bound motivates the reliability-conditioned masking strategy and what additional insight it provides beyond the existing reconstruction objective.
Questions for authors
The following questions refer to the weaknesses discussed above.
-
Could the authors clarify how accurately the learned patch-level reliability scores identify actual artifact intervals? Is there evidence from patch-level annotations or controlled corruption with known artifact locations?
-
Given that the reconstruction targets may contain artifacts, how should the reported reconstruction improvements be interpreted? Is there evidence that the model can recover physiologically correct signals rather than simply predict the recorded waveforms?
-
Could the authors clarify whether the performance gains remain stable with a larger or more diverse pretraining population? Is there any evidence of how performance changes with the number of pretraining subjects?
4 comments
Response to Reviewer P1yQ (Part 2/2: W5, Q1–Q3)
W5: Equation (9) is an information-theoretic interpretation rather than an optimized mutual-information term. How does it motivate reliability-conditioned masking, and what insight does it add beyond reconstruction?
A5: For a fixed mask policy and fixed-variance Gaussian decoder, reducing squared reconstruction error raises a variational lower bound on information retained about withheld observations. Reliability-conditioned masking chooses both the visible evidence and the prediction targets: reliable patches supply context for predicting withheld waveform content.
The insight from Equation (9) is that mask selection determines both the evidence available to the encoder and the content the representation is trained to predict. Equation (8) defines the training objective. Table 2 and the shared-mask evaluation test the masking strategy empirically.
Revision locations.
- Main text §3.3 | p. 5 — Information-theoretic interpretation of reconstruction.
- Supplement §C.2 | p. 12, Table S18 — Empirical comparison on shared reconstruction targets.
Q1: Could the authors clarify how accurately the learned patch-level reliability scores identify actual artifact intervals? Is there evidence from patch-level annotations or controlled corruption with known artifact locations?
A6: The known-location experiment directly evaluates the learned patch scores. Each held-out 10-second PPG segment contains 20 half-second patches, with synthetic motion artifacts injected into four. FGQA achieves AUPRC 0.80 across 20,000 patches, including 4,000 injected positives; the random-ranking reference is 0.20. These results assess localization of controlled synthetic artifacts, complementing the record-level expert supervision used to train FGQA.
Revision locations.
- Supplement §B.1 | p. 7 — Patch-level localization evaluation and results.
Q2: Given that the reconstruction targets may contain artifacts, how should the reported reconstruction improvements be interpreted? Is there evidence that the model can recover physiologically correct signals rather than simply predict the recorded waveforms?
A7: The recorded-waveform results measure prediction of observed PPG. To evaluate recovery separately, we use paired pre-injection PPG as the reference and score predictions within the injected artifact regions.
R3-Table2: Paired clean-reference RMSE within synthetically corrupted regions, normalized by the Random-mask result.
| Pretraining method | Relative clean-reference RMSE | Reduction versus Random mask |
|---|---|---|
| Random mask | 1.00 | Reference |
| QRAFT | 0.91 | 9% |
The 9% reduction supports recovery toward the pre-injection waveform under this controlled protocol. The separate shared-mask comparison, 0.72 versus 0.82 RMSE, evaluates prediction of identical recorded-waveform targets.
Revision locations.
- Supplement §§C.2–C.3 | p. 12 — Shared-mask comparison and paired clean-reference recovery.
Q3: Could the authors clarify whether the performance gains remain stable with a larger or more diverse pretraining population? Is there any evidence of how performance changes with the number of pretraining subjects?
A8: R3-Table1 reports the available scale evidence with a fixed MIMIC-III fine-tuning subset. SBP MAE falls from 8.83 to 4.96 mmHg as the VitalDB fraction increases from 1% to 25%, and from 4.10 to 4.09 mmHg between 75% and 100%. Thus, increasing the pool improves downstream performance, with smaller changes near the full 1,000-subject pool. This experiment evaluates pretraining size within VitalDB.
Revision locations.
- Supplement §E | p. 19, Table S34 — Performance across seven fractions of the VitalDB pretraining pool.
The revisions clarify Equation (9) and provide controlled evidence for artifact localization, clean-reference recovery, and pretraining-scale effects. We thank Reviewer P1yQ for the constructive suggestions and welcome further questions.
Thank you for running the controlled experiments I asked for. The synthetic artifact-localization result (AUPRC 0.80 vs 0.20 for random ranking) and the clean-reference recovery evaluation (9% improvement over random masking) address my two main questions directly, and the dataset-size ablation is useful. My remaining concerns are narrower:
- Both new experiments are synthetic, so patch-level accuracy on real annotated artifacts is still open; and
- The scale ablation varies the fraction of the same 1,000-subject cohort, so generalization to a larger and more diverse population is untested
I am keeping my score at 3 (weak accept) because I feel like a straight 4 is not up to the quality of this paper, but maybe in my mind the score is up to around 3.4.
Response to Reviewer P1yQ: Real-signal validation and population extension
Thank you for confirming that the controlled localization and clean-reference experiments directly address your two main questions, and for recognizing the value of the size ablation. Your remaining concerns distinguish natural-artifact localization from local quality assessment, and broader-population pretraining from downstream transfer. We provide additional completed evidence and an update on the population extension below.
1. Validation on real artifacts beyond synthetic corruption.
A1: Real-signal expert-score validation. We additionally compare the current FGQA scores with expert assessments on real ECG and PPG. Three experts scored nine segments per modality, with 20 scored positions per segment on a 0–100 scale.
Follow-up Table 1: Expert absolute agreement and FGQA correlation with mean expert scores.
| Modality | Expert ICC(A,1) [95% CI] | FGQA–expert correlation |
|---|---|---|
| ECG | 0.871 [0.694, 0.950] | 0.94 |
| PPG | 0.939 [0.919, 0.954] | 0.97 |
ICC confidence intervals use 10,000 whole-segment bootstrap resamples. On this small real-recording subset, the correlations provide evidence of agreement between FGQA and expert-rated local signal quality. This complements the known-location synthetic experiment; localization against annotated natural-artifact intervals remains a separate evaluation.
Physiological-feature preservation. The existing reconstruction analysis also measures identifiable waveform features:
Follow-up Table 2: Physiological-feature preservation under reconstruction.
| Metric | Random-mask | QRAFT |
|---|---|---|
| Systolic peak retention (%) ↑ | 91.7 ± 0.78 | 95.2 ± 0.28 |
| Diastolic peak retention (%) ↑ | 89.5 ± 1.03 | 94.1 ± 0.37 |
| Heart-rate error (bpm) ↓ | 2.42 ± 0.08 | 1.35 ± 0.05 |
The peak-retention and heart-rate measurements add physiological-feature evidence to the paired clean-reference recovery result.
Revision locations.
- Supplement §B.2 | p. 6, Table S9 — Expert-score agreement and FGQA validation.
- Supplement §C | p. 7, Table S13 — Physiological-feature preservation.
2. Larger and more diverse pretraining populations.
A2: The reported size ablation characterizes scaling within the selected 1,000-subject VitalDB cohort. Evaluating pretraining on a larger and more diverse population is the next stage of this work.
Additional completed transfer experiment. We further evaluate transfer of the pretrained encoders to heartbeat classification on the MIT-BIH Arrhythmia Database. Each encoder is frozen, and a linear classifier predicts the five AAMI classes (N, S, V, F, Q).
Follow-up Table 3: MIT-BIH frozen-encoder classification; mean ± SD over ten paired seeds.
| Pretraining method | Accuracy (%) ↑ | Macro-F1 (%) ↑ |
|---|---|---|
| Random-mask reconstruction | 94.2 ± 0.8 | 85.1 ± 1.2 |
| DM-Rand | 94.8 ± 0.7 | 86.0 ± 1.1 |
| CPC | 95.1 ± 0.7 | 86.6 ± 1.0 |
| JEPA | 95.4 ± 0.6 | 87.2 ± 0.9 |
| QRAFT | 95.9 ± 0.5 | 88.1 ± 0.8 |
Methods share the pretraining data and matched training budgets. The fixed patient-independent split contains 22 training records and 21 test records. Training uses class weighting; testing retains the original class distribution.
QRAFT improves Accuracy by 1.7 percentage points and Macro-F1 by 3.0 percentage points over random-mask pretraining. This provides complementary evidence of heartbeat-class information accessible through a linear classifier on a separate real ECG dataset.
The original BP-transfer experiments evaluate the VitalDB-pretrained model on MIMIC-III, UCI, and the in-house cohort (IHC); the MIT-BIH experiment adds a different downstream task, providing complementary transfer evidence across datasets and tasks.
Population-extension progress. As a continuation of this work, we have collected public physiological data covering more than 10,000 participants from MIMIC, VitalDB, MESA, UCI, and other resources, alongside our in-house multicenter database. Pretraining on this expanded collection requires a longer training cycle, and preliminary results are not yet available.
Revision locations.
- Supplement §E.2 | p. 18, Tables S34–S35 — MIT-BIH classification results and patient-independent split.
- Supplement §E.3 | p. 21, Table S41 — VitalDB pretraining-size ablation.
Thank you for recognizing our work and the additional evidence. Whatever the final evaluation outcome, your thoughtful comments have helped us substantially improve the experimental evaluation and explain the findings more clearly. We appreciate the time and care you have devoted to this discussion, and wish you continued success in your research.
Response to Reviewer P1yQ (Part 1/2: W1–W4)
Thank you for the constructive comments on patch reliability, reconstruction targets, pretraining scale, and presentation. We address W1–W5 first, followed by Q1–Q3.
W1: Record-level quality supervision and QA accuracy do not establish patch-level artifact localization. Please provide patch annotations or controlled corruption with known locations; difficulty-matched and factorial comparisons address a different question.
A1: Experts provide record-level quality labels; FGQA learns half-second instance scores through multi-instance learning. We therefore evaluate localization directly using known synthetic artifact locations, separately from QA classification and downstream robustness.
In each held-out 10-second PPG segment, we inject motion artifacts into 4 of 20 half-second patches. Across 20,000 test patches, including 4,000 positives, FGQA achieves AUPRC 0.80. Positive prevalence is 0.20, the random-ranking reference. This controlled evaluation directly tests whether the learned scores identify the injected regions.
Revision locations.
W2: Reconstruction targets include artifacts in the recorded waveforms. Lower reconstruction error does not establish clean physiological recovery. Please evaluate prediction of recorded observations separately from recovery against a known clean signal.
A2: The policy-specific reconstruction evaluation (original Table 2) uses recorded PPG as the target. In the shared-mask reconstruction evaluation, all methods predict identical randomly withheld patches at a 38.5% ratio, with overall RMSE of 0.72 for QRAFT versus 0.82 for Random mask. In the paired clean-reference evaluation, we score regions with controlled synthetic motion artifacts against their pre-injection PPG. With the Random-mask clean-reference RMSE normalized to 1.00, QRAFT reaches 0.91, a 9% reduction. The clean-reference score measures recovery under the specified corruption protocol and complements the recorded-waveform evaluation.
Revision locations.
W3: Figure 2 is dense, and the relationships between its four panels are difficult to follow. Please simplify the diagrams or separate components to improve readability.
A3: Figure 2 now presents quality scoring, patch selection, shared encoding, and source-specific reconstruction as a single workflow. It makes the role of reliability explicit: selected patches provide visible context, and source-specific decoders predict the withheld waveform content. Supplementary Figure S1 provides the detailed module diagram.
Revision locations.
W4: Pretraining uses 1,000 VitalDB subjects. Would performance remain stable with a larger or more diverse population? A dataset-size ablation or additional pretraining data would clarify scale sensitivity.
A4: We vary the fraction of the selected 1,000-subject VitalDB pretraining pool while keeping the labeled MIMIC-III fine-tuning subset fixed.
SBP MAE decreases as the VitalDB pool grows, reaching 4.10 mmHg at 75% and 4.09 mmHg at 100%. The sweep shows diminishing gains as the pool approaches 1,000 subjects and evaluates pretraining size within this cohort.
Revision locations.