- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates whether laboratory measurements can be reliably predicted from pretrained PPG representations. The results suggest that much of the predictive signal can be explained by measured patient characteristics, whereas ECG representations preserve more information after adjustment.
Critical strengths
S1: The paper raises an important question and examines it through a careful series of increasingly controlled analyses.
S2: The careful study design avoids patient overlap and accounts for related observations. The authors are also transparent about methodological corrections and appropriately cautious when the evidence is inconclusive, which strengthens the credibility of the work.
S4: The evaluation is comprehensive, and the target-derivative rule provides a useful safeguard against inappropriate covariate adjustment.
Critical weaknesses
W1: Laboratory test results are linked to waveforms by clinical encounter rather than by specimen collection time. The findings therefore support encounter-level associations more directly than associations with the patient’s physiological state at the time of measurement.
W2: The strongest ECG incremental result is based on a much smaller complete-case subset, which may differ systematically from the full cohort.
W3: The ECG interval labels are calculated from the same ECG waveform given to ECGFounder, whereas AnyPPG must infer them indirectly from PPG. The difference in interval prediction therefore reflects both representation quality and access to the source signal.
Questions for authors
Q1: Can any subset be aligned to specimen time, or should the claims be narrowed to encounter-level association?
Q2: How do the conclusions change when encoders with unresolved MC-MED exposure are excluded or ECG and PPG use matched inputs?
3 comments
Reference-Signal Access, Pretraining Exposure, and Matched ECG–PPG Comparisons
W3. Access to the reference signal
We interpret concept-prediction R² as information accessible from a specified encoder–input pair. The original patient-disjoint matched-segment experiment illustrates the reference-source dependence:
| Reference-feature group | AnyPPG R² | ECGFounder R² | HR-only R² |
|---|---|---|---|
| PPG morphology | 0.5342 | 0.1940 | 0.1858 |
| ECG intervals | 0.0951 | 0.4883 | 0.0529 |
These fixed-ridge readouts use the same concept-valid rows within each comparison. The original protocol uses the first aligned segment, with central eight-second PPG and ten-second ECG inputs; ECG is resampled from the archived 125-Hz signal. The directional pattern makes access to the reference signal explicit: each representation predicts its own modality's features more accurately. The expanded reciprocal evaluation covers both reference sources across four released encoders and six study-trained CNNs.
For target prediction, potassium supplies a reference measured independently of either waveform feature extractor. The matched CNNs below then test whether its ECG–PPG contrast remains when architecture, input support, and supervision are held fixed. These comparisons distinguish reference-feature accessibility from the clinically measured target association.
Q2. Pretraining exposure and matched inputs
Exact-release provenance records support MC-MED source exclusion for PaPaGei-S, Pulse-PPG, and ECGFounder; AnyPPG has documented exposure. Excluding AnyPPG leaves two additional PPG comparisons. Separately, the CNNs use identical 10-second, 125-Hz, single-segment inputs, architecture, and supervision, with a fixed 60-epoch endpoint across three seeds.
| Control | Comparison | Adjusted ECG−PPG r difference [95% CI] |
|---|---|---|
| Source-excluded releases, equal eight-second support | ECGFounder−PaPaGei-S | 0.2208 [0.1854, 0.2539] |
| Source-excluded releases, equal eight-second support | ECGFounder−Pulse-PPG | 0.2077 [0.1728, 0.2432] |
| Matched CNN, seed 0 | ECG−PPG | 0.0861 [0.0503, 0.1226] |
| Matched CNN, seed 1 | ECG−PPG | 0.0833 [0.0476, 0.1192] |
| Matched CNN, seed 2 | ECG−PPG | 0.0611 [0.0256, 0.0970] |
All contrasts use the common 6,037-encounter cohort and age/eGFR/BUN adjustment. The released-model adaptation preserves each model's sampling requirements; the CNNs match sampling as well as duration. The fixed-endpoint results replace the earlier evaluation-selected checkpoints. Provenance establishes documented source exclusion; individual pretraining identities are unavailable for direct matching. The conclusion applies to the tested encoders and matched CNNs on this potassium cohort; it does not establish a modality-wide information limit.
The added controls give consistent evidence across evaluation populations, alternative PPG encoders, and three matched training runs. They directly address whether the potassium contrast depends on interval-complete selection, AnyPPG exposure, or the original input and architecture differences.
Thank you again for your thoughtful feedback. We would appreciate your assessment of whether our responses and additional analyses adequately address your concerns about temporal alignment, complete-case selection, reference-signal access, and pretraining exposure. Please let us know if you have any remaining concerns or would find further clarification or evidence helpful. We would be happy to respond during the remaining discussion period. If we have resolved your concerns, we would be grateful if you would reconsider your overall assessment and rating in light of the additional evidence.
Temporal Alignment and Sensitivity to Complete-Case Selection
Thank you for the careful assessment of timing, selection, and model comparability. The additional analyses show that ECG's potassium increment persists in interval-incomplete encounters and under matched input and training conditions. We address each concern below. Here, r denotes Spearman correlation, Δr denotes improvement over the specified clinical baseline, and brackets give 95% patient-cluster bootstrap intervals conditional on fitted models. The added comparisons are sensitivity analyses.
W1/Q1. Temporal alignment and the prediction claim
The MC-MED laboratory claim is encounter-level association and incremental prediction. ECG and PPG are synchronized within each recording and evaluated against the same laboratory target and clinical baseline. This defines a paired comparison of their information about the encounter's laboratory measurement. MC-MED provides laboratory order and result-reporting times. MC-MED documentation.
We also completed a temporally linked external analysis using MIMIC-IV Waveform v0.1.0 and Clinical v3.1. The primary sample selects the latest eligible 30-second synchronized waveform within the 30 minutes preceding laboratory
charttime, yielding 141 potassium and 142 creatinine patients. MIMIC documentation describescharttimeas usually corresponding to specimen acquisition; we therefore identify this analysis as chart-time aligned. LABEVENTS documentation.The 15- and 60-minute sensitivity cohorts retain identical laboratory–waveform pairs for shared admissions, so those comparisons assess eligibility. We use encounter-level wording for MC-MED and chart-time wording for MIMIC, with neither presented as individually verified collection-time alignment. This adopts the claim definition proposed in Q1 while adding an external cohort with an explicit temporal selection rule.
W2. Complete-case selection
We separated selection of training patients from selection of evaluation encounters. Of 6,348 potassium-available encounters, 6,037 from 4,561 patients meet the adjustment-variable requirements; these comprise 5,160 interval-complete and 877 interval-incomplete encounters. Thus, the initial 311-encounter reduction reflects covariate availability.
Models fitted on all eligible training patients give the following increments over age/eGFR/BUN:
The paired complete-minus-full difference is 0.0009 [−0.0054, 0.0070]. Inverse-probability weighting, with selection probabilities and truncation thresholds estimated from training patients, gives a complete-case increment of 0.0941 [0.0752, 0.1135]. We also cross-evaluate models trained on all eligible versus complete-case patients. The positive increment in the interval-incomplete group directly establishes that successful extraction of every interval is unnecessary for the observed ECG gain. Appendix S reports the cohort reconciliation, training-population comparisons, and weighting sensitivity.