- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
Pulse2View (P2V) presents a self-supervised learning approach that constructs two complementary representations of the same PPG signal to capture important morphology features. In particular, the first representation is in the image space where the PPG is transformed using CWT and encoder using a ConvNeXt. The second representation is a time series view where the PPG is encoded using 1D CNN + BiGRU. P2V is pre-trained using InfoNCE loss over these representations across 99K windows. After pre-training, the model is fine-tuned on 71K windows for multi-label classifications of 7 diseases. The validation demonstrates superior performance compared to prior baselines on a private dataset.
Critical strengths
- P2V's use of multiple representations is interesting because it still relies on a single PPG sensor, making it useful for deployments.
- Label efficient learning and the six class task external evaluation are useful experiments that demonstrate the efficiency and some generalization of P2V.
Critical weaknesses
(Experimental weakness) Unfair comparisons to prior SSL approaches: The closest baseline to P2V is TF-C. However, only P2V is pre-trained on 99.7K unlabelled pre-training. For fair comparison, TF-C should also be trained on the same pre-training data to ensure that the performance gains are because of pre-training method and not the data. Unlike public models which can be evaluated directly, TF-C is an SSL approach, hence it should be evaluated in the way mentioned above.
(Experiment weakness) Single representation temporal SSL baseline: The claim that single sensor at inference time does not mean that pre-training requires a single sensor requires an SSL baseline that uses a single representation. This comparison will support that multiple representations in SSL are better than a single one. As PPG is a time series, using a single representation approach like SimCLR for PPG is necessary. This baseline is more important that pre-trained baselines because P2V is presented as an SSL approach.
(Experimental weakness) Pre-training vs. Fine-tuning distributions: The paper states that the pre-training data is split prior to constructing CWPC. This implies that they are part of the same study and could have the same devices and protocols. Consequently, P2V pre-training and evaluation distributions could be similar. If so, P2V is in an easier in-domain setup compared out-of-distribution for other baselines.
(Experimental weakness) Fine-tuning vs Probe: A major approach to evaluate the effectiveness of SSL approaches transfer to downstream performance is a linear probe (multi-label probe in P2V's case). This would indicate if the representations learned from multiple views is actually useful for downstream tasks. However, the experiment results rely on fine-tuning, which update the pre-trained model. Therefore, it is unclear whether downstream performance is driven by fine-tuning or P2V's multi-representation pre-training.
(Results) Confidence Intervals: Providing bootstrapped CIs from a single seed would be more useful than 3-seed averaging in Table 2. These CIs will help the reader understand if P2V's improvements are meaningful given the smaller sample size of CHD labels.
Questions for authors
These questions and comments did not affect my score:
(1) What are the inputs to the traditional controls (e.g., RF, LR)? Is feature engineering performed prior to training these ML models.
(2) The positive-class weight , wouldn't these value dramatically increase the loss? Wouldn't it better scale it between 0 to 1 to obtain ratio?
(3) The Experimental Setup can be better presented to clarify which models are trained with what data. SSL approaches can be separated from PPG or Time series native models.
(4) Why not evaluate on other large PPG datasets such as MIMIC, VitalDB, or others? P2V is not restricted to multi-label classification as that is only downstream.