- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper investigates how to extract meaningful features from second to minute multichannel, heterogeneous data. Continuous data is encodes using patch encoders, and episodic measurements through a parse encoder. The patch representations are further encoded using a bi-axial encoder and the sparse encoder output further through channel attention. This is then used for cross channel masked reconstruction and cross vital correlation matching. The validation is done using Site A, and MIMIC III is used for external validation. Internal validation is done using held out data from Site A, and external validation through MIMIC data.
Critical strengths
Solid engineering, that first a) encodes high resolution temporal signals as patches and episodic signals through a sparse encodes, b) processes temporal signal through MAMBA in both forward and reverse directions, and vital sign processing through multi-head attention and then finally trained using standard reconstruction and cross-vital correlation loss. The results demonstrate that these features do produce better predictions. The results are presented thoroughly.
Critical weaknesses
• If a foundation model is the claim, I would have expected a much clearer separation in results from simpler methods, which does not seem to be the case. • It is unclear to me whether the second-to-minute resolution is solved through this engineering, or whether any fundamental issues of temporal multiresolution are solved. Also, not imputing is a good thing, but it is not clear any breakthrough idea has been presented through the encoding with the sparse encoder. In summary, a good engineering solution, but no methodological insights. Even the ablations consider what happens when each specific module is removed, but I got no further insights into modelling long term disparate measurement fusion.
Questions for authors
I found Figure 2 hard to interpret, perhaps a better motivation would have helped.
3 comments
Response to wnKD (2/2): Methodological insights and Figure 2
W2. Methodological insights
We understand the concern that VitalFM reads as an engineering solution. VitalFM addresses second-to-minute resolution through within-minute encoding followed by day-long temporal modeling; we do not claim a general solution to temporal multiresolution. We agree that the original manuscript gave the reasoning behind each modeling choice in the method description without drawing it together, and did not state the insights from the comparisons explicitly enough. The revised Discussion and Conclusion section now states three insights supported by the results:
-
Self-supervised pre-training makes deep learning on raw monitoring effective when labeled data are limited. Labeled cohorts for a given clinical question can be small, and end-to-end deep learning may then struggle to match handcrafted features paired with classical or tabular models, which can leave outcome prediction dependent on manual feature engineering. In our experiments, the same architecture trained only on task labels falls well short of expert-designed features, whereas fine-tuned VitalFM achieves the highest mean AUROC and AUPRC in within-cohort evaluation, and even the frozen encoder is competitive with expert-designed features (Section 4.4).
-
Our physiologically motivated pre-training objective turns the interdependence among vital signs into an effective source of supervision. Because vital signs tend to co-vary as a patient's physiological state evolves, VitalFM can reconstruct an entirely withheld vital from the remaining signals, without access to any of its measured values. Encouraging the decoded target and decoded context vitals to correlate as the observed signals do further improves downstream performance at little cost to reconstruction quality (mean squared correlation mismatch 0.427 vs. 0.045; mean AUROC/AUPRC gains of 1.0/1.1 points with TabPFN-3 and 1.8/1.4 points with a linear probe; Figure 3, Table 3).
-
Partially observed ICU monitoring can be modeled as it is recorded, without imputing missing measurements. VitalFM's patch encoders represent what was recorded within each minute, with a dedicated sparse encoder for episodic NIBP; bidirectional Mamba, a state-space design motivated by the evolving physiological state that vital signs reflect, models each vital's full-day trajectory, and masked attention lets the vitals available at each minute inform one another. Several of these choices are supported empirically: in matched models without pre-training, retaining NIBP adds predictive information (removing it lowers mean AUROC/AUPRC by 1.5/0.8 points) and the sparse encoder achieves higher AUROC than a shared convolutional encoder in most settings (six of eight; Table C.6); with pre-training, bidirectional Mamba outperforms approximately parameter-matched attention-based temporal backbones (mean AUROC/AUPRC gains of 2.3/1.8 points over gated attention and 2.1/2.2 points over the masked Transformer with TabPFN-3; patch encoding and cross-vital attention held fixed; Table 3). Even without observation-aware gating, VitalFM predicts well from partially observed inputs. Adding gating improves reconstruction and yields higher AUROC in five of eight settings and higher AUPRC in seven of eight with TabPFN-3. Although channel missingness and availability differ between the pre-training and downstream data, VitalFM performs well downstream and transfers across sites without refitting, suggesting that its representations remain robust under such differences in measurement availability.
Q1. Interpretation and purpose of Figure 2
Figure 2 asks whether VitalFM’s advantage holds in each cohort and outcome, not only on average, and how certain each difference is. Each point is a comparator’s performance minus fine-tuned VitalFM’s, so points left of zero favor VitalFM; bars are 95% paired bootstrap confidence intervals, and asterisks mark nominal p<0.05. It shows clear separation from most baselines. Overall, VitalFM is numerically higher in most comparisons, and none significantly favors a comparator. We revised the caption to explain how to read the comparisons.
Thank you again for your review. We would appreciate your thoughts on whether our responses address your concerns. We would welcome the opportunity to clarify anything that remains unclear.
Response to wnKD (1/2): Foundation-model scope and performance
Thank you for recognizing the study's soundness and thorough presentation. We address your comments below.
W1. Foundation-model scope and performance
We use “foundation model” to describe a self-supervised encoder reused across outcomes and evaluation settings. VitalFM is evaluated across four outcomes, two cohorts, multiple downstream learners, frozen transfer, fine-tuning, and cross-cohort transfer without destination-site refitting.
VitalFM does outperform simpler methods: fine-tuned VitalFM achieves mean AUROC 3.2 points above handcrafted features with LightGBM and at least 7.9 points above each supervised sequence baseline. Its closest competitors are not simple baselines: they combine expert-designed features with TabPFN-3 and TabICLv2, which are themselves pre-trained foundation models for tabular data. Even against these, fine-tuned VitalFM achieves the highest mean AUROC and AUPRC. Fine-tuned VitalFM learns directly from raw monitoring and outperforms those same tabular foundation models applied to raw vital-sign grids by 3.7–7.0 AUROC points and 2.8–4.3 AUPRC points on average. Finally, the identical architecture trained only on task labels is 14.8/8.4 points lower than pre-trained VitalFM. Together, these comparisons show the value of physiologically motivated pre-training for learning representations that transfer across outcomes and health systems.