- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3(+1)
Read review
Paper summary
PULSE is a self-supervised framework for multimodal ICU progression modeling. It combines knowledge-informed phase prototypes, equal-mass hourly optimal transport alignment, and phase-aware attention to learn shared clinical representations. Experiments on MIMIC-IV and eICU report the best mean performance in nine of ten task settings, supported by ablations, history-length analyses, and clinical case studies.
Critical strengths
- Coherent design for a clinically relevant problem: Knowledge-informed phase prototypes and equal-mass hourly alignment offer a well-motivated approach to modeling asynchronous ICU trajectories while addressing observation-intensity bias.
- Broad empirical gains: PULSE achieves the highest reported mean performance in nine of ten settings across two datasets, with particularly substantial improvements in AKI progression prediction.
Critical weaknesses
- Uncertainty about baseline fidelity: Appendix A.5.1 removes CTPD’s reconstruction decoder and loss, as well as parts of DiPro’s architecture and training objectives. These adaptations may be justified, but their impact is not evaluated, leaving uncertainty about whether the comparisons preserve the baselines’ competitiveness.
- Insufficient validation of shared clinical phases: Section 3.3 presents two retrospectively interpreted cases but does not systematically establish whether the same prototype has consistent clinical meaning across patients. This limits support for the central claim of discovering shared clinical phases beyond generic physiological state clusters.
Questions for authors
1. Baseline adaptation clarification: Appendix A.5.1 attributes the omission of DiPro’s auxiliary objectives to the lack of disease progression labels. What motivates removing CTPD’s reconstruction decoder and loss? What validation supports the competitiveness of these adapted baselines?
2. Clinical phase validation clarification: Beyond the two case studies, what evidence supports consistent clinical meanings of the same phase prototype across patients? Is there any cohort-level analysis or independent clinical assessment of this consistency?
2 comments
Dear Reviewer c6jn,
With the discussion period nearing its end, we are following up to ensure we have addressed all of your concerns. Please let us know if you have any remaining questions or further feedback.
Thank you again for your valuable time and insights.
Thank you for recognizing the motivation and empirical results of our method and for your thoughtful comments and questions. We address each point below.
W1 & Q1: Clarification of Adoptation of the Baseline CTPD and DiPro
Thank you for the constructive comments. As described in Appendix A.5.1, all seven baselines are implemented on a shared input interface, with identical landmark examples, modality streams, and task labels, and each retains its characteristic fusion mechanism. Five baselines (UMSE, UTDE, TAMME, FuseMoE, and Flex-MoE) retain all of their original components and training objectives. Only CTPD and DiPro requires the omission of components that are not applicable to our setting:
CTPD: We removed the reconstruction decoder and reconstruction loss. CTPD uses frozen pretrained representations for reconstruction supervision. Extending it to our jointly trained CXR and ECG encoders would require additional design choices regarding the reconstruction targets and decoder.
DiPro: We removed progression-aware loss, since it requires additional fine-grained disease progression labels, which are unavailable in our data. We also removed the temporal-consistency loss, since it requires at least three consecutive events within the same modality, which most of our samples do not contain.
W2 & Q2: Clinical phase validation clarification
Thank you for this insightful suggestion. We evaluated the shared phase prototypes through cohort-level analysis and independent review by clinical experts.
Cohort-level analysis (Table R13). We analyzed AKI and Sepsis trajectories in the MIMIC test set using the pretrained PULSE model without downstream fine-tuning. For each stay we summarized its phase assignments into a phase-exposure vector and tested whether adding it to standard clinical covariates improved prediction of subsequent progression (multinomial logistic-regression likelihood-ratio test, Holm-corrected). As shown in Table R13, phase assignments are significantly associated with progression for both tasks, showing that the shared phases carry predictive clinical information.
Table R13. Cohort-level association between phase assignments and subsequent AKI and Sepsis progression across MIMIC test stays (multinomial logistic-regression likelihood-ratio test, Holm-corrected).
Independent clinical assessment (Table R14 & Table R15). A clinical expert and three LLMs independently reviewed the phases generated by PULSE for 30 randomly sampled MIMIC test stays, alongside the raw EHR time series, ICU notes, discharge summaries, and phenotype labels, rating the phases on a five-point Likert scale for two aspects:
As shown in Table R14, most stays were rated agree or strongly agree by the clinical expert, and three independent LLM reviewers produced consistent ratings (Table R15), suggest that the discovered phases are clinically meaningful.
Table R14. Case-level review by clinical expert.
Table R15. Case-level review by clinical expert and three independent LLM reviewers over 30 MIMIC test stays (Mean ± SD).
Full experimental details of both analyses have been added to Appendix A.3.2.
Summary of Manucript Revisions
We have revised the manuscript accordingly to address your comments and suggestions, with all modifications highlighted in blue:
Thank you again for your valuable comments and suggestions!