- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
PatientWorld is a latent world model for ICU trajectories. It factorizes the latent state into five physiological systems with global context. Each system’s transition combines three components: (1) GRU driven by a shared cross-system mixer and generic treatments, (2) physiology specific treatments routed to literature-defined target systems, and (3) gated local residual that limits rollout drift. The model is pretrained task-agnostically on MIMIC-III and MIMIC-IV (4-h bins, 48-h history, 12/24-h horizons). It is then adapted to sepsis treatment and RRT initiation timing on MIMIC-IV by freezing the backbone and learning residual corrections. It is evaluated on trajectory forecasting against 11 baselines, with the best error reported in 15 of 16 settings. There are also comparisons against other reuse strategies (from scratch, zero-shot, full fine-tuning, random-graph adapter).
Critical strengths
-
Well-motivated design with structural controls. Separating reusable, task-agnostic dynamics from task-specific context adaptation is a relevant direction for clinical world models. The physiological priors are tested with appropriate controls: shuffled treat breaks the treatment-to-system mapping, random graph adapt randomizes the task graph, and base WM is parameter-matched. These controls are what make the structural claims testable.
-
Broad, unified evaluation from forecasting to decisions. The paper evaluates diverse baselines under a shared protocol on two databases with three seeds, includes multiple OPE estimators and support/ESS diagnostics. I also appreciate the detailed appendices and code availability.
Critical weaknesses
-
The baseline comparison is not fully convincing for irregularly sampled EHR data. Although GRU and Transformer are included, common and relevant clinical irreuglar time-series models such as GRU-D, STraTS, DuETT, and mTAN are missing. Most comparisons rely on general-purpose forecasting models rather than EHR-specific approaches. A comparison with pretrained clinical time-series encoders using frozen backbones and forecasting heads would also help support the claim about reusing learned patient dynamics.
-
I am not fully convinced that the results demonstrate better treatment-conditioned dynamics. PatientWorld performs similarly to Transformer when future treatments are available, while most of its gains appear in blind forecasting. This raises the question of whether the improvement comes from better treatment modeling or simply greater robustness to missing future inputs. Also, the use of 4-hour bins may obscure the temporal relationship between treatments and physiological responses, particularly for fast-acting interventions. Fig 4 shows that predictions change under different actions, but does not establish whether these changes are physiologically plausible.
Questions for authors
- How are future treatment inputs handled in the blind setting? Were the same conditions applied to all baselines?
- What is the rationale for using 4-hour bins?
- How are test windows selected, and how are patients with less than 48 hours of history handled? An online-monitoring evaluation over the full ICU stay would also be interesting.
- The downstream results vary across OPE estimators, with other models outperforming PatientWorld on some metrics. How much of the improvement can be attributed to the world model itself rather than the shared planning components?
- Have you evaluated whether the predicted treatment responses are physiologically plausible, not just simply measuring how much predictions change under different actions?
5 comments
Response to Reviewer 77xe (Part 2/2)
Q4. World-model contribution under shared planning
All dynamics-based approaches use the same action space, planner, and OPE protocol for each downstream task; their main difference is the learned dynamics supplied to the planner. Thus, differences under this controlled comparison cannot be attributed to different planning algorithms and instead reflect the offline decision performance of different world models within the same planning pipeline. We also report model-free CQL, which does not rely on world-model-guided planning, as an independent decision-making baseline.
Q5. Physiological plausibility of treatment responses (also addressing W2)
We agree that variation across hypothetical actions alone does not establish agreement with observed physiological responses. We therefore added factual RRT treatment-response forecasting, restricted to test windows with observed RRT initiation (action initiate). Conditional forecasts use the recorded RRT treatment schedule and are compared with subsequent observed physiological changes; Blind forecasts use the same windows without future treatment information. This differs from the hypothetical-action sensitivity diagnostic in Figure 4.
We evaluate normalized continuous changes in BUN, creatinine, potassium, bicarbonate, and pH:
| Model | Conditional RMSE ↓ | Blind RMSE ↓ | Conditional gain ↑ |
|---|---|---|---|
| PatientWorld | 0.6360 | 0.7329 | 0.0976 |
| Transformer | 0.6626 | 0.7330 | 0.0705 |
| MedDreamer | 0.7671 | 0.8498 | 0.0827 |
Conditional gain is defined as Blind RMSE − Conditional RMSE. PatientWorld's gain is 0.0969, with a patient-clustered bootstrap 95% CI of [0.0683, 0.1320]. Its Conditional RMSE is 0.0266 lower than Transformer's (paired patient-clustered 95% CI [0.0071, 0.0451]) and 0.1311 lower than MedDreamer's ([0.0878, 0.1773]). The patient-macro Spearman correlation between predicted and observed physiological changes is 0.5888.
These results show that, on observed RRT-initiation windows, PatientWorld more accurately predicts subsequent measured physiological changes, providing factual treatment-conditioned evidence beyond action sensitivity alone.
Follow-up on Our Rebuttal
Dear Reviewer 77xe,
Thank you for your time and effort in reviewing our paper. We sincerely appreciate your constructive feedback.
As the author–reviewer discussion period is approaching its end, we would greatly appreciate it if you could take a moment to review our rebuttal and let us know whether your concerns have been adequately addressed.
Thank you again for your time and consideration.
Best regards,
The Authors
Response to Reviewer 77xe (Part 1/2)
We thank the reviewer for the constructive assessment and for recognizing the physiological design, structural controls, and common evaluation protocol. We added clinical EHR baselines and factual RRT treatment-response analyses, and clarify the relevant forecasting and downstream evaluation protocols below.
W1. Clinical EHR baselines
We added GRU-D, STraTS-supervised, and STraTS-SSL-frozen, covering missingness-aware modeling, supervised clinical sequence encoding, and a self-supervised pretrained clinical encoder kept frozen while training a forecasting head. All use the same MIMIC-III/MIMIC-IV patient splits, L12 history, and H3/H6 Conditional/Blind evaluation protocol as Table 1. Results are mean ± SD over three training seeds (lower is better).
MIMIC-IV
MIMIC-III
All three additional clinical baselines have higher mean RMSE and MAE than PatientWorld in the four forecasting settings on both datasets. We will add these comparisons to the revised paper.
Q1&W2. Blind treatment inputs
In the Conditional setting, models with a treatment-conditioning interface receive recorded future treatments. In the Blind setting, future treatment information is withheld, while historical treatment records remain available. All methods use the same patient-level splits, history windows, horizons, and metrics. Baselines that do not take treatments as inputs retain their respective forecasting interfaces. Thus, future treatment information is not withheld only from PatientWorld, nor supplied to competing methods in the Blind setting.
Q2&W2. Four-hour temporal discretization
We chose 4-hour bins to balance temporal resolution and observation density in sparse, irregular ICU data, especially laboratory measurements. This resolution is also used in established ICU decision-making work (e.g., AI Clinician; Komorowski et al., 2018) and enables a common evaluation protocol for both datasets and all baselines.
Observation masks and elapsed-time features represent missingness and sampling intervals (Appendix B.2). PatientWorld predicts next-step physiology from preceding-step treatment inputs. For downstream sepsis modeling, the state uses information available at the decision point, the action corresponds to treatment recorded over the following 4 hours, and subsequent physiology provides the prediction target (Appendix B.3).
Q3. Test windows, short-history patients, and online monitoring
Forecasting uses a 12-bin (48-hour) history to predict H3 or H6. A valid window must contain the full history and forecast range—at least 15 or 18 bins, respectively. Training samples at most eight eligible windows per ICU trajectory; testing evaluates eligible windows from the held-out patient-level test split.
Patients without enough history to form a complete L12 forecasting window are therefore excluded from this forecasting evaluation, and short-history padding is not used in this setting. Downstream adaptation permits shorter histories with appropriate padding and masks. Evaluating rolling or online monitoring across entire ICU stays, including early-admission short-history predictions, is an important direction for future work.