- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper is written in the context of clinical treatment generation from retrospective EHR data, specifically for sepsis patients in ICUs. To apply LLMs in this setting, we need preference data of preferred and rejected actions but retrospective records only provide the administered action for each state, so there are no natural preference pairs to compare alternative actions under the same state. This work proposes VasoDPO, a DPO framework that uses the recorded action as the chosen response and constructs a MAP-guided rejected action under the same patient state. The paper also shows empirical results on ICU Sepsis dataset, showcasing that VasoDPO outperforms Standard-DPO and other LLM baselines (SimPO, KTO, SafeDPO) in train-on-synthetic, test-on-real mortality prediction and direct action diagnostics .
Critical strengths
The paper is well written and easy to follow. Experiments are thoughtfully designed to explore the behaviour of the generated actions beyond downstream predictive scores, through near-zero concentration, directional violations and a controlled MAP sweep.
Critical weaknesses
The paper doesn’t explain why LLMs are a reasonable modeling choice for predicting actions from states in this medical setting. The state only has four numeric features, which are serialized into text, and simple tabular models like Ridge and XGBoost perform comparably on several metrics
Questions for authors
Can you clarify how exactly mean arterial pressure (MAP) helps generate alternate rejected trajectories? Can you also give more evidence for why LLMs are suited for this task?