- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces MedAgentWorld, a hybrid replay-and-world-model environment for training clinical language agents on sequential emergency-care trajectories. The framework consists of MedWA-Gym for interactive rollouts, MedWA-WM for generating missing action feedback using privileged on-policy self-distillation (OPSD), and an SFT+GRPO agent trained over replayed and generated observations. The paper constructs MedWA-118K and MedWA-Bench from MC-MED, reports next-observation prediction results for the world model, evaluates transfer to MIMIC-IV-ED, and shows an agent-level improvement from 42.73% to 44.92% diagnosis accuracy when the world model is included.
Critical strengths
- The paper targets a meaningful limitation of static clinical QA: real clinical planning involves sequential evidence gathering under partial observability. The proposed routing principle, returning recorded feedback whenever it exists and invoking the learned model only for valid requests without recorded feedback, is a sensible attempt to preserve grounding in observed data.
- The paper gives a reasonably explicit formulation of the world-model prediction objective and the generalized JSD loss.
- The world-model results are substantial within the reported laboratory-prediction setting.
Critical weaknesses
- Figures 1, 2, and 3 show obvious signs of AI drawing. The text is filled with numerous low-quality AI-written elements, and I did not see any "AI use statement" in the paper. This is clearly a low-quality paper produced with AI assistance.
Questions for authors
- See "Weaknesses".