- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes LongRx, which formulates medication recommendation as a sequential decision process with RETRIEVE, ADD, DELETE, VERIFY, and EXIT actions. The main technical contribution is CATO, which combines tree-based credit assignment with coverage-aware sampling of under-explored valid actions. Experiments on MIMIC-III, MIMIC-IV, and eICU show modest but consistent improvements in prescription overlap and DDI rate, with extensive ablations and matched-budget comparisons.
Critical strengths
-
The experimental evaluation is thorough. The paper includes matched rollout/resource comparisons, component ablations, exploration baselines, statistical testing, cross-dataset evaluation, and controls for access to the DDI verifier. These make the empirical improvements fairly convincing.
-
The closed-loop formulation is useful and well motivated. Learning when to retrieve, edit, verify, and stop is more flexible than using a fixed medication-generation workflow, and the experiments support the value of this design.
Critical weaknesses
-
Limited novelty: Most ingredients—multi-turn GRPO, tree/shared-state credit assignment, and exploration-aware branching—have close precedents. The main new piece appears to be the opportunity-normalized action coverage rule, which feels incremental.
-
Baseline coverage: The paper does not directly compare against some closely related recent methods such as GiGPO/ATPO, making it harder to judge the added value of CATO over stronger agentic RL baselines.
-
Application novelty: In medication recommendation, related agentic systems such as SafeRx-Agent already combine sequential decision making with safety verification, so the distinction of LongRx could be better established empirically.
Questions for authors
-
Can you clarify the novelty of CATO relative to recent multi-turn/tree-based GRPO methods such as GiGPO and ATPO? In particular, what capability does opportunity-normalized coverage provide that these methods cannot achieve with their existing exploration mechanisms?
-
Why are closely related agentic medication systems such as SafeRx-Agent not included as empirical baselines?
-
How were the 250 extra medications selected for the blinded clinical evaluation? Was the sampling procedure fixed and uniform across methods/patients?