- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper extends a chain of LLM agents over chunked EHR, with two additions. One is a memory of the best reasoning traces from training patients, retrieved as few-shot examples for similar patients. The other fine-tunes the worker and manager agents on rollouts that agree with the label. Task is one-year lung cancer prediction from up to five years of single-centre EHR, with an overall and a never-smoker test set.
Critical strengths
- never-smoker early detection is maybe important (How accurate is self-reported status? I also
neversmoked of course...) - leave-one-out retrieval during training makes sense
- detailed cohort table
Critical weaknesses
- the stream is random training samples added over time, no time order. how is that self-adaptive?
- only 27 cases in the never-smoker test set. bootstrap SE only, any paired test planned?
- index date is the chest radiology exam. is the report of that exam in the input? then the model just reads the finding
- 1:10 case-control matching, hence PPV and F1 don't mean much outside this setup
- LCRAT is made for ever-smokers, not a fair baseline on never-smokers
- MAPA is basically RAFT style fine-tuning on two agents, why call it MARL in the figures?
- you store reasoning traces of real patients and show them for other patients. data governance?
- what is k? how many GPU hours?
Questions for authors
see above