- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces a workflow model for instruction guided lesion segmentation in chest x-rays. It uses a two-stage pipeline built on MedGemma to generate box and coordinate prompts that are used by a separate SAM3 model to produce segmentations. Supervised fine-tuning and GRPO are used to train each policy. The model is evaluated on an internal test set and an external test set from a different hospital. There is an additional analysis of fragmentation in the predicted masks, and a reader study with medical experts.
Critical strengths
The methodology is strong. The authors retrain the baseline ROSALIA on the same training cases. The evaluations are also strong and include an external dataset and a reader study. The analysis of mask fragmentation shows a clear advantage of XFlow over ROSALIA.
Critical weaknesses
One of the main claims of the paper is that the multi-turn workflow is beneficial to segmentation performance. The ablation study, however, suggests that stage two doesn't meaningfully improve segmentation performance and that nearly all of the improvement over ROSALIA is because of the SFT and RL of stage 1. Stage two shows only minimal improvements on the internal CheXpercept dataset and almost no benefit on the external CheXlocalize.
Questions for authors
To address the small performance margins in stage 2 ablations, would the authors consider including variation across seeds, confidence intervals, or some other analysis to help readers judge the significance of these slight differences in performance?
Would the authors consider including a baseline on a simple multi-channel segmentation model (e.g. nnU-net) trained on the same dataset to demonstrate the benefit of instruction-guided segmentation?