- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper treats medical segmentation as a repair problem starting from a coarse mask. An nnU-Net provides the initial prediction and a reference mask from complementary folds, a risk map picks candidate regions, and MedSAM2 is called through a structured action space. A learned controller plus proxy rollback decides whether to keep an edit, and teacher trajectories are distilled into the test-time policy. The evaluation covers 2D and 3D benchmarks.
Critical strengths
The clinical setup is sensible: in practice one often starts from a coarse automatic mask, not from a blank prompt. I also like that the action space is explicit and that the method tries to prevent harmful edits instead of just running SAM repeatedly. Covering CT, MRI, endoscopy, dermoscopy, and fundus images is a useful breadth check.
Critical weaknesses
The Kvasir results are what stopped me. Table 9 is described as the development split with 880 cases and reports 88.51 Dice, which is exactly the main-table result and the five-turn ablation result. Also, repairable recall changes with the number of teacher trajectories, although that should be a property of the teacher and available actions, not of student training size. This looks like possible overlap between the teacher/tuning split and the reported evaluation. Until the authors give an exact case-level split and explain those numbers, I cannot trust the headline gain.
Even if the split is clean, the paper does not separate the controller from simpler use of the same references. There is no direct coarse+reference fusion baseline and no fixed one-step MedSAM2 prompt under the same budget. Most of the gain is already there at turn 1; later turns add a tiny amount of Dice at a much higher runtime. So the current evidence supports a reasonable one-step repair pipeline, but not the full multi-turn agent with gating, ranking, and rollback.
Questions for authors
- What are the exact Kvasir training, development, and test sizes, and why does the 880-case development result equal the main test result to two decimal places?
- Why does repairable recall change from 45.83% to 79.17% with more teacher trajectories if it is defined from the teacher’s available actions?
- Can you add a direct coarse/reference fusion baseline and a fixed one-step MedSAM2 baseline with the same reference information?
- Can you report paired per-case bootstrap or McNemar tests for the Dice gains and a table that isolates the learned gate, ranker, and rollback?
The authors did not respond and address the concerns. I will keep original rating.