- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes MISeg-Agent, a human-in-the-loop framework for 3D medical image segmentation that selects pretrained models based on benchmark performance and computational requirements. It uses a trained error-diagnosis network to identify segmentation errors, proposes corrective point prompts, and tests them using nnInteractive before human review and approval. The framework is evaluated on seven CT datasets involving 120 cases and 360 human-review sessions, reporting segmentation accuracy, error-detection performance, and human interaction efficiency.
Critical strengths
The framework is evaluated on seven public CT datasets covering different anatomical structures, with 120 validation cases and 360 human-review sessions involving three participants.
The authors also investigate error-diagnosis performance across masks generated by different pretrained segmentation models.
Critical weaknesses
1. Unavailable Source Code: The paper claims that its source code is publicly available. However, as of October 16, 2026, the provided GitHub repository contains only a readme.txt file, with no implementation available. This prevents reviewers from inspecting the framework, verifying implementation details, or reproducing the reported results.
2. Limited Methodological Novelty: The proposed framework primarily integrates existing pretrained segmentation models, a conventional 3D U-Net for error detection, heuristic point selection, and nnInteractive for segmentation refinement. While the integration may offer practical utility, the paper does not establish a sufficiently distinctive methodological contribution beyond combining existing components into an agentic workflow.
3. Unfair Segmentation Performance Comparisons: Table 1 compares MISeg-Agent, which incorporates human-guided corrections, against pretrained segmentation models operating without human intervention. The reported improvement from 0.915 to 0.943 Dice therefore does not establish the superiority of the proposed framework. Furthermore, the interactive segmentation baselines receive unfiltered prompts without initial segmentation masks, making these comparisons difficult to interpret fairly.
4. Absence of Controlled Human Evaluation: Although the authors conduct 360 participant–case sessions involving three participants, they do not provide a controlled comparison against conventional human-assisted segmentation workflows. A meaningful evaluation would compare users correcting the same initial masks with and without the proposed agentic assistance. Without such a comparison, it remains unclear whether the framework actually improves annotation accuracy or reduces human effort.
5. Insufficient Evidence for Annotation Efficiency: The authors report an average human review time of approximately 35 seconds per case and compare this with annotation times from previous studies. However, these comparisons involve different datasets, annotation procedures, and measurement protocols. Furthermore, the reported time measures recorded human review activity rather than the complete workflow. Consequently, the claimed efficiency benefits are not convincingly established.
6. Lack of Component-Level Ablation Studies: The framework contains several components, including model routing, error diagnosis, prompt proposal, executable review, and human-guided refinement. However, the paper does not provide systematic ablations to establish how much each component contributes to the final segmentation performance or annotation efficiency. In particular, it remains unclear whether simpler approaches, such as direct interactive correction of pretrained masks without the proposed agentic coordination, could achieve comparable results.
Questions for authors
Please refer to the Critical Weaknesses section.