- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents a pipeline for constructing large-scale 3D abdominal CT visual grounding data from routine clinical annotations. Report phrases are matched to radiologists’ measurement lines and arrows using measurements and imaging metadata, and SAM2CT converts these annotations into volumetric masks. The authors construct approximately 105K phrase–mask–volume triplets, train LocusCT, and introduce LocusBench, comprising 500 radiologist-reviewed examples covering oncology and emergency-department findings. Validation includes zero-shot comparisons, training two architectures on the constructed data, ablations, and an initial external evaluation on Merlin.
Critical strengths
-
A practical and scalable source of clinically grounded supervision. Obtaining volumetric annotations for individual findings is expensive. The proposed pipeline leverages annotations already produced during routine care, reducing the need for additional manual delineation when constructing training data. The resulting 105K triplets and improvements with increasing training data provide convincing evidence that this supervision source is useful. This is the paper’s principal contribution.
-
An expert-reviewed benchmark for abdominal finding grounding. LocusBench extends evaluation beyond predominantly anatomical or chest-focused datasets to oncology and emergency-department abdominal findings. Both phrase–annotation correspondence and segmentation quality are reviewed, with problematic examples corrected and re-reviewed. Together with experiments on two architectures and data-scaling ablations, this provides meaningful validation of the constructed supervision.
Critical weaknesses
-
Limited baseline coverage and insufficient comparison under matched supervision. The zero-shot evaluation includes only VoxTell, SegVol, and BiomedParse-v2. Several methods evaluated on ReXGroundingCT could also serve as relevant baselines, but their applicability is neither evaluated nor discussed. Broader comparisons, including training or fine-tuning representative methods on the same data, would help establish their relative performance under comparable supervision.
-
Limited independent external validation. The training data and LocusBench originate from the same institution, and benchmark examples are selected through the same annotation pipeline. The evaluation therefore primarily represents positive findings with retained clinical annotations and matchable report descriptions. The Merlin experiment includes only 78 findings, relies on radiologist ratings rather than independently annotated segmentation masks, and lacks corresponding baseline evaluations. This provides preliminary evidence of transfer but leaves uncertainty about generalization across institutions and reporting styles.
Questions for authors
See weakness
Thank you for the thoughtful review, and for recognizing the routine-care supervision as a practical and scalable contribution, the value of LocusBench, and the validation across two architectures and data scales.
W1. Limited baseline coverage and comparison under matched supervision.
We selected VoxTell, SegVol, and BiomedParse-v2 as the strongest publicly available, text-promptable 3D segmentation models that can be applied to abdominal CT without retraining. Many methods evaluated on ReXGroundingCT are not publicly available or were developed for chest CT; we will add a discussion of their applicability to the Related Work.
To address comparison under matched supervision, we fine-tuned pretrained VoxTell, the strongest zero-shot baseline, on the same training data (10 epochs, lr = 5e-6) and evaluated it under the same protocol:
Training on our data raises VoxTell's hit rate from 0.188 to 0.696 on LocusBench-Onc and from 0.209 to 0.810 on LocusBench-ED, a nearly 4× gain under identical architecture, prompts, and evaluation. Fine-tuning from pretrained weights and training from scratch perform similarly, with each leading on one benchmark. We retain LocusCT (from scratch) as our primary model because its performance is more balanced across the two benchmarks. We will add this comparison to the paper.
We also tested whether the zero-shot gap reflects prompt format rather than grounding ability by prompting all baselines with short category labels (≤ 4 words) instead of full report sentences. This improves them only modestly (best: 0.221 on Onc), so prompt format does not explain the gap (full table in our response to Reviewer rwjo).
W2. Limited independent external validation.
We agree, and built LocusBench-Merlin to address each point you raised (details in the comment to all reviewers, "All Reviewers: Expanded External Validation"):
Reference masks were initialized from LocusCT predictions, which radiologists could edit or redraw; they relocated the finding entirely in 48 of 154 cases. Because some anchoring cannot be ruled out, we treat LocusCT's absolute hit rate as an upper bound and its margin over baselines as the main result.
LocusCT localizes 68.8% of findings versus 26.0% for the best baseline (VoxTell). On findings within our existing categories, its hit rate (0.779) is in line with LocusBench-Onc and -ED (0.733, 0.765), indicating that LocusBench results are not an artifact of pipeline selection. On finding types none of our benchmarks cover (e.g., fractures, fluid collections), LocusCT still reaches 0.597, more than twice the best baseline (0.247). We will also state the GSPS-matching selection step explicitly in the Limitations, framing LocusBench results as performance on pipeline-matchable findings.