- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes PRISM for query-conditioned fetal ultrasound segmentation. The main idea is to inject fetal-ultrasound-specific knowledge from a pretrained FetalCLIP model into an MLLM-SAM segmentation framework. PRISM uses FetalCLIP both as the MLLM visual encoder and as an external source of plane-level ScoreCAM priors. The proposed Activation Prior Refinement (APR) refines the coarse plane activation map using visual and query representations, while Patch-Adaptive Prior Composition (PAPC) adaptively combines the refined prior, visual features, and query semantics through set-level expert selection and patch-level fusion.
Experiments on one public benchmark assembled from five datasets and one private benchmark show consistent improvements over LISA, SESAME, READ, and Sim4Seg across 7B/13B model scales. The best model achieves 80.55 cIoU on the public benchmark and 71.41 cIoU on the private benchmark. Component and routing ablations generally support the contributions of CAM, APR, and PAPC.
Critical strengths
-
The paper explicitly spatializes fetal-plane knowledge and refines it according to the requested anatomy. This is well motivated for fetal ultrasound, where imaging plane strongly constrains anatomical appearance.
-
Gains are observed on both public and private benchmarks and at both 7B and 13B scales. The component ablation is particularly convincing: on the public 7B setting, the baseline improves from 38.41/70.01 gIoU/cIoU to 50.43/77.09 with the complete method.
Critical weaknesses
-
At inference time, the query already specifies the imaging plane, yet the external branch independently predicts the plane from the image and uses that prediction to select the ScoreCAM target. I could not find quantitative plane-classification accuracy, an oracle-plane comparison, or an analysis of segmentation performance when the predicted plane is incorrect. This makes it difficult to determine how robust the proposed mechanism actually is and how much of the gain depends on correct plane recognition. The appendix states that prediction/annotation mismatches are recorded, but no quantitative analysis appears to be provided.
-
Queries are generated from annotated plane/target names using a small number of wording variants. There is no evaluation on unseen paraphrases, omitted/incorrect plane descriptions, or unseen target/plane combinations. In addition, the private benchmark is described as being split at the source-image level, rather than explicitly at the patient/examination level. For ultrasound data, clarification that correlated images from the same patient/examination cannot cross splits is important.
Questions for authors
-
What is the FetalCLIP plane-classification accuracy on the two benchmarks? Please report segmentation performance separately for correctly and incorrectly predicted planes, and ideally compare predicted-plane CAM vs. ground-truth/oracle-plane CAM. This would directly establish how sensitive PRISM is to the quality of its plane prior.
-
Since the query already contains the plane name, why is the CAM target inferred independently from the image rather than selected from the query? How does performance change if the query-specified plane is used directly?
-
Are train/validation/test sets separated at the patient or ultrasound-examination level, rather than only by source image? If multiple frames/images from the same patient or examination exist, can they appear in different splits?
-
What is the computational overhead of PRISM at inference time? ScoreCAM operates over 1,024 activation channels and scores masked inputs for channel weighting, which appears substantially more expensive than a standard forward pass. Please report inference latency or FLOPs relative to LISA/Sim4Seg.
4 comments
Authors Rebuttal to Reviewer h9Fc [2/3]
Q2. Queries are generated from annotated plane/target names using a small number of wording variants. There is no evaluation on unseen paraphrases, omitted/incorrect plane descriptions, or unseen target/plane combinations. In addition, the private benchmark is described as being split at the source-image level, rather than explicitly at the patient/examination level. For ultrasound data, clarification that correlated images from the same patient/examination cannot cross splits is important.
Response: Thank you for your valuable feedback. We address this concern through evaluations with implicit clinical queries, unseen query formulations, and a clarification of the patient-level data split.
1. Query understanding beyond explicit anatomical labels.
To examine whether PRISM can use query meaning beyond explicit plane and target names, under the guidance of experienced clinicians, we formulated implicit queries for five target categories. These queries describe the requested anatomy through its role in a clinical measurement. For example, the implicit query for the fetal head region is: “For fetal growth assessment using a cranial circumference measurement, segment the full region enclosed by the measurement contour.” All compared methods were retrained using the same implicit-query training data and evaluated on the corresponding held-out test split, retaining the original public-benchmark split assignments.
PRISM achieves the highest gIoU and cIoU among the compared methods under this shared setting, demonstrating effective segmentation from clinical descriptions without explicit plane or target names. The results are shown below (Main Text, Section 4.3, “Segmentation with Implicit Clinical Queries”, Table 2). The subset composition (Table 18), complete query formulations, and corresponding targets are provided in Appendix A.7.10, “Implicit Clinical Queries and Corresponding Segmentation Targets”.
Segmentation with Implicit Clinical Queries.
| Method | gIoU | cIoU |
|---|---|---|
| READ(CVPR2025) | 81.06 | 86.47 |
| SESAME(CVPR2024) | 83.90 | 87.23 |
| LISA(CVPR2024) | 83.90 | 86.64 |
| Sim4Seg(AAAI2026) | 84.46 | 87.88 |
| Ours(CLIP) | 85.49 | 89.17 |
2. Generalization across query formulations.
We further evaluated whether performance generalizes beyond the query formulations used during training. In the Unseen-Query setting, the trained model is evaluated with a new inference-time template. In the Held-out Query setting, one original template is excluded from training and used only at test time.
PRISM maintains its advantage over LISA in both settings, with cIoU decreases of only 0.09 and 0.18 percentage points relative to the default setting. The results are shown below (Appendix A.7.3, “Generalization to Unseen and Held-Out Query Formulations”, Table 10).
Generalization to Unseen and Held-Out Query Formulations.
| Setting | PRISM gIoU | PRISM cIoU | LISA gIoU | LISA cIoU |
|---|---|---|---|---|
| Default | 50.43 | 77.09 | 38.41 | 70.01 |
| Unseen-Query | 49.77 | 77.00 | 36.80 | 68.12 |
| Held-out Query | 49.99 | 76.91 | 36.34 | 67.70 |
3. Patient-level separation.
The private training, validation, and test sets are patient-disjoint. All images from the same patient, together with their annotations and queries, remain in one split. Thus, correlated images from the same patient or examination cannot cross splits. We have clarified this in Main Text, Section 4.1.3, “Dataset” and Appendix A.5, “Dataset Details”, Tables 6–7.
We thank the reviewer for this helpful comment, which improved the rigor of the experimental analysis.
# Authors Rebuttal to Reviewer h9Fc [3/3]
Q3: Since the query already contains the plane name, why is the CAM target inferred independently from the image rather than selected from the query?
Response: Thank you for the valuable comment. Image-based plane prediction allows prior generation without an explicit plane name in the query, supporting the implicit clinical queries evaluated in Main Text, Section 4.3, “Segmentation with Implicit Clinical Queries”, Table 2.
Q4: Are train/validation/test sets separated at the patient or ultrasound-examination level, rather than only by source image? If multiple frames/images from the same patient or examination exist, can they appear in different splits?
Response: Thank you for your insightful comment. The private training, validation, and test splits are patient-disjoint. All frames and images from the same patient, including their annotations and queries, remain in one split, preventing overlap across patients or examinations (Main Text, Section 4.1.3, “Dataset”; Appendix A.5, “Dataset Details”, Tables 6–7).
Q5: What is the computational overhead of PRISM at inference time? ScoreCAM operates over 1,024 activation channels and scores masked inputs for channel weighting, which appears substantially more expensive than a standard forward pass. Please report inference latency or FLOPs relative to LISA/Sim4Seg.
Response: Thanks for your comment! We measured the computational cost of the 7B configurations, including parameters, FLOPs, peak GPU memory, and inference time. Although PRISM incurs higher FLOPs and inference latency, it achieves better segmentation performance than all compared methods on both benchmarks. The computational results are shown below (Appendix A.7.7, “Computational Cost and Inference Trade-Off”, Table 14).
Computational Cost and Inference Trade-Off.
| Method | Total params. (B) | Trainable params. (M) | FLOPs (T) | Peak GPU memory (GB) | Inference time (s) |
|---|---|---|---|---|---|
| LISA-7B | 7.7089 | 288.26 | 10.4977 | 17.158 | 0.2506 |
| Sim4Seg-7B (RVLS2M) | 7.7089 | 288.26 | 10.4977 | 17.158 | 0.2650 |
| PRISM-7B (Plane ScoreCAM) | 8.1424 | 294.076 | 176.576 | 18.038 | 1.4946 |
Dear Reviewer h9Fc
I hope this message finds you well.
I am one of the authors of Paper 11503, titled "Refining Plane Priors for Query-Conditioned Fetal Ultrasound Segmentation." As the author-reviewer discussion period is in its final stages, I wanted to gently follow up to see if our responses have satisfactorily addressed all of your concerns. If there are any additional points or feedback you'd like us to consider, please let us know. Your insights are invaluable to us, and we are eager to address any remaining issues to improve our work.
Thank you very much for your time and consideration.
Best regards,
The authors of Paper "Refining Plane Priors for Query-Conditioned Fetal Ultrasound Segmentation" (ID: 11503)
Authors Rebuttal to Reviewer h9Fc [1/3]
We sincerely thank you for your careful and thorough review. We appreciate your recognition that PRISM spatializes fetal-plane knowledge according to the requested anatomy, a design well motivated for fetal ultrasound, and that its gains hold across both benchmarks and model scales, with the component ablation being particularly convincing. We address your questions below and have incorporated all feedback in the revised version. All new material added to the revised manuscript has been highlighted in pink text for better visibility.
Response: Thank you for the insightful comment. The frozen FetalCLIP predictor used to select the ScoreCAM target achieves zero-shot accuracies of 80.89% and 59.83% on the public and private test sets, respectively. PRISM shows limited overall sensitivity to plane-prediction errors and retains its segmentation advantage over LISA when the predicted plane is incorrect.
For the oracle comparison, we use the same trained 7B model and segmentation queries, replacing only the predicted ScoreCAM plane with the annotated plane. For these explicit benchmark queries, the oracle also corresponds to using the query-specified plane directly. Prediction-True and Prediction-False indicate whether the actual FetalCLIP prediction matches the annotation; all methods use the same groups. The results are shown below (Appendix A.7.1, “Plane Classification and Sensitivity to Plane Prediction Errors”, Table 8).
Plane Classification Accuracy and Segmentation by Prediction Correctness.
Correcting the predicted plane to the annotated plane improves overall cIoU by only 0.04 and 1.10 percentage points on the public and private benchmarks, respectively. This indicates that PRISM’s overall segmentation gains do not rely entirely on correct plane recognition. On incorrectly classified images, PRISM still outperforms LISA by 4.97/1.09 points, although correcting the plane improves cIoU by 1.31/4.18 points. Thus, plane recognition affects segmentation, particularly on the private benchmark, while PRISM retains gains under the observed prediction errors.
We sincerely thank the reviewer for this insightful suggestion, which has helped strengthen the experimental validation of our work.