- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper presents PhysiVLM, a text-conditioned VLM for 3D medical image segmentation, which aims to improve segmentation performance by introducing physical priors into a VLM. However, some experimental results, metric calculations, and statistical analysis in the current manuscript need further clarification.
Critical strengths
PhysiVLM offers a relative clear and practical coarse-to-fine framework that connects text-guided spatial localization with medical mask generation. The VLM interprets text descriptions and expresses target locations as depth intervals and 2D bounding boxes, while MedSAM2 generates pixel-level masks. This provides a approach to using VLMs for medical image segmentation.
Critical weaknesses
Several details about the datasets, metric calculations, consistency of results, and reproducibility remain unclear. These problems affect the main conclusions and confidence in the experiments (see Questions For Authors for details).
Questions for authors
Please address the questions below, particularly the dataset and evaluation protocols, and check the inconsistencies in the reported metrics and training settings. Explaining these differences is important for assessing the main conclusions and the reliability of the experiments:
-
The MSD setup is unclear. The paper mentions three MSD subsets in the training data but does not name them. It is also unclear which tasks and evaluation settings the MSD results in Table 1 cover. Please specify these details.
-
Different models have identical results across multiple metrics. In Table 1, U-KAN and U-RWKV report exactly the same values for all four MSD metrics. This seems unusual. Please check these results and explain why they are identical.
-
The full list of 21 training datasets is missing. Line 323 states that PhysiVLM is trained on 21 public CT/MRI segmentation datasets, but these datasets are not fully listed. Please provide the complete list and explain how each dataset is used.
-
R1Seg’s metric calculations need clarification. For large targets, Table 2 reports a Dice score of 76.5%, Precision of 70.0%, and Recall of 67.0%. If these metrics use the same samples, weights, and standard definitions, the mean Dice cannot exceed the harmonic mean of the mean Precision and Recall, which gives an upper bound of approximately 68.47%. Please check these values and explain how each metric is calculated and aggregated.
-
VILA’s subgroup results do not match its overall results. If VILA in Table 2 is VILA-M3 in Table 1, and both tables use the same test set and aggregation method, the overall Dice should lie between the large-target score of 57.8% and the small-target score of 48.7%. It therefore cannot be the 33.3% reported in Table 1. HD95 shows a similar issue: both subgroup values are higher than the overall value. Please clarify the model, evaluation cohort, and aggregation method used in each table.
-
PhysiVLM’s results imply inconsistent subgroup weights. If Tables 1 and 2 use the same set of valid cases, the same grouping, and case-wise averaging, let be the proportion of large targets. Then: From Dice, we obtain: From HD95, we obtain:
For the same set of cases, the proportion of large targets cannot be both 27.2% and 16.5%. This difference may come from how empty masks are handled, how metrics are aggregated, or the use of different MSD subsets in the two tables. Please explain the calculation steps. If the tables use different subsets, please also explain why.
-
The Stage 2 training duration is inconsistent. Lines 808–809 in Appendix A.3 on page 15 state that Stage 2 is trained for 15,000 epochs, while Table 9 lists 1,500 epochs. Please confirm the actual number of epochs and the training schedule used.
The manuscript also has the following editing and reproducibility issues:
-
The title does not match the content. The PDF is titled “AudioRouter: Audio-Guided Visual Compression for Streaming Video Language Models,” which is unrelated to the study presented. Please check the manuscript version.
-
Unexplained citation markers remain in the text. Markers such as
:contentReference[oaicite:…]index=…appear at lines 715, 787, 809, and 823, among others. Their meaning and sources are unclear. Please clarify what they refer to and clean up these markers. -
The anonymous code link could not be accessed. I could not access the anonymous code link during the review, so I was unable to check the implementation and evaluation pipeline. Please provide a working link or the relevant code materials.