- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes LucidSeg, a training-free framework that uses multimodal LLMs as evidence selectors rather than direct segmentation models. The MLLM makes two discrete decisions: (1) selecting annotated support examples for an in-context segmenter, and (2) selecting the anchor frame for SAM2 propagation in ultrasound sweeps. The actual masks are always produced by frozen segmentation models. The method is evaluated on four ultrasound datasets with multiple executors and MLLMs. The results show clear improvements over visual similarity on TG3K, modest gains on USST, and limited or no gains on MicroSeg/CardiacUDA; for video propagation, MLLM-selected anchors help on TG3K, while multi-start propagation works better on USST.
Critical strengths
-
Instead of requiring an MLLM to generate masks, boxes, or points, LucidSeg restricts it to discrete evidence-selection decisions and leaves geometry to frozen segmentation models. This is conceptually clean and makes the approach executor-agnostic.
-
The paper evaluates four ultrasound datasets, two in-context executors, several MLLMs, trained and training-free baselines, and multiple ablations. In particular, the substantial improvement over DINOv2 selection on TG3K supports the central hypothesis that semantic/anatomical judgment can help when visual similarity is misleading.
Critical weaknesses
-
The strongest result is on TG3K. On MicroSeg, LucidSeg is below DINOv2 similarity; on CardiacUDA the differences among support-selection strategies are small; and on USST the improvement is modest and configuration-dependent. Moreover, with Gemma-4-31B, withholding the query performs similarly or even better on three of four datasets, suggesting that part of the gain may come from selecting generally representative supports rather than query-specific anatomical reasoning.
-
The paper correctly uses cluster bootstrap confidence intervals because queries from the same unit are correlated, but the reported paired Wilcoxon tests appear to be performed over individual queries rather than units, which may produce overly optimistic p-values. In addition, Level 2 is evaluated on only 13 TG3K sweeps and 6 USST sweeps, and the authors explicitly note that full-system results on the single-vertebra USST setting are missing.
Questions for authors
-
Could the authors recompute the main significance tests using the patient/scan/unit as the statistical unit, or another test that explicitly accounts for within-unit correlation? Do the main TG3K and USST conclusions remain significant?
-
The paper states that TG3K scan units were reconstructed because patient/video identities are unavailable and therefore cannot guarantee that all supports come from different subjects. Could the authors quantify the potential leakage risk or provide results under a stricter exclusion strategy?
-
Can the authors provide the full LucidSeg pipeline on the available single-vertebra USST sweeps, or otherwise provide additional sweep-level experiments? This would help determine whether the success of anchor selection on TG3K generalizes beyond a single anatomy/acquisition pattern.
2 comments
Response to Reviewer 1T5j (2/2)
Q2. Leakage from reconstructed TG3K scan units, and a stricter exclusion.
The improvement does not shrink as the exclusion widens. DINOv2 similarity stays at the level of random supports throughout. DINOv3 similarity falls slightly, and LucidSeg_E with DINOv3 candidates stays level with or above it at every R.
We ran two checks.
(i) Similarity by unit distance. The mean DINOv2 cosine between pool frames is .804 within a unit. It is .750 for adjacent units, which are already excluded. It is .747 at distance 2 and .742 at distance ≥ 5. A query's maximum cosine is .915 to its own unit, .840 to adjacent units and .874 to the allowed pool. The supports LucidSeg chose average .76–.78. The nearest allowed frame lies at distance 2 in 16.5% of queries (10.2% if independent of the unit). Its cosine is at the level of distant units.
(ii) Stricter exclusion. We removed the query's unit and R neighbours on each side. We then re-ran the Gemma decision (exemplar mode).
| R (paper uses 1) | pool frames | random | DINOv2 | DINOv3 | LucidSeg_E (DINOv2 cand.) | LucidSeg_E (DINOv3 cand.) | (DINOv2 cand.) Δ vs DINOv2, UvS / MvS (p_u) | (DINOv3 cand.) Δ vs DINOv3, UvS / MvS (p_u) |
|---|---|---|---|---|---|---|---|---|
| 1 | 144 | .373 / .537 | .401 / .544 | .495 / .623 | .484 / .611 | .512 / .629 | +0.084 (0.0034) / +0.066 (0.01) | +0.017 (0.22) / +0.006 (0.84) |
| 2 | 129 | .388 / .542 | .404 / .556 | .491 / .626 | .509 / .607 | .515 / .622 | +0.105 (0.00024) / +0.052 (0.08) | +0.025 (0.24) / −0.005 (0.64) |
| 3 | 115 | .378 / .529 | .404 / .556 | .479 / .617 | .496 / .596 | .506 / .626 | +0.092 (0.0061) / +0.040 (0.094) | +0.027 (0.31) / +0.009 (0.89) |
Random supports are re-drawn for every R. So R = 1 gives .373 / .537, while the draw of Table 1 gives .384 / .547.
If one video had been split into non-adjacent units, the leak would help visual similarity, not the MLLM. DINOv3 similarity falls by 0.016 with UniverSeg and 0.006 with MultiverSeg from R = 1 to R = 3, so a leak, if there is one, favours the visual baseline. LucidSeg_E with DINOv3 candidates stays level with or above it at every R (p_u ≥ 0.22), and its value does not fall (.512, .515 and .506 with UniverSeg).
Q3. Full pipeline on the single-vertebra USST sweeps and more sweep-level experiments. Does anchor selection generalise beyond TG3K?
Every chain agrees. On the 50 vertebral segments, multi-start is best (+0.015 to +0.026 over the LLM anchor, p = 0.04–0.12). The LLM anchor is the best single start in every chain. It is +0.023 to +0.077 over the middle frame and +0.007 to +0.045 over confidence. It is +0.07 to +0.11 over a random candidate (p < 1e-5).
We ran the full system on all 50 USST test segments with all four support chains. We also ran it on the 14 single-vertebra segments of the Level-2 patients. Table 2 now reports the 50 segments.
| USST, MultiverSeg, K = 8 | middle | confidence | LLM anchor | all K (multi-start) | anchor oracle |
|---|---|---|---|---|---|
| 14 segments, DINOv2 supports | .658 | .673 | .671 | .703 | .726 |
| 14 segments, Gemma supports | .676 | .658 | .691 | .720 | .730 |
| 14 segments, GPT-5.5 supports | .589 | .642 | .671 | .723 | .724 |
| 50 segments, DINOv2 supports | .642 | .632 | .667 | .686 | .742 |
| 50 segments, Gemma supports | .661 | .695 | .702 | .726 | .767 |
| 50 segments, GPT-5.5 supports | .633 | .674 | .703 | .718 | .752 |
| 50 segments, GPT-6 Sol supports | .630 | .683 | .699 | .725 | .759 |
| 6 per-patient scans of the original version (each joins one patient's segments), DINOv2 / Gemma / GPT-5.5 supports | .623 / .640 / .633 | .589 / .630 / .622 | .678 / .665 / .632 | .712 / .726 / .724 | .706 / .706 / .695 |
So the anchor decision generalises from TG3K, but the single-anchor policy does not. One structure through the scan favours one well-chosen start. A structure that changes or repeats favours many starts. We made this choice a third discrete decision of the MLLM. One extra call per scan shows the MLLM the eight candidate frames with their predicted outlines. The MLLM answers whether the target is one continuous structure or a series of repeating structures. For "one" we propagate from the LLM anchor, and for "repeating" we use multi-start. It chose "one" on 92–100% of TG3K scans. It chose "repeating" on 50–67% of the 6 per-patient USST scans. This pipeline is at most 0.025 Dice below the better fixed policy (.764–.787 on TG3K, .688–.724 on the 6 per-patient USST scans). Supports chosen by Gemma-4-31B raise every anchor policy by 0.02–0.06 over DINOv2 supports on the 50 segments. TG3K has only 13 test scans, and the protocol fixes this number. The per-patient scans of the original version are given here for reference.
Response to Reviewer 1T5j (1/2)
Thank you for the positive assessment. You saw right away what the method offers: a training-free MLLM that only makes discrete choices over annotated evidence, so that every mask comes from a frozen segmenter and any executor can be used.
W1. Improvements are concentrated on TG3K. With Gemma-4-31B, withholding the query is similar or better on three of four datasets.
The general response (CQ1) gives the full comparison. You are right. How much the MLLM improves on image features depends on its own ability to generalize, and it differs across models and datasets. A stronger MLLM goes further above the features. With DINOv3 candidates, GPT-6 Sol in the exemplar mode is +0.047 above DINOv3 similarity on TG3K (p_u = 0.017) and level with it on MicroSeg, while Gemma-4-31B is level on both.
Withholding the query is as good on TG3K, CardiacUDA and USST. Still, one fixed support set loses 0.016–0.163 on these three datasets, significantly on CardiacUDA and USST. So the decision without the query still follows each query's candidate list.
On the withheld query, we built a fixed-set baseline. It uses one support set for all queries. The set is the four annotated frames chosen most often as supports when the query was withheld. It needs no MLLM call at test time.
W2 / Q1. Wilcoxon over queries may be optimistic. Recompute with the unit as the statistical unit.
The TG3K and USST improvements over DINOv2 stay significant at the unit level. On TG3K, all 13 scans are positive in the transfer mode. The improvement over the trained reranker on TG3K is no longer significant (p_u = 0.19). The paper now says "matched" instead of "improved on". The MicroSeg deficit becomes significant. The paper states it as such.
We recomputed every main test with the unit as the statistical unit. The unit is the scan on TG3K and the patient on USST and MicroSeg. CardiacUDA already has one query per patient. We average the paired differences within each unit. We then run a paired Wilcoxon over units (p_u) and a unit-bootstrap 95% CI.
The last eight rows also compare LucidSeg with DINOv3 similarity. LucidSeg_T is significantly above it on USST, significantly below it on MicroSeg and level with it on TG3K and CardiacUDA. LucidSeg_E is not significantly different from it on any dataset over units. Appendix D now defines the unit-level test. §5.1 gives both p-values for the key claims.