- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies cross-domain few-shot segmentation (CD-FSS), where source and target domains differ in both data distribution and label space, and no source-domain training data are available; no model parameters are updated. The authors propose a training-free framework that directly reuses a fully frozen SAM3, a foundation segmentation model supporting "promptable concept segmentation" with text or visual-exemplar prompts. The method has three components:
- Shared spatial canvas: the support and query images are composed into one canvas, so SAM3 can model cross-image correspondence within a single forward pass via its native attention. The support mask is converted to a tight box and mapped to canvas coordinates as a visual prompt.
- Dual-branch candidate generation: a visual-only branch uses only the support box; a visual-text branch additionally uses the class name as a text prompt. Candidates from both branches are merged into a unified candidate pool.
- Candidate reliability calibration: each candidate is scored by a weighted fusion of (i) SAM3's own confidence, (ii) support–query prototype consistency (cosine similarity of the candidate's regional feature to support foreground vs. background prototypes in the frozen encoder's feature space), and (iii) cross-branch agreement (max IoU with candidates from the other branch). Candidates above threshold δ are retained and merged by pixel-wise union. Validation: on DeepGlobe, ISIC, Chest X-Ray, and FSS-1000, the method reports 71.56% (1-shot) and 74.60% (5-shot) average mIoU, outperforming the listed training-required CD-FSS methods and several SAM-based training-free methods. Ablations cover canvas layout, calibration terms, threshold, fusion weights, negative prompting, and domain-aware text prompts, plus qualitative comparisons, failure cases, inference speed (7.5–9.8 FPS), and pseudocode.
the novelty is primarily a system-level combination—"frozen SAM3 + dual-branch candidate calibration"—rather than a new learning mechanism; this matters for assessing the contribution.
Critical strengths
- The problem formulation and the method are cleanly matched, with practical value. Rather than training a cross-domain adapter, the authors exploit SAM3's concept segmentation and text/visual-exemplar prompting to recast CD-FSS as spatial reasoning on a shared canvas, achieving the best average 1-shot/5-shot results in Table 1 (71.56/74.60) with zero source-domain data and zero parameter updates. This is meaningful for settings where source data are unavailable or compute is limited, and it challenges the default assumption that CD-FSS must be trained.
- The dual-branch + three-term calibration design is clearly motivated and supported by ablations. The authors first use a preliminary analysis (Fig. 1(a)) to show the domain-dependence of text prompting and a "prompt conflict" effect, then design complementary branches accordingly. Table 3 shows prototype consistency and cross-branch agreement each help (70.16→71.15 / 71.02) and their combination is best (71.56); Fig. 4 shows the dual branch is never worse than either single branch across domains; Figs. 5–6 provide qualitative support.
Critical weaknesses
- The attribution of the core gain is not clean, and the necessity of the dual branch is not isolated. Fig. 4 only shows bar plots of average/per-domain mIoU, with no per-domain numeric table; and the Table 3 calibration ablation appears to be run on the dual-branch pool. A reader cannot tell how much performance would drop if (a) candidates from the visual-text branch were fed into the same calibration and threshold (a single-branch-generation + dual-branch-calibration mismatch), or (b) the dual branch were used without prototype/agreement calibration. If the dual-branch gain mainly comes from "a larger candidate pool + calibration picking the better one," the contribution is closer to candidate re-ranking than to complementary prompting, which would materially affect the novelty judgment.
- The negative-prompt conclusion may be confounded by the experimental construction and is in tension with the paper's own motivation. Table 5 shows performance degrading monotonically when negative prompts are added (71.56→66.63→63.14→60.90), attributed to "SAM3 being sensitive to negative guidance" and supported by the t-SNE in Fig. 6. But per Sec. 5.4, negative prompts are built by running SAM3 on the support image with a positive box and converting low-confidence candidates into negative boxes—those low-confidence candidates are themselves likely noise or background fragments, so using them as negative prompts injects erroneous spatial priors. The experiment therefore more plausibly shows "this automatic way of constructing negatives is unreliable" than "SAM3 should not use negative prompts." The claim is currently too strong; please weaken it.
Questions for authors
- Fig. 4 reports visual-only 64.95, visual-text 62.24, and dual-branch 71.56 average mIoU. Table 3(a) reports a no-calibration baseline of 70.16. Please clarify: (a) were the single-branch numbers in Fig. 4 obtained with the same reliability calibration (prototype consistency + cross-branch agreement + δ) as the dual-branch number, or without it? (b) Does the 70.16 baseline correspond to the dual-branch candidate pool scored by SAM3 confidence alone? This determines whether the dual-branch gain comes from complementary candidates or from calibration operating over a larger pool.
- Sec. 5.4 states that negative prompts are obtained by converting low-confidence candidates from the support image into negative boxes. Please specify the criterion for "low-confidence" (threshold or count) and whether such candidates may themselves be background/noise. If negatives were instead drawn from confident background regions outside the support mask, would the monotonic degradation in Table 5 persist? This affects whether the conclusion is "SAM3 is sensitive to negative guidance" or "this particular construction is unreliable."
- Please clarify the irreplaceable component of this work relative to the training-free baselines already in Table 1 (Matcher, CPS, GF-SAM), given that the shared-canvas idea is explicitly credited to Tsai et al. (2026).
- Please report the fraction of episodes in which no candidate passes δ and an empty mask is returned on each of the four datasets. Table 4 indicates that the 5-shot setting uses the same α=1.0, β=0.2, γ=0.1; please confirm that δ=0.5 is also retained for 5-shot and briefly justify why no shot-specific adjustment is needed.
2 comments
Q3: Our contribution couples complementary visual-only and visual–text candidate generation with support-conditioned candidate selection. The two branches expand the candidate pool, while selection combines SAM3 confidence, foreground–background prototype consistency, and cross-branch agreement to retain candidates matching the support-defined target. Matcher uses feature matching and instance-level selection, CPS adapts matched-point density, and GF-SAM employs graph clustering and gating. Our distinction lies in jointly exploiting complementary prompting routes and candidate reliability, with their contributions supported by Tables 5 and 6.
Table 5. Threshold analysis of candidate pools and calibration variants under the 1-shot setting. Results are reported as mIoU (%).
| Candidate pool | Prototype | Cross-branch | δ = 0.3 | δ = 0.4 | δ = 0.5 | δ = 0.6 |
|---|---|---|---|---|---|---|
| Visual-only + visual-text | – | – | 68.85 | 69.45 | 70.16 | 69.91 |
| Visual-only + visual-text | ✓ | – | 69.95 | 70.61 | 71.15 | 70.96 |
| Visual-only + visual-text | – | ✓ | 69.72 | 70.38 | 71.02 | 70.67 |
| Visual-only + visual-text | ✓ | ✓ | 70.31 | 70.98 | 71.56 | 71.24 |
| V-Top + V-Bottom | ✓ | ✓ | 66.71 | 67.25 | 67.86 | 67.51 |
Table 6. Decomposition of 1-shot mIoU (%) across three matched episode seeds. Results are reported as mean ± standard deviation.
| Configuration | DeepGlobe | ISIC | Chest X-ray | FSS-1000 | Average |
|---|---|---|---|---|---|
| Visual-only, confidence-only | 26.18 ± 0.25 | 62.97 ± 0.19 | 80.43 ± 0.25 | 84.62 ± 0.18 | 63.55 ± 0.21 |
| Dual-branch, confidence-only | 44.59 ± 0.24 | 64.13 ± 0.23 | 83.25 ± 0.19 | 88.67 ± 0.16 | 70.16 ± 0.21 |
| Dual-branch, full calibration | 46.05 ± 0.21 | 65.55 ± 0.18 | 84.60 ± 0.22 | 90.04 ± 0.15 | 71.56 ± 0.19 |
Table 5 demonstrates the benefits of complementary prompting and individual calibration components, while Table 6 separates the gains from dual-branch candidate generation and full calibration, reporting means and standard deviations across three matched episode seeds on four datasets.
Q4: The fractions of successfully evaluated episodes in which no candidate passes δ and an empty mask is returned are 10.21% for DeepGlobe, 7.17% for ISIC, 4.00% for Chest X-ray, and 1.96% for FSS-1000. For 5-shot evaluation, we retain δ = 0.5 together with α = 1.0, β = 0.2, and γ = 0.1. The support prototypes are averaged and re-normalized, and the candidate-scoring formula remains unchanged, so increasing the support count does not change the nominal score range. We therefore use the same threshold as a consistent evaluation setting, rather than introducing shot-specific tuning.
We thank the reviewer for the detailed assessment and for highlighting the clear motivation and supporting ablations of our dual-branch design. Your comments help us clarify the sources of performance gains, refine the interpretation of the negative-prompt experiments, and better define our contribution. We respond to each point below.
Response:
Q1:(a) The single-branch results in Fig. 4 use SAM3 confidence and prototype consistency with the same fixed selection threshold, δ = 0.5. Cross-branch agreement is omitted because it is undefined for a single branch. The dual-branch result additionally includes cross-branch agreement. Thus, Fig. 4 does not isolate candidate-generation effects under identical scoring terms. (b) The 70.16% result in Table 3(a) corresponds to the combined visual-only and visual–text candidate pool filtered using SAM3 confidence alone, with δ = 0.5. Applying full calibration to this same pool increases average mIoU to 71.56%. This comparison isolates the contribution of calibration within the dual-branch pool, whereas Fig. 4 compares the overall branch configurations.
Q2: In our implementation, “low-confidence” candidates are defined as support-image predictions with scores in the interval 0.1 < s ≤ 0.5. Candidates whose intersection with any positive candidate box exceeds 5% of their own area are removed. The remaining boxes are sorted by score, filtered using non-maximum suppression with an IoU threshold of 0.5, and capped at the specified maximum number of negative prompts. These candidates may contain background, noise, or unrecognized foreground regions. We tested negative boxes sampled from annotated support-background regions. As shown in Table 8, increasing their maximum number from one to three reduces average mIoU from 63.60% to 57.12%, with declines across all four domains. Thus, the degradation is not limited to low-confidence negatives and supports sensitivity to negative guidance under our evaluated setting.
Table 8. Comparison of negative prompts derived from low-confidence candidates and annotated support-background regions. Results are reported as mIoU (%).