- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates cross-domain few-shot object detection, focusing on the underexplored mechanism of candidate box selection, and highlights that this process may be a critical factor affecting detection performance. The authors find that under domain shift, high-quality candidate boxes may fall outside the selection budget and thus be discarded, while top-ranked boxes might fail to properly enclose the target. By comparing in-domain and cross-domain settings, they observe that this issue is more severe in cross-domain scenarios and attribute it to vision-language misalignment during candidate selection rather than insufficient candidate generation capability. Based on this insight, they propose a lightweight, plug-and-play method called Support-Conditioned Local Evidence (SCLE). SCLE constructs foreground and background prototypes using a small number of support samples, generates local evidence maps, and evaluates candidate boxes based on in-box purity and inside-outside contrast. A fusion-quota strategy then combines candidates ranked by semantic relevance and those ranked by local evidence, enabling better adaptation to the target-domain distribution without modifying the detector architecture, adding learnable parameters, or using external data. The paper presents a relatively novel research angle, and the experimental results validate its effectiveness to some extent. However, the argument regarding the root cause of the problem remains insufficiently substantiated, the methodological novelty is somewhat limited, and the existing experiments are insufficient to fully support the paper's core claims. While the authors primarily attribute candidate selection failures to cross-domain vision-language misalignment, they do not adequately establish this causal relationship. Additionally, the necessity of the three-channel quota strategy and the prototype construction approach, as well as their advantages over simpler alternatives, still require more compelling experimental evidence.
Critical strengths
- A Relatively Novel Perspective on the Research Problem This paper identifies pre-decoder candidate-box selection as an underexplored performance bottleneck in cross-domain few-shot object detection (CD-FSOD). By introducing the Coverage Gap metric, the authors quantitatively analyze the discrepancy between candidate-box generation and selection under domain shift. They demonstrate that some high-quality candidates may be discarded due to inaccurate semantic ranking, resulting in additional losses in object coverage. Unlike existing approaches that primarily focus on decoder optimization, fine-tuning strategies, or data augmentation, this work offers a different perspective on understanding performance limitations in CD-FSOD. The identification of this underexplored bottleneck provides meaningful research insights and constitutes an important strength of the paper.
- Lightweight Design, Good Compatibility, and Consistent Performance Improvements SCLE modifies only the pre-decoder candidate-box selection mechanism without altering the detector architecture, introducing additional learnable parameters, or requiring external data. This lightweight design offers good compatibility with existing Grounding-DINO-based detection frameworks and demonstrates practical potential. The experiments cover six cross-domain datasets under 1-shot, 5-shot, and 10-shot settings, showing consistent improvements in average mAP on both Grounding DINO and HED. Furthermore, the authors provide additional empirical evidence through candidate-box coverage analysis, component ablation studies, and hyperparameter sensitivity experiments. Although certain limitations remain in the experimental evaluation, the broad experimental coverage and consistent performance gains provide encouraging evidence of the method's practical value.
Critical weaknesses
- Insufficient Evidence for the Claimed Vision-Language Misalignment The paper uses the Coverage Gap metric to identify substantial coverage loss during candidate-box selection under domain shift and primarily attributes this issue to vision-language misalignment. However, the experiments do not directly quantify the degree of vision-language misalignment or adequately rule out alternative explanations, such as a weakened correlation between semantic confidence and localization quality, variations in object scale, and background complexity. Therefore, while the results demonstrate a potential bottleneck in candidate-box selection, they do not sufficiently establish vision-language misalignment as its primary cause.
- Insufficient Validation of the Three-Channel Quota Mechanism SCLE combines foreground and background prototypes, local evidence scoring, and a three-channel quota mechanism to improve candidate-box selection. However, the paper lacks direct comparisons with simpler alternatives, such as weighted score fusion or straightforward candidate re-ranking. Although Table 5 examines different quota allocations, the evaluation is limited to three datasets under the 1-shot setting. This is insufficient to establish the robustness of the fixed quota strategy across different domains and shot settings. Consequently, the necessity and advantages of the proposed quota mechanism over simpler alternatives remain insufficiently validated.
- Potential Confounding Factors in Candidate-Box Coverage Analysis In Section 6.3, the Semantic Top-K and SCLE models are trained independently, potentially resulting in differences in their candidate pools and feature representations. Therefore, the observed coverage improvements may not be solely attributable to the candidate-selection mechanism itself. Although the authors state that differences between the candidate pools are marginal, they do not provide sufficient quantitative evidence to support this assumption. A controlled comparison using the same frozen detector and identical candidate pool would help isolate the contribution of SCLE's selection strategy.
- Limited Robustness Evaluation of Support-Set Prototypes SCLE constructs foreground and background prototypes from a small number of labeled target-domain support samples and keeps them fixed during inference. Particularly in the 1-shot setting, these prototypes may be sensitive to support-sample selection, annotation noise, occlusion, and intra-class appearance variations. However, the paper does not systematically evaluate robustness across different support-set samplings or under perturbations to support-sample quality. As a result, the reliability of the proposed approach under challenging real-world conditions remains unclear.
Questions for authors
Question 1: Causal Evidence for Vision-Language Misalignment The paper primarily attributes candidate-box selection failures to vision-language misalignment. However, the Coverage Gap metric only quantifies the loss of candidate coverage during selection and does not directly establish the underlying cause. Could the authors provide additional evidence to support this explanation, such as an analysis of the correlation between semantic matching scores and candidate-box IoU? Question 2: Necessity of the Three-Channel Quota Mechanism Have the authors considered simpler alternatives, such as directly combining semantic scores and local evidence scores through weighted fusion or applying a straightforward candidate-box re-ranking strategy? How do these alternatives compare with the proposed three-channel quota mechanism in terms of detection performance? Additionally, how robust is the fixed quota allocation across different target domains and shot settings? Question 3: Isolating the Contribution of Candidate-Box Selection In Section 6.3, the models using Semantic Top-K and SCLE are trained independently, potentially introducing differences in their candidate pools and feature representations. Could the authors conduct a controlled comparison using the same frozen detector and identical candidate pool to isolate the contribution of the selection mechanism? This would help clarify whether the observed coverage improvements primarily result from the proposed selection strategy rather than differences introduced during training.
2 comments
W4 — Sensitivity to support image quality
We tested support-box annotation error and support-image quality separately.
Box perturbation. For each dataset, we use the 1-shot checkpoint with the highest validation mAP of its paper-selected model (default SCLE for FISH, background expansion 1.8 for UODD, FgOnly for Clipart1k, and BgOnly for NEU-DET). We fix the detector, support images, and clean test set, change each support box center and width/height by at most 5% or 10%, and rebuild the prototypes with three seeds at each perturbation level. This isolates the sensitivity of prototype construction to support-box errors; the detector is not retrained. Detection mAP is:
| Dataset | Paper result without perturbation | 5% perturbation | 10% perturbation |
|---|---|---|---|
| FISH | 43.3 | 42.97 ± 0.06 | 42.93 ± 0.06 |
| UODD | 23.6 | 23.50 ± 0.00 | 23.47 ± 0.06 |
| Clipart1k | 58.0 | 57.77 ± 0.06 | 57.77 ± 0.06 |
| NEU-DET | 17.0 | 16.90 ± 0.00 | 16.90 ± 0.00 |
The largest numerical difference between the perturbed results and the paper results without perturbation is 0.37 mAP points. We verified that the perturbation changes both the support boxes and rebuilt prototypes.
Support-image perturbation. For each dataset, we use the 1-shot checkpoint with the highest validation mAP of its paper-selected model, fix the detector, support images, and clean test set, add fixed Gaussian pixel noise (standard deviation 0.10 on the [0, 1] scale) only to the support images, rebuild the prototypes from the noisy supports, and evaluate on clean test images; the detector is not retrained:
| Dataset | Paper result without perturbation | Noisy support (no retraining) | mAP change |
|---|---|---|---|
| FISH | 43.3 | 43.0 | −0.3 |
| UODD | 23.6 | 23.4 | −0.2 |
| Clipart1k | 58.0 | 57.8 | −0.2 |
| NEU-DET | 17.0 | 16.9 | −0.1 |
Under the tested settings, prototypes rebuilt from noisy support images have little effect on the frozen detector; the mAP change is at most 0.3 points across the four domains.
Questions 1–3
Q1. See W1. The two-way matching-score change on fixed candidate boxes directly tests how vision–language matching affects selection.
Q2. See W2. The no-quota fusion comparison tests the value of quotas; the main results across six domains, three shot settings, and two detectors test the fixed allocation across settings.
Q3. See W3. Changing only the selection rule on the same frozen model and candidate pools reduces the six-domain mean coverage gap at all three shot settings.
W1 — Evidence for vision–language misalignment
Thank you for noting that the coverage gap alone does not explain why good candidates are missed. To directly test the effect of vision–language matching on selection, we construct class visual prototypes from target-domain 1-shot supports. We fix the test-image encoder features, all candidate boxes, and the Top-900 budget, mix each original class text feature with its corresponding visual prototype at a 0.75:0.25 ratio, normalize the mixture, temporarily replace the original text feature with the result, and recompute matching scores and selection. We also mix in the negated visual prototype or a random vector with the same weight to test moving away from the prototype and a random perturbation. On UODD, the results are as follows. Retention is measured only for objects that already have an IoU ≥ 0.75 box in the candidate pool:
With the locations and number of candidate boxes unchanged, moving toward the visual prototype increases retention by 2.95 percentage points, whereas moving away reduces it by 11.04 points; the random control increases it by only 0.30 points. This bidirectional controlled perturbation shows that vision–language matching affects which existing good boxes are selected.
W2 — Value of quota selection across domains and shot settings
To test the suggested score fusion and direct reranking alternative, we rank all candidates by the fused score in Eq. (10) and take the Top-900 without quotas. SCLE instead reserves the 900 slots for semantic, local, and joint evidence. The end-to-end detection results on DeepFish, UODD, Clipart1k, and NEU-DET are as follows (four-domain mean mAP, %):
Direct fused-score ranking performs below semantic-only selection at every shot setting, whereas SCLE achieves the highest four-domain mean mAP. These results show that direct fused-score ranking does not replace quota selection.
The main results test the fixed allocation across settings. We use the same 450/225/225 quota on all six target domains, at 1/5/10 shots, and with both Grounding DINO and HED, without tuning it by domain or shot. Relative to their respective baselines, six-domain mean mAP improves by 7.4/3.2/3.1 points for Grounding DINO and 1.5/1.0/0.7 points for HED. Table 5 addresses a different question, sensitivity to the quota values: changing the semantic allocation from 300 to 600 changes mAP by at most 1.3 points on the three tested 1-shot datasets.
W3 — Confounding in the coverage analysis
We isolated the selection rule with a frozen-model control. For each test image, we computed the encoder candidates once, then applied semantic Top-900 and SCLE to the same features and boxes under the same 900-box budget. The mean coverage gap across the complete test sets of six domains is shown below (IoU ≥ 0.75; lower is better):
The six-domain mean improves at every shot setting. On UODD at 1 shot, the gap decreases from 0.108 to 0.071. This matched-pool experiment attributes the measured coverage gain to selection at a fixed representation; Sec. 6.3 reports the related end-to-end comparison.