- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies whether a remote-sensing grounding model should localize a target, request clarification, or abstain. It constructs RS-EviBench by keeping the original image–query pair, removing distinguishing attributes from the query, or masking the target. The proposed EASG combines a frozen LAE-DINO detector with Qwen2.5-VL, using marked images and candidate coordinates as prompts, followed by LoRA fine-tuning and an additional decision loss.
Critical strengths
Distinguishing an ambiguous query from insufficient visual evidence is practically useful. These situations can reasonably call for different responses.
Critical weaknesses
- The benchmark does not yet establish the intended evidence-aware decision ability beyond its construction process. The three labels closely follow three data-generation operations: the original query supports Ground, an attribute-deleted query produces Clarify, and a target-masked image produces Abstain. Adding auxiliary masks to Ground and Clarify is a useful control, but the mask-area, location, and aspect-ratio slices in Table 6 remain within this same construction process. They do not rule out other cues introduced by query editing or the masking procedure.
- The external benchmarks only evaluate localization, so neither tests whether Clarify and Abstain transfer to naturally ambiguous queries, missing targets, or different forms of visual degradation. Consequently, the high decision accuracy does not yet show that the model can make the intended distinction in realistic cases.
- The method’s contribution to the central decision task is limited, and the localization comparisons do not fully isolate its technical value. Ordinary Qwen2.5-VL SFT already reaches 96.44% decision accuracy, compared with 96.89% for EASG. Clarify F1 changes from 98.81 to 98.84. These results suggest that ordinary fine-tuning already solves most of the constructed decision task, while the added detector evidence mainly improves localization. Given the variation across EASG seeds in Table 4, the small decision gain also needs matched-seed comparisons with the baseline.
- The localization improvement is useful, but the method largely combines detector-generated visual prompts, coordinate prompts, and standard fine-tuning losses. A stronger comparison would use the same LAE-DINO evidence in a conventional proposal-ranking or refinement system. The oracle-proposal and output-dependence analyses show that EASG can go beyond copying a proposal, but do not establish its advantage over such an inference-time baseline.
Questions for authors
- Do the three-way decisions still work when ambiguity and insufficient evidence are created differently—for example, through independently written ambiguous queries, naturally missing targets, or different occlusion patterns? A text-only decision baseline would also help check whether Clarify can be recognized from the edited query alone.
- How does EASG compare with a grounding model that uses the same LAE-DINO proposals for ranking or refinement? Could the SFT baseline and EASG also be compared across the same training seeds to assess the small decision-accuracy difference?
- How were the data splits formed: by referring expression, image, or original source image? Since VRSBench includes DIOR imagery, please clarify whether the RS-EviBench training images overlap with DIOR-RSVG test images.
- Which LAE-DINO checkpoint was used, and what data was used to train it? This matters for interpreting the DIOR-RSVG results as cross-dataset generalization of the complete system.