- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes a progressive approach to ultra-high-resolution (UHR) remote sensing visual question answering by decoupling linguistic information at different granularities. Specifically, it analyzes the structure of question descriptions and develops a coarse-to-fine visual search and localization process based on the extracted linguistic cues. Although the motivation is reasonable, several concerns remain regarding the methodological novelty, benchmark dependency, and experimental justification.
Critical strengths
- The paper presents a reasonable approach to decoupling linguistic information at different granularities, shifting from conventional uniform region partitioning and subsequent selection toward a text-guided, coarse-to-fine visual search process.
- The paper provides a useful analysis of the prominent question construction patterns in UHR remote sensing VQA benchmarks, highlighting the prevalence of explicit spatial cues and their potential value for visual evidence localization.
Critical weaknesses
- Exploiting target descriptions, reference objects, and spatial relationships for visual localization is already a well-established practice in remote sensing vision-language research. For example, Exploring Fine-Grained Image-Text Alignment for Referring Remote Sensing Image Segmentation (IEEE TGRS 2025) explicitly decouples object descriptions from spatial position information for fine-grained visual grounding. More notably, ProVG: Progressive Visual Grounding via Language Decoupling for Remote Sensing Imagery (ACM MM 2026) introduces a progressive localization framework based on decoupled linguistic cues. Similarly, GeoMag: A Vision-Language Model for Pixel-level Fine-Grained Remote Sensing Image Parsing (ACM MM 2025) explores prompt-guided region cropping and multi-granularity visual processing. While these studies differ in their specific tasks and implementations, they have already explored several key principles underlying the proposed approach. Therefore, the authors should clarify whether TraceEarth introduces any fundamentally new mechanisms beyond existing language-guided region retrieval, relational grounding, and progressive visual search methods.
- Benchmark-driven design rather than a fundamental paradigm shift: The proposed framework appears more closely aligned with a benchmark-driven engineering strategy than a fundamentally new transition from semantic matching to spatial tracing.
Questions for authors
- How does the proposed method perform when spatial cues in the questions are removed, paraphrased, or expressed with uncertainty? Can the framework robustly handle diverse and implicit spatial descriptions, or is its effectiveness largely restricted to the explicit spatial prompts and question patterns represented in the evaluated benchmarks?
6 comments
[Weakness 2: Beyond Benchmark-Driven Design — From Semantic Matching to Spatial Tracing]
We thank the reviewer for this important comment. We would like to clarify that TraceEarth is not designed around benchmark-specific question patterns, but proposes a distinct visual evidence acquisition strategy that addresses the intrinsic challenges of UHR remote sensing VQA and can be integrated into compatible existing visual search methods in a plug-and-play manner. As clarified in our response to Weakness 1, the transition from semantic matching to spatial tracing lies in using question-derived spatial roles and dependencies to directly govern how visual evidence is acquired and verified in UHR remote sensing VQA, rather than merely introducing another region-cropping heuristic.
-
From Semantic Matching to Spatial Tracing. Existing training-free UHR visual search methods commonly determine which regions to inspect through semantic relevance, visual feedback, or model-generated search decisions. While effective, these approaches do not necessarily translate the explicit spatial dependencies in a question into direct execution constraints. In contrast, TraceEarth shifts evidence acquisition from identifying semantically relevant regions to tracing where the target should be located. By converting image-level directions and object-relative relations into executable spatial constraints, TraceEarth determines the visual search path according to the spatial dependencies expressed in the question. This represents a substantive methodological distinction in evidence acquisition, rather than merely another implementation of region selection.
-
Motivation from UHR Remote Sensing VQA Rather Than Benchmark-Specific Heuristics. UHR remote sensing imagery presents inherent challenges, including extensive spatial coverage, numerous visually similar object instances, and limited visual token budgets. Semantic descriptions alone may therefore be insufficient to uniquely identify the target, whereas spatial constraints can substantially reduce localization ambiguity. As shown in Section 3 and Figure 2, explicit spatial cues occur in 95.26% (3,561/3,738) of MME-RealWorld-RS questions and 91.17% (2,808/3,080) of XLRS-Bench Lite questions. Importantly, TraceEarth interprets spatial information from the semantics of questions and answer candidates rather than relying on benchmark-specific keywords or fixed templates. As demonstrated by the evaluations on MME-RealWorld-RS, XLRS-Bench Lite, and LHRS-Bench, the framework achieves consistent improvements across different remote sensing VQA benchmarks, supporting its applicability beyond a single benchmark.
-
Preserving Baseline Accuracy Without Explicit Spatial Cues. Importantly, TraceEarth does not require every question to contain explicit directional descriptions or executable spatial constraints. When no executable spatial cue is identified, the framework falls back to the original image and vanilla VLM inference rather than forcing an inappropriate tracing operation. We further evaluate the 177 naturally occurring MME-RealWorld-RS questions without explicit spatial cues, obtaining the following results:
Subset # Questions Vanilla Qwen3-VL-8B (%) TraceEarth (%) Difference (pp) Without explicit spatial cues 177 55.37 55.37 0.00 Both methods achieve exactly the same 55.37% accuracy, demonstrating that TraceEarth preserves the baseline's aggregate performance on questions without explicit spatial guidance. This further shows that spatial tracing is applied when appropriate, rather than imposed on every question.
-
Plug-and-Play Compatibility with Existing Visual Search Methods. Furthermore, TraceEarth is not restricted to a standalone inference pipeline and can serve as a complementary module for existing visual search frameworks. As already demonstrated in Section 5.7 and Table 5, integrating TraceEarth into RAP improves average accuracy from 54.21% to 56.75% (+2.54 pp) while reducing average inference time from 96.57 s to 70.59 s (−25.98 s, approximately 26.9%). These results demonstrate that spatial tracing can complement an existing visual search strategy and improve its accuracy–efficiency trade-off, rather than functioning only as a benchmark-specific solution.
Overall, “from semantic matching to spatial tracing” represents a substantive change in visual evidence acquisition: from primarily evaluating region relevance to directly executing question-derived spatial constraints. This design addresses the intrinsic localization challenges of UHR remote sensing VQA, preserves baseline accuracy when explicit spatial cues are absent, and provides complementary benefits when integrated into existing visual search frameworks. We have clarified this methodological motivation and the scope of our contribution in the revised manuscript.
[Question 1: How does the proposed method perform when spatial cues in the questions are removed, paraphrased, or expressed with uncertainty? Can the framework robustly handle diverse and implicit spatial descriptions, or is its effectiveness largely restricted to the explicit spatial prompts and question patterns represented in the evaluated benchmarks?]
We thank the reviewer for raising this important question regarding the robustness and general applicability of TraceEarth. To address this concern, we conduct an additional paired evaluation of paraphrased, implicit, and uncertain spatial expressions, examine questions without explicit spatial references, and further clarify the semantic routing, conditional execution, and plug-and-play properties of our framework.
-
Spatial Cues as Constraints for Target Disambiguation. UHR remote sensing scenes often contain numerous visually similar object instances, making semantic descriptions insufficient to uniquely identify the intended target. Spatial cues help resolve this ambiguity by specifying image-level locations or relationships to reference objects, providing actionable guidance for visual evidence acquisition. For example, “the building to the right of the smaller football field near the image center” combines image-space and object-space constraints to identify a particular instance. Our analysis identifies spatial references in 3,561/3,738 questions (95.26%) on MME-RealWorld-RS and 2,808/3,080 questions (91.17%) on XLRS-Bench Lite, highlighting their prevalence in the evaluated benchmarks. While these proportions may partly reflect benchmark construction, they motivate spatially guided evidence acquisition. The following experiments further examine whether TraceEarth can interpret such constraints beyond their original wording.
-
Robustness to Diverse Spatial Expressions. To directly evaluate sensitivity to spatial wording, we conduct a controlled paired perturbation study on MME-RealWorld-RS using 200 original questions containing spatial cues. Each question is reformulated into three variants, resulting in 200 matched pairs per perturbation type:
- Paraphrased expressions: Rewording spatial descriptions while preserving their meaning, such as replacing “bottom right corner of the picture” with “the picture's lower-right corner”.
- Implicit expressions: Conveying spatial constraints indirectly, such as describing the lower-right corner as “the corner where the bottom and right edges of the image meet”, or expressing “the road is above the water” as “the water is below the road”.
- Uncertain expressions: Retaining the spatial direction while introducing qualifiers such as “roughly” or “approximately”.
The evaluation comprises 800 inputs (200 original questions and 600 rewritten variants), all evaluated using the same TraceEarth framework and frozen Qwen3-VL-8B backbone. Each variant is compared against its corresponding original question under identical inference settings.
Spatial Expression Matched Pairs Accuracy (%) Δ vs. Original (pp) Original 200 64.50 – Paraphrased 200 65.00 +0.50 Implicit 200 64.00 −0.50 Uncertain 200 63.50 −1.00 Relative to the original accuracy of 64.50%, the three perturbations yield changes of only +0.50, −0.50, and −1.00 percentage points, respectively. These small observed differences provide direct empirical evidence that TraceEarth can accommodate alternative spatial formulations, including indirect descriptions and uncertainty-qualified expressions, rather than relying exclusively on the original benchmark wording.
-
Semantic Spatial Routing Beyond Fixed Question Templates. The observed results are consistent with TraceEarth's design. Rather than relying on predefined directional keywords or fixed question-to-crop mappings, Spatial Intent Routing (SIR) uses the frozen VLM to interpret the semantic roles and dependencies of spatial information in both questions and candidate answers. Specifically, it distinguishes known spatial constraints used for localization from unknown positions or spatial relations that must be predicted, and selects the corresponding tracing or verification strategy. Image-Space Tracing (IST) handles image-referenced constraints, including natural-language directions, bounding boxes, and visual markers, while Object-Space Tracing (OST) handles reference entities and object-level spatial relationships. This semantic, task-aware design provides a mechanism for interpreting equivalent spatial meanings expressed in different forms, consistent with the small accuracy changes observed in our paired evaluation.
Dear Reviewer VqdC,
Thank you for your thorough review and feedback on our manuscript. We truly appreciate the time and effort you dedicated to understanding our work, and your constructive comments. Below, we respond to each of the concerns you raised. We hope this addresses your concerns and helps further improve your evaluation of our work.
[Weaknesses 1 : Distinction from Prior Spatial Grounding Methods]
We thank the reviewer for highlighting these related studies, and we fully acknowledge their contributions. While, we would like to clarify that TraceEarth differs fundamentally from these works in both its motivation and technical mechanisms. While FIANet, ProVG, and GeoMag primarily leverage linguistic and spatial cues to guide image-text alignment, progressive visual grounding, or region-level perception, TraceEarth transforms question-derived spatial cues and their dependencies into executable constraints that directly control visual evidence acquisition in UHR remote sensing VQA. Specifically, the roles of spatial cues determine which visual operations are performed, while their dependencies determine the execution order across image space and object space. This shifts local visual evidence acquisition from semantic matching to spatial tracing, rather than merely improving target localization or region selection. The key mechanisms are detailed below.
Answer-Role-Aware Spatial Execution. TraceEarth determines the execution strategy according to the role of spatial information in the question and candidate answers. Spatial Intent Routing (SIR) distinguishes known localization constraints, candidate image positions requiring verification, and unknown object relations requiring prediction. For example, “the building to the right of the field” provides a known localization constraint, whereas “Is the building to the left or right of the field?” requires inferring the relation itself. Treating the latter as a known search constraint would implicitly assume the answer. Thus, SIR distinguishes which spatial information can guide evidence acquisition and which must instead be inferred from visual evidence, enabling different execution paths for different VQA prediction targets.
Answer-Conditioned Evidence Construction and Verification. TraceEarth further translates these execution decisions into distinct evidence acquisition and verification mechanisms. For image-position questions, candidate locations are converted into independent local hypotheses, each evaluated through a Yes/No verification query using the frozen VLM. When the highest verification scores are insufficiently separated, the framework falls back to full-image inference. For object-relation questions, TraceEarth instead jointly localizes the relevant entities and preserves their relative spatial layout, allowing the unknown relation to be inferred from visual evidence. These mechanisms directly connect spatial tracing to the prediction target of VQA, rather than treating region localization as the final objective.
Spatial Disambiguation through Executable Tracing. Spatial cues are highly prevalent in UHR remote sensing VQA. As shown in Section 3 and Figure 2, explicit spatial cues appear in 95.26% of MME-RealWorld-RS and 91.17% of XLRS-Bench Lite questions. Repeated similar objects make semantic descriptions insufficient for precise localization. TraceEarth converts image-level directions and object-relative relations into executable spatial constraints, progressively narrowing the search space and reducing ambiguity among similar target instances. As illustrated in Figure 3, image-space localization and reference-object-guided tracing follow the spatial dependencies expressed in the question, rather than relying on generic coarse-to-fine visual search.
In summary, TraceEarth introduces an answer-role-aware, dependency-driven spatial execution framework that transforms question-derived spatial information into executable tracing and answer-conditioned evidence verification. Its methodological distinction lies in determining how spatial information should be used, constructing evidence according to the prediction target, and exploiting spatial dependencies to reduce localization ambiguity in UHR imagery. We will further clarify these distinctions from FIANet, ProVG, and GeoMag in Section 2.2 of the revised manuscript.