- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies tool-augmented reasoning for ultra-high-resolution remote-sensing VQA. A pilot study with a zoom-in-only RL model on XLRS-Bench suggests that zoom-in mainly solves tasks with localized evidence and saturates on tasks requiring global search, multi-region comparison, or path reasoning. Motivated by this, the paper contributes (1) GeoMTVR, a dataset of about 13K UHR VQA samples whose questions come from SuperRSVQA and LRS-GRO-train, re-annotated with interleaved reasoning and crop-and-zoom, grounding, and auxiliary-line tool calls through a staged semi-automatic pipeline (Qwen3-VL-235B, GPT-5.2, GroundingDINO); (2) Reinforced Tool Attention Learning, which adds an advantage-weighted Jensen–Shannon divergence on final-layer attention at tool-call positions to the GRPO objective; and (3) GeoLens, a Qwen2.5-VL-7B model trained with SFT on GeoMTVR followed by RTAL.
Critical strengths
- The paper is well presented. The figures clearly illustrate the pilot study, the dataset, and the RTAL pipeline, and the layout is clean and easy to follow.
- GeoMTVR is a potentially useful resource for UHR remote sensing. It provides 13K VQA samples with interleaved reasoning, multi-tool calls, and returned visual observations.
Critical weaknesses
- Limited algorithmic novelty. RTAL is essentially Reinforced Attention Learning (RAL; Li et al., 2026), restricted to tool-call positions. Eqs. 2–8 follow RAL almost term by term, yet RAL is cited only as "inspiration". There is no comparison against RAL, so the 1.8-point gain over GRPO cannot be attributed to the tool-position mask, which is the only new component.
- The "beyond zooming" thesis is weakly supported. With the same SFT setup, zoom-only data and full multi-tool data differ by only 0.7 points (Table 14). The line tool appears in only about 5% of samples. No zoom-only model is trained under the same RL pipeline.
- The main results do not back the claims. On XLRS-Bench, the benchmark used for the pilot study and all ablations, GeoLens only ties the zoom-only GeoEyes on average and is best on 2 of 13 sub-tasks. It also shows no gain on the tasks that motivate the extra tools.
Questions for authors
- Can you compare RTAL against vanilla RAL (attention JSD on all response tokens) under the same SFT checkpoint, data, and steps, and against RTAL with the
response_regbranch removed? This is needed to attribute any gain to the tool-position mask. - Which objective is actually used in the reported experiments: Eq. 3 alone, or Eq. 3 plus the valid-response JSD branch described in Appendix A.2? If the latter, what is ?
- Can you report the mean and standard deviation over multiple seeds for SFT + GRPO and SFT + RTAL?
- Can you train a zoom-in-only variant with the same backbone, SFT data size, and RTAL stage, and report per-task results, especially on RP, RCCD, and CCR, where you claim multi-tool gains?
- Can you rerun the pilot-study Quality analysis with GeoLens on the same failure sets to show that the additional tools improve the persistently failed samples?
- Why does GeoLens trail GeoEyes on Overall Counting and GeoLLaVA-8K on Route Planning, the task types that motivate the grounding and line tools? How often is the line tool used on RP samples?
- Are the Qwen3-VL-235B-A22B values in Table 4 correct? Its OC and RC scores are far above those of all other models, while its RLUC and OMS scores are far below.
- How many generated trajectories were filtered or corrected by human annotators, by how many annotators, and with what agreement?
- How was the annotation quality of GeoMTVR evaluated? Since GPT-5.2 sees the ground-truth answer when it generates trajectories, are the intermediate steps checked to actually support that answer? Can you report trajectory correctness and bounding-box accuracy on a manually verified sample?