- Rating
- 1
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Authors present a GeoRlex to handle UHR remote-sensing understanding which reasons to examine and corrects using multi-step visual observation. To do so, they curate a dataset called GeoRelex-48K to include the generator, reflector and refiner capabilities through SFT and RL, guiding the model when to reflect and how to correct. Authors evaluated their method over 3 benchmarks showing better scores.
Critical strengths
A) Authors proposed a framework that does UHR remote-sensing understanding as a visual perception problem through reasoning, reflection to diagnose insufficient evidence and guide the observation.
B) Authors construct a GeoRflex-48K which contains the trajectories to supervise the generation, teacher diagnoses supervise reflection, and restore the state to supervise the next correct trajectory using fallback tool which restores the parent view.
C) Author proposed recovery learned in the context when there error happens
D) The reflection reward penalizes the unnecessary reflections to avoid blind refection.
Critical weaknesses
A) The novelty is limited. The contribution overlaps heavily with prior work, for example zoom tools with GRPO are existing well established methods such as (Deepeyes, Geoeyes, GeoLens, GeoVista, ZoomEarth). However the parent-view fallback and judge reflection are minor contributions. But these can be seen as zoomout tool.
B) Authors claim where to look, ZoomEarth’s region-guided reward and GeoLens invoke the tools which tool to select and where to apply it.
C) I see that table 1 has different evaluation scores from GeoLens and ZoomEarth comparison tables against XLRS. Why it is so.
D) Table 2 does not compare scores only with format and accuracy. Since SFT and RL is performed, the gain with reflection and geometry reward might be minimum. Additionally, geometry rewards are common which are giving major gain whereas reflection reward is less contributing. Why it so?
Questions for authors
A) Why the scores are different in your table compared to GeoLens and ZoomEarth comparison tables against XLRS and similar trend is seen for all RSHR, XLRS, and MME-RS benchmarks,
B)- It is better to see how much percentage the reflection is called. How often reflection and fallback happen on the full benchmarks, and accuracy on questions with and without reflection calls to better understand the reflection reward benefits.
C)- Additionally to see the score with format and accuracy rewards only.
D)- Why authors used Thinking model instead of stronger Instruct model?