- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper targets the “where-to-look” bottleneck in ultra-high-resolution (UHR) remote sensing VQA, where models struggle to locate and exploit question-relevant visual evidence in extremely large images. It proposes RS-OPSD, a reliable privileged on-policy self-distillation framework that internalizes zoom-in evidence into the student during training while requiring only standard full-image input at inference. The authors construct GeoEvidence-6K with explicit evidence-region annotations and introduce HF-SR for human-feedback-guided annotation refinement. Methodologically, CPVP provides the teacher with global, contextual, and fine-grained evidence views, while CAD filters unreliable teacher supervision via sample-level reliability gating and correctness-aligned token updates. Experiments report strong results on three UHR remote sensing VQA benchmarks without additional visual search or tool calls at inference.
Critical strengths
- The paper clearly identifies the evidence-localization bottleneck in UHR remote sensing VQA and frames training-time privilege internalization as a sensible alternative to token pruning, inference-time search, and tool use.
- The pilot study exposes the limitations of naive crop-only OPSD, and CPVP and CAD are introduced as targeted remedies. The ablation results support their individual and combined effectiveness, making the design logic reasonably solid.
- GeoEvidence-6K and the HF-SR pipeline are valuable contributions in their own right. RS-OPSD also achieves a favorable accuracy-efficiency trade-off among the compared methods, and the Lite variant is notable for surpassing most evaluated 8B-scale models with only a 2B student while maintaining low inference latency.
Critical weaknesses
- The paper aims to internalize privileged visual information into the student model. However, it remains unclear what inductive bias this process introduces, what capabilities are actually internalized, and under which domains or task conditions such a bias is effective.
- Table 3 shows that naive OPSD slightly underperforms LoRA fine-tuning (45.2 vs. 45.7), while the complete framework improves performance to 49.3. However, the absence of a full-parameter SFT baseline makes it difficult to establish whether the proposed framework offers advantages beyond conventional supervised fine-tuning.
- The paper claims SOTA performance on three remote sensing VQA benchmarks, but several evaluated baselines are relatively outdated. More recent closed-source models (e.g., GPT-6, Claude Opus 5.5, Gemini 3.1 Pro) and open-source models (e.g., Qwen3.5-9B, Qwen3.8-27B) are not included, making the SOTA claim less convincing.
Questions for authors
The following questions correspond directly to the critical weaknesses above, and satisfactorily addressing them would positively influence my overall assessment and potentially increase my rating.
- Could the authors provide a more concrete explanation of what is internalized through OPSD? Specifically, does the proposed framework induce an inductive bias toward identifying and attending to question-relevant visual regions, or does it primarily improve the model's task-specific knowledge? Furthermore, what properties of a task or domain make this form of privileged information particularly effective? It would be valuable to discuss whether the proposed approach is expected to generalize to other high-resolution visual understanding tasks beyond remote sensing VQA.
- Could the authors include a full-parameter SFT baseline using the same GeoEvidence-6K dataset and comparable training settings? Given that naive OPSD underperforms LoRA in the pilot study, it is important to establish whether OPSD + CPVP + CAD offers advantages over full-parameter SFT. Beyond improvements in benchmark accuracy, are there specific capabilities, generalization properties, or robustness benefits that the proposed framework can provide but conventional SFT cannot?
- Could the authors provide additional comparisons with stronger, more recent closed-source and open-source vision-language models, such as GPT-6, Claude Opus 5.5, Gemini 3.1 Pro, and newer Qwen variants, where applicable? In particular, comparisons with more recent models of similar parameter scales would help establish whether RS-OPSD remains competitive under a fair model-size setting, while evaluations against larger frontier models would provide useful context for the broader SOTA claim.
Follow-up on Rebuttal Discussion
Dear Reviewer Y8gP,
We hope you are doing well. Since the discussion period is scheduled to close tomorrow, we would like to kindly follow up on our rebuttal responses.
We would be very happy to address any further questions or suggestions you may have and engage in additional discussion. We will do our best to respond promptly and thoroughly before the discussion period concludes.
Thank you again for your time and consideration.
Best regards,
The Authors of Submission 15361