- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes TerraEvo, a self-evolution framework for earth-observation VLMs that trains a Proposer and a Solver jointly from unlabeled remote-sensing imagery, with no human annotations and no external judge. Specifically, TerraEvo uses a skill-guided Socratic dialogue to turn the Solver's answer disagreement into targeted follow-up questions, while skill balancing, quality supervision, adaptive rewards, and knowledge-preservation mechanisms keep the self-generated data grounded and diverse. On five RS benchmarks, the Qwen3-VL-4B-based model reaches 54.2% average accuracy, the highest among all. Ablations on GeoBench-VLM also support each component in TerraEvo.
Critical strengths
- The motivation of the paper is clear, and the performance of TerraEvo is good.
- The component ablations are quite comprehensive.
Critical weaknesses
- The experiments are currently conducted only with Qwen3-VL-4B-Instruct. There is no evaluation across different model families (e.g., Llama, Gemma, etc.), nor are larger-scale models or more recent models from the Qwen series tested. This limited scope makes it difficult to assess whether the observed findings generalize beyond this single configuration.
Questions for authors
Please see weaknesses.
3 comments
Thank you for responses. I will maintain my positive score.
Thank you to Reviewer LZjP
Dear Reviewer LZjP,
Thank you for reading our responses and for keeping your positive score. We appreciate your feedback and your time throughout the review process. We have included the results on the larger model (Qwen3-VL-8B) in the revised manuscript.
Authors
Response to Reviewer LZjP: results on a larger model (Qwen3-VL-8B)
We thank the reviewer for the summary, for recognizing the motivation, performance, and component ablations, and for encouraging evaluation beyond the 4B model. The submitted paper reported the 4B experiments, and the 8B experiment was still running at that time. We now report its completed results below and in Table 1 of the revised manuscript.
Weakness 1 and Question 1: larger model. Question 1 refers to the weaknesses, so this reply answers both. Accuracy (%) on five EO benchmarks. Average is the unweighted mean of the five scores.
Gain over the base model (points).
What the results show. TerraEvo improves over its base model on all five benchmarks at both sizes. The average gain is +2.5 points for 4B and +1.5 points for 8B. The 8B base model is already stronger than the 4B base model, which may leave less room for gains. Compared with TerraEvo 4B, TerraEvo 8B is higher on GeoBench-VLM, XLRS-Bench, and MME-RealWorld-RS, and lower on RSHR-Bench and LHRS-Bench. Its average is higher (54.6 vs. 54.2). Both models are trained for 3,000 steps with seed 42.
Scope. We agree that broader testing would further show how well TerraEvo generalizes. In the discussion period, we did not evaluate models larger than 8B, other model families such as Llama or Gemma, or more recent Qwen models. Our evidence therefore covers Qwen3-VL at two sizes. All other experiments and analyses in the paper use Qwen3-VL-4B-Instruct.
Changes in the manuscript: Sections 5.1 and 5.2 and Table 1.