- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper addresses the issue of step reward assignment by considering dependencies of subsequent steps in earth observation agents. The same step could be right or wrong depending on whether its dependencies are fulfilled, which previous methods do not capture. The paper also contributes a new skill bank that is evolved based on the utility it provides.
Critical strengths
- The approach is intuitive and addresses weaknesses of previous approaches. Understanding how to assign rewards to each step is a challenging problem, and the work shows that building dependency checkers can improve on this front.
Critical weaknesses
- The benefit over baselines for GDL-GRPO is not clearly established. The utility improvements' confidence intervals include zero, and improvements beyond utility are demonstrated on metrics that are part of the reward policy, which just shows that optimizing for this metric increases it.
- The comparisons to baselines are not budget-matched. L. 288 states "TerraWeave also uses no-gradient admission and utility probes, leaving total execution cost unmatched," and Table 35 shows that TerraWeave ran environments, whereas the baselines only ran , over twice as many. This confounds the comparison. Especially with the previous weakness, it's not clear where the gains come. It seems plausible that the improvements from GDL-GRPO are a statistical artifact and that TerraWeave performs better only because it has twice the budget.
Questions for authors
- How would GDL-GRPO with the ReSkill skill bank perform?
- How would TerraWeave's skill bank perform with SALT?
- The code has not been provided, and descriptions from the paper raise implementation questions. For example, how has the decoding seed been implemented for API-hosted models such as GPT-5.5? Can authors provide the code?
- Why are the confidence intervals in Tables 26 and 30 exactly symmetric?
- How were the "Eligible / all" counts in Table 22 obtained?
TerraWeave: Core Contributions and Controlled Evidence
We thank the reviewers for their careful assessment and constructive questions. We would like to highlight the central contribution of TerraWeave and how the additional evidence clarifies its scope.
TerraWeave addresses two coupled challenges in stateful Earth-observation workflows: successful tool execution does not necessarily resolve the dependencies required for task completion, and the usefulness of a procedural skill changes as the receiving policy improves.
Our framework connects these challenges through a shared, execution-verified state interface. GDL-GRPO assigns credit at comparable dependency opportunities, while GeoSkillBank compiles executable procedures and evaluates their incremental utility through matched, frozen-policy ON/OFF continuations. Utility-selected skills subsequently inform policy learning, creating a grounded co-evolution process.
The controlled results support both mechanisms. With the Bank OFF and the same GeoVerify feedback, GDL-GRPO improves Ans./Gen. by +1.84/+2.30 points over GRPO+GeoVerify. Removing dependency-based grouping reduces HELD-OUT Binary Answer from 50.5% to 47.1%. Under the execution-count-matched comparison, TerraWeave achieves 50.37/77.01 versus 49.02/75.40 for ReSkill-EqualExec.
Our reviewer-specific responses provide the corresponding controls, diagnostic analyses, and implementation clarifications. We will incorporate these clarifications into the revised manuscript.