- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Evo², a framework that jointly evolves an agent's harness and the model responsible for improving that harness. A shared policy acts as both a Proposer, which generates harness modifications, and a Reflector, which analyzes execution feedback and suggests further improvements. The authors also introduce crossover searching to combine useful strategies from different branches of the harness evolution tree.
For weight evolution, EvoTIDE collects trajectories from both roles and trains the shared policy using SFT followed by interleaved GRPO. The experiments cover three coding benchmarks, proprietary models, and memory tasks. The results show improvements over existing self-evolving frameworks, along with cross-benchmark transfer of the evolved harnesses.
Critical strengths
S1. Interesting direction for self-evolving agents. The paper explores how experience from harness modifications can be used to improve the model responsible for generating those modifications. Connecting weight evolution with harness evolution is a reasonable direction for improving self-evolving systems.
S2. A unified framework for harness modification and feedback. Using a shared Proposer–Reflector policy allows the system to learn both how to modify a harness and how to interpret the results. The combination with crossover searching also provides a practical way to reuse improvements discovered in different branches.
S3. Encouraging results across several benchmarks. Evo² achieves strong performance on the three coding benchmarks, with particularly large improvements on Polyglot. The additional experiments on proprietary models and memory tasks suggest that parts of the framework can be applied beyond a single model or domain.
S4. Evidence of transferability. The evolved harnesses are evaluated on benchmarks different from those used during evolution, without additional updates. The results in Table 2 provide useful evidence that some discovered improvements generalize beyond their original tasks.
Critical weaknesses
W1. Limited methodological novelty. The main components of Evo², including reflection-guided modification, tree-based harness search, experience sharing, SFT, and GRPO, have been explored in previous work. While combining weight and harness evolution is interesting, the paper could better establish what fundamentally new mechanism makes their interaction more effective than existing self-improvement approaches.
W2. Insufficiently controlled comparisons with existing methods. The baselines use an untrained model as the evolver, whereas Evo² benefits from an evolver trained through EvoTIDE. This makes the main comparisons difficult to interpret, since the improvements may come from a stronger evolver rather than the proposed harness evolution procedure. Although Table 5 provides a trained-versus-untrained comparison within Evo², a more controlled comparison with baselines using the same trained evolver would be useful.
W3. The contributions of individual components are not sufficiently isolated. Evo² combines dual-role training, trajectory recovery, crossover searching, SFT, and interleaved GRPO. Table 5 examines weight evolution, but there is no comprehensive ablation separating these components.
W4. Potentially unfair harness selection in the proprietary-model experiments. Section 4.4 states that the baselines evaluate their top-ranked harness, while Evo² reports the better result of its two top-ranked harnesses.
Questions for authors
If the authors can carefully address the weaknesses, I can consider update my score
We thank the reviewer for the helpful review. Below, we provide detailed responses to your comments.
W1. Novelty.
W2. Baselines with the trained evolver.
W3. Component isolation. We will add a component-wise ablation in the revision: SFT, GRPO, shared vs. separate roles, trajectory recovery and crossover, under the same initial harness and search budget.
W4. Selection in the proprietary-model experiments. We re-scored every method under the same rule: the better of its two top-ranked harnesses.
Evo² remains first with GPT-5-mini and is second with Claude Haiku 4.5.
We sincerely thank you again for your thoughtful feedback and hope that these clarifications and additional results address your concerns; we would be happy to answer any follow-up questions.