- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes FreeEvolve, a framework that allows LLM-based evolvers to manage their own optimization campaigns. Instead of following a predefined search loop, the evolver decides which tasks to evaluate, how to allocate resources, which candidates to pursue, and when to stop. The authors further introduce meta-evolution to improve the evolution skill itself. Candidate skills are evaluated through complete worker-evolution campaigns. Experiments on τ³-bench, ARC-AGI-2, ARC-AGI-3, and Terminal-Bench 2.1 show that FreeEvolve generally outperforms existing evolution frameworks. Additional analyses examine the benefits of meta-evolution, cross-environment transfer, and adaptive campaign decisions.
Critical strengths
The paper extends agent evolution beyond candidate generation by allowing the evolver to manage evaluation, resource allocation, and search decisions. Treating the evolution skill as an editable target is also interesting. It provides a way to improve the optimization process using feedback from complete evolution campaigns.
FreeEvolve achieves strong performance on four different agent environments. The fresh-worker experiments help evaluate whether improvements are retained in the learned evolution skill. The cross-environment transfer experiments and campaign-control ablations provide additional evidence about how the method works.
Critical weaknesses
1. Unfair computational budgets in the main comparisons.
Table 1 compares methods under different stopping conditions and resource budgets. The baselines stop after five iterations without improvement, while FreeEvolve receives 24 hours of meta-evolution with up to five worker nodes. Although Appendix Table 9 reports wall-clock times, the total computational costs are not consistently compared. Figure 4(b) examines token efficiency but only on ARC-AGI-3. It remains unclear whether FreeEvolve's advantages would persist under matched computational budgets.
2. Insufficient isolation of the main methodological contribution.
The novelty over existing meta-evolution methods needs to be clarified. EvoX [1] already adapts its search strategy during optimization, while HyperAgents [2] evolves the mechanisms used to improve agents. FreeEvolve offers broader control over the campaign, but the specific benefits of this additional flexibility are not fully established.
Figure 3 shows that meta-evolved skills outperform the seed skill. However, this does not establish how much of the improvement comes from autonomous campaign control versus better evolution instructions. Table 4 examines several fixed decisions but only on τ³-bench. A more direct comparison would help isolate the contribution of the proposed mechanism.
References
[1] Liu et al. (2026). EvoX: Meta-Evolution for Automated Discovery. https://arxiv.org/abs/2602.23413
[2] Zhang et al. (2026). HyperAgents. https://arxiv.org/abs/2603.19461
Questions for authors
-
Could the authors compare FreeEvolve with the main baselines under matched computational budgets? Reporting performance against total token consumption and node-hours would help establish whether the gains come from more effective search.
-
Could the authors compare seed and meta-evolved skills under both fixed and autonomous campaign configurations? This would help isolate the contribution of learned campaign control from improved evolution instructions.
-
Could the authors directly test cross-model transfer of the learned evolution skill? For example, a skill learned using Opus 4.8 could be executed by Sonnet 4.6 on fresh worker tasks. Can the authors also explain the negative transfer observed on Terminal-Bench 2.1?
6 comments
The difference is not whether EvoX can discover a useful idea such as clustering; both methods can. The difference is how the idea is used in the next inner evolution. EvoX produces a search program whose behavior is determined before that evolution starts, while FreeEvolve learns a skill that decides how to apply the idea as evidence unfolds. This is not just a off-by-one-iteration issue. Previous meta-evolution work designs a fixed strategy based on past evolution experience and expected to work for a new evolution campaign, while FreeEvolve observe a principle, and how to use that is still adaptive during next evolution.
Of course, EvoX could also encode a very general adaptive agent-based controller in its search program, but this would move it toward the same design principle as FreeEvolve: giving the evolver control during the campaign.
2, How to use isolation to better single out the effect of broader control?
This is very critical, and we are also eager to study the impact of full control. This is why we conducted experiments in Table 4 as you also noted. We believe Table 4 shows partly that broader control is important, and we would like to extend the discussion here.
The isolation is not straightforward, because meta-evolution jointly changes how the evolver organizes the campaign and how it improves the worker. We use six settings to isolate in different aspects:
| Evolution setting | Tau-3 mean (%) | ARC-AGI-3 RHAE (%) |
|---|---|---|
| Seed Skill | 33.3 ± 5.3 | 61.7 ± 4.3 |
| Seed Skill without control | 35.6 ± 2.0 | 60.4 ± 4.4 |
| Meta-evolution using seed without control | 39.1 ± 7.2 | 62.2 ± 4.6 |
| Meta skill without campaign-control guidance | 39.1 ± 2.0 | 63.4 ± 2.0 |
| Meta skill without worker-improvement guidance | 44.8 ± 9.1 | 66.0 ± 8.8 |
| Full meta-evolved skill | 47.1 ± 8.7 | 70.3 ± 3.2 |
All results in this table follow the paper protocol: one evolution or meta-evolution search, followed by three held-out evaluations of the returned worker. The standard deviation is across these evaluations, not across independent searches.
First is your suggested experiment (comparing row 1 and 2), we remove all controls knob from the seed skill, we can see that the performance is comparable. This is expected, as we already pointed out in the submission, the seed skill does not know how to use the control, and removing it would not make significant impact on the performance.
Then for the control-removed Seed skill, we conducted meta-evolution on it, and we found that meta-evolution was only minimally helpful in this case (comparing row 3 and 6). This shows that the broader control and flexibility is critical for the meta-evolver to come up with effective strategy that generalize.
To take the evaluation further, we use the meta-evolved skill, and ask an LLM to separate compaign control prompt from the evolution prompt, and we performance ablation study by doing evolution using them individually. We can see that removing either one of them would results in performane decrease, so evolution prompt and campaign control have orthogonal effect, but overall removing campaign-control results in larger performance drop, showing that this is a major factor for the effectiveness of freeevolve.
- Cross model transfer.
Table 2 already shows the tranferrability across models, so in Table, not only the environment changes, the underlying model for evolver also switched from the source environment model to the target environment model. We have clarified this in the updated draft. The results in Table shows that evolver from opus 4.8 can transfer to both opus 4.7 and opus 5.
- Performance drop in terminal-bench.
We looked into the actual evaluation logs, the two negative transfer results shows more TimeOut error, this is potentially because the the two source skill favors harness that consistently check its solution correctness which is costly in terminal-bench, and lead to degradation.
Note: we carefully looked into the work you mentioned in Q4, but we believe they are only remotely connected to our work. And seems like you are referring to our work as Scope Protection. We were wondering, maybe you accidentially put some of your review to another submission to ours? Would you mind kindly let us know if this question is indeed for us address?
Thank you again for your time and effort in helping us improve our work, and we look forward to hearing back from you!
Dear Reviewer A6ZR,
We would like to again sincerely thank you for your constructive comments and feedback, and see if there is any further clarification or discussion we can do with you to make our discussion more fruitful. A short summary of what we did: 1, we provide matched-budget results, showing FreeEvolve is both effective and efficient with learned campaign control. 2, we conducted a series of experiment isolating the impact of free-control. We discussed that complete isolation is difficult, but also shows that the broader control is essential and effective in multiple scenarios. Let us know if this answers your questions, and we would love to address any further concerns you may have.
Sincerely, Authors.
Dear Reviewer A6ZR,
We really appreciate your thorough comments and your deep insights in helping us improve our work. Here we address your concerns as follow
We agree with you, Table 1 is not a strictly fair comparison. The purpose of Table 1, as we also suggested in line 315, is to show that given sufficient resource, ultimately how much better the worker can get using different evolver, so we try to compare the capability boundary and potential of the evolvers.
Hence, following your suggestion, we further assess the evolvers under comparable or less total token budgets. We conduct three independent searches with the frozen meta-evolved FreeEvolve skill on Tau-3 and ARC-AGI-3. Every search starts from the same fresh worker and runs for 12 hours. We evaluate each returned worker three times and use its mean held-out performance as one search-level observation.
Here, the mean and standard deviation are computed across the three independent searches, rather than repeated evaluations of one worker. Total search tokens include every model call during evolution.
We can see that, the evolved meta-skill is both more efficient and more effective. This is in fact very intuitive, under the same time budget, FreeEvolve can choose to focus on a subset for a specific problem, while GEPA and HyperAgents does not have such mechanism and have to evaluate the full set every time. So even when the ability to search and make changes is the same, FreeEvolve can be more efficient.
Meta-evolution itself is more costly indeed, what we picture is that a meta-evolution can produce effective frozen meta-skill, and is both efficient and effective as we show above. We have updated the full cost table in the Appendix.
This is a very keen observation! We'd like to answer this from two angles:
1, How does freeevolve compare to existing meta-evolution work like EvoX and HyperAgents?
You are correct. The advantage come from a broader control. I think its easier to illustatae via an example. (We will use EvoX as an example, but HyperAgent share a very similar mechanism and is comparable)
Let's say both FreeEvolve and EvoX conducted a similar inner evolution, they both identified that errors can usually be grouped into clusters, and focusing on solving individual clusters might be more beneficial then evaluating the whole dataset at once. And the following is what two frameworks would do and their consequences.
(Continues to the next reply)