- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes EvoAge, an evolutionary framework for automated problem solving (APS) in combinatorial optimization that extends automated heuristic design beyond individual heuristics to the organization and optimization of complete problem-solving workflows. EvoAge jointly evolves instance-specific plans and a persistent skill library: plan evolution optimizes the composition, ordering, parameters, and control flow of operations, while skill evolution extracts and refines reusable experience across instances, with paired validation to assess skill modifications. The resulting workflows can express conditional operation selection, execution order, and stopping rules. Experiments on four combinatorial optimization problem families show that EvoAge achieves competitive performance across the evaluated instances.
Critical strengths
-
This paper proposes a meaningful extension from a single heuristic design to a complete problem-solving workflow design. In complex combinatorial optimization, solution quality can depend not only on the choice of an individual operator but also on how different operations are composed and when they are executed. EvoAge explicitly optimizes these decisions. This broader design space may also help explain its reported advantages over AHD baselines.
-
The final output skills include conditional operation selection, execution sequence, and stopping rules, making it reasonably checkable and reusable.
Critical weaknesses
-
Insufficiently established novelty relative to existing agent-based AHD and self-evolving agents. Although APS is a meaningful framing, the paper does not clearly establish the technical boundary between EvoAge and existing approaches that combine tool-using agents, iterative plan refinement, persistent memory, and experience reuse. In particular, the paper needs to clarify which capabilities arise from a fundamentally new method rather than from integrating these mechanisms into a unified framework. Without a sharper comparison and clearer identification of the methodological novelty, the central contribution remains insufficiently established.
-
Insufficient ablation studies and incomplete accounting of computational costs. The experiments do not adequately isolate the contributions of plan evolution, skill evolution, persistent memory, and skill validation. Consequently, it is difficult to determine whether the reported gains come from the proposed dual-evolution mechanism, accumulated experience, or simply a more flexible workflow with access to multiple operations. In addition, the reported per-instance execution budget does not capture the cost of constructing and refining the skill library. Without matched-budget ablations and a clear accounting of training and validation costs, the paper cannot establish the effectiveness of its central mechanisms or support broader conclusions about efficiency.
Questions for authors
-
What are the essential algorithmic differences between EvoAge and existing self-evolving agent frameworks that already support iterative planning, tool use, and persistent experience? Which specific capabilities or mechanisms constitute the methodological novelty of EvoAge, rather than an integration of existing components?
-
Under matched LLM-call and execution budgets, how much performance improvement is attributable to plan evolution and skill evolution individually? In particular, do the authors have ablation results comparing the full framework against variants without skill evolution, without plan evolution, with a fixed skill library, and without skill validation? Without such evidence, it is difficult to determine whether the proposed mechanisms are responsible for the reported gains.
-
What are the total computational costs of building and refining the skill library, including LLM calls or tokens, plan evaluations, validation runs, and wall-clock time? Are these costs included in the reported budgets, and are the total computational resources allocated to EvoAge and the AHD baselines comparable? A complete accounting is important for assessing both the fairness of the performance comparisons and the practical efficiency of the proposed framework.
-
Do the compared AHD and agent-based baselines have access to the same underlying operations and solver tools as EvoAge? If not, how much of the performance difference can be attributed to workflow evolution rather than to EvoAge's broader set of available operations? A comparison against a non-evolving planner using the same toolbox would help isolate the contribution of the proposed evolution mechanisms.
-
The presented skills appear to primarily combine and coordinate existing optimization techniques, rather than introduce fundamentally new solving operators or tools. How do the authors distinguish workflow-level innovation from the autonomous discovery of new problem-solving capabilities? More specifically, what evidence supports the claims about expanding beyond predefined capabilities, given that the framework appears to operate within an available set of operations and tools?
8 comments
Response to Critical Weaknesses
Thanks for your comments.
W1: The key distinction lies in the research objective, optimization target, and evolutionary mechanism, rather than simply integrating existing agent components. Agent-based AHD methods, such as RefineEvo and PathWise, primarily aim to improve heuristic design through planning, feedback, and experience. In contrast, APS aims to autonomously solve optimization problems by discovering and optimizing complete problem-solving processes, rather than treating heuristic generation as the final objective.
Compared with existing self-evolving agents, EvoAge introduces a coupled two-level evolutionary mechanism specifically for combinatorial optimization: (1) Plan–Trajectory Evolution, where LLM-driven agents analyze execution trajectories and autonomously guide crossover, mutation, and refinement of executable solving workflows; and (2) Skill Evolution, where successful cross-instance experience is distilled into reusable conditional Skills, whose updates are selected through paired, outcome-based validation. The methodological contribution is this explicit evolutionary optimization of both problem-solving processes and persistent solving capabilities, connecting instance-level strategy discovery with cross-instance knowledge accumulation. We will clarify these distinctions in Related Work and Methodology.
W2: On 12 common TSP instances with Qwen3.6-27B (four each at 100, 500, and 1,000 cities), removing Plan evolution and Skill learning increases mean tour length by 3.20% and 2.80% relative to Full. No-Plan-Evolution still constructs a Plan but removes parent selection, crossover, and mutation; Skill learning remains enabled in that settings.
Separately, in Qwen3.8-27B controlled public-benchmark tests, the full learned library improves TSPLIB feasibility from 60/77 to 77/77 and paired mean gap from 5.77% to 4.27%; CVRP decreases from 5.53% to 5.20%. In a separate CVRP evaluation, No Skill Validation yields 5.38% versus 5.20% for Full. These experiments use different backbones and are not pooled. We use the same tool access and test solver cap in each within-framework comparison and report offline LLM calls and evaluations separately.
Response to Questions for Authors (Part 1/2): Q1–Q3
Thanks for your questions.
Q1: EvoAge differs in (i) its optimization object—an executable multi-operator solving workflow rather than a single heuristic program; (ii) its evolutionary search—structural variation plus agent-guided revisions based on executed Plan records; and (iii) its persistent knowledge update—conditional Skills accepted through matched, outcome-based library validation. This makes the evolutionary selection of solving strategies and reusable Skills explicit for combinatorial optimization, rather than relying solely on LLM reflection or memory editing. The trajectory is execution evidence, not a third evolved object.
Q2: The Qwen3.6-27B TSP ablations show that removing Plan evolution and Skill learning increases mean tour length by 3.20% and 2.80%, respectively, relative to Full. Complementary Qwen3.8-27B tests on CVRPLIB report 5.20% mean gap for Full, 5.53% without the learned library, and 5.38% without Skill Validation. These quantify component effects under the same registered toolbox and test-time execution cap; detailed LLM-call counts, Plan evaluations, and exact ablation definitions accompany the revised appendix. Results from distinct experiments are reported separately rather than pooled. There is no separate “Trajectory Evolution” settings; trajectory is the evidence used by Plan evolution.
TSP Ablation Results
| TSP setting | Δ tour length vs EvoAge |
|---|---|
| EvoAge | — |
| without Plan Evolution | +3.20% |
| without Skill Learning | +2.80% |
CVRP Ablation Results
| CVRP setting | Mean gap |
|---|---|
| EvoAge | 5.20% |
| without learned library | 5.53% |
| without Skill Validation | 5.38% |
Q3: The 60-second Table 1 limit applies to deployment-time solver execution and excludes offline evolution and online LLM orchestration, which we measure separately. For a representative single Qwen3.8-27B run, EvoAge uses 500 LLM calls / 2.30M tokens on TSP and 515 / 2.96M on CVRP, versus 501–1,579 and 510–1,593 calls across five AHD baselines, respectively. We followed RefineEvo/PathWise-style iteration and training-time limits and will report actual Plan/heuristic evaluations, Skill-validation runs, tokens, wall-clock time, and solver-only/end-to-end latency by method in the revised appendix. Independent repeat seeds are accounted for separately from one training run.
| Setting | TSP calls | TSP tokens | CVRP calls | CVRP tokens |
|---|---|---|---|---|
| EvoAge Qwen3.8-27B | 500 | 2.30M | 515 | 2.96M |
| Five AHD baselines (range) | 501–1,579 | 0.85–7.51M | 510–1,593 | 0.84–11.10M |
Response to Paper Summary and Critical Strengths
Thank you for recognizing workflow-level APS and interpretable Skills. We clarify below the algorithmic differences between EvoAge and agent-based AHD and self-evolving agents. We have justified the effects of Plan and Skill evolution through additional ablation studies, with execution trajectories as the evidence used by Plan evolution. The solver-only versus offline cost accounting has also reported in appendix. The new controlled comparisons in the ablation study directly test the value of learned Skills under unchanged tool access.
Thank you for recognizing workflow-level optimization and the interpretable decision rules encoded in the learned Skills.