- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes DIVE, a framework for improving frozen language models by evolving persistent natural-language skills from verifier-labeled task experience, without parameter updates or a stronger teacher model. DIVE initializes multiple independently bootstrapped skill populations and evolves them using heterogeneous operators (reflective repair, exploratory revision, compression, and recombination). It allocates evolution steps across operators with UCB and can generate additional operators from the evolution history. After evolution, it greedily selects a complementary set of skills based on the performance of the full candidate-aggregation pipeline. Experiments on six mathematical and logical reasoning benchmarks and several model families show improvements over prompting, memory-based methods, and GEPA, including strong results with multiple inference candidates and cross-model skill transfer.
Critical strengths
1. Strong and reasonably broad empirical results. DIVE demonstrates consistent improvements across six mathematical and logical reasoning benchmarks and multiple model families. In the 10-candidate setting, Multi-DIVE improves average accuracy over Multi-GEPA from 75.9% to 81.4% on GPT-5-nano, from 92.1% to 96.4% on DeepSeek-v4-flash, and from 81.0% to 86.0% on Qwen3.5-27B (Table 2). The paper also reports promising cross-model skill transfer. These results make the proposed framework practically interesting even if some individual mechanisms are incremental.
2. A useful, systematic approach to skill evolution. Separating different skill-transformation operators and adaptively allocating the evolution budget using UCB is a reasonable and potentially robust improvement over relying on a single reflection/update strategy. The independent populations provide a straightforward way to explore different evolution trajectories. The resulting framework is modular and applicable to frozen models, and the operator-allocation comparisons in Figure 4 provide some empirical support for this design.
Critical weaknesses
1. The improvement over GEPA is not sufficiently disentangled from the final skill-set selection procedure. GEPA already exploits diversity through Pareto-based candidate selection and can merge complementary prompt improvements. DIVE's use of diversity at inference is different, but conceptually modest: the selected skills independently generate answers, which are then aggregated, rather than being routed based on the input or task context. More importantly, the Multi-GEPA baseline retains the best prompt from each of ten independent GEPA runs, whereas Multi-DIVE selects its final set jointly for complementary performance. Thus, the reported comparison changes both the evolution procedure and the final selection procedure. A critical missing baseline is GEPA + the same joint skill/prompt-set selection, using a comparably sized candidate pool, the same aggregation procedure, and a matched optimization budget. Without this control, it is difficult to determine how much of DIVE's advantage comes from its new evolution strategy rather than from the final set-selection mechanism. This matters directly to the paper's claimed methodological contribution beyond GEPA.
2. Figure 4 does not sufficiently isolate or explain the contribution of adaptive operator generation. The caption suggests that the difference between M-UCB and Full is operator generation, but the exact configurations and controlled differences between these variants are not fully specified. Moreover, the default setting introduces only one new operator per population at evolution step 8 out of 10, leaving very limited opportunity to evaluate and exploit it. The paper does not clearly report how often the generated operators are subsequently selected, which transformations they perform, or how parent selection is handled for these newly generated operators. Consequently, the observed Full–M-UCB gap is hard to attribute specifically to history-conditioned operator generation, rather than to simply introducing an additional operator or additional exploration. A control that adds a fixed or randomly generated operator at the same step, along with operator-use statistics and an explicit mapping from evolution steps to the rollout curves, would substantially strengthen this claim.
Questions for authors
Q1. Could the authors evaluate Multi-GEPA + Joint Set Selection, applying the same greedy complementarity-aware selection and inference-time aggregation used by DIVE to a comparable pool of GEPA candidates? In particular, could the candidate-pool sizes, validation protocol, and optimization rollout budgets be matched? This would help separate the contributions of the evolution algorithm from those of final ensemble construction.
Q2. In Figure 4, is Full strictly identical to M-UCB except for adaptive operator generation? Please specify the precise configuration of each variant, indicate when generated operators become available and are actually selected on the rollout curves, and clarify their parent-selection rules. Could the authors also report examples and usage frequencies of generated operators and compare against adding a fixed or random extra operator at the same step? These details would clarify whether the reported gain is attributable to adaptive generation itself.
Q3 (minor clarification). GPT-5-nano Multi-DIVE is reported as 81.4% in Table 2 and 81.5% in Table 3, with a small difference in the corresponding HMMT results (82.7% in Table 6 vs. 82.9% in Table 7). Are these from separate evaluation runs, and if so, why were separate runs needed? Also, Table 2 describes frozen-model ranking, whereas Appendix A.6 specifies majority voting for HMMT. Could the authors clarify which aggregation procedure was used for HMMT in these results, and whether there is a reason for any difference?
4 comments
Response to Reviewer W4vU (Part 2)
HMMT population 1:
---
name: Phase-Coherent_Reorganization
parent_arity: 1
parent_selection: score_proportional
---
Analyze the parent skill’s section structure and trajectory feedback to identify disjointed or redundant reasoning phases. Reorder and regroup existing content into a sequence aligned with problem-solving stages (e.g., problem characterization, hypothesis generation, validation), preserving all original guidance while improving logical progression.
Sudoku population 3:
---
name: Conflict_Resolution_Restructuring
parent_arity: 2
parent_selection: strong_then_complementary
---
Analyze contradictions between the two parents' reasoning approaches using their success/failure summaries. Identify conflicting assumptions, verification methods, or decomposition strategies. Restructure the skill to create a coherent framework that resolves these conflicts through principled prioritization or integration of competing approaches, preserving essential knowledge from both parents while eliminating contradictory guidance.
We conducted the requested controlled comparison:
- M-UCB + Fixed replaces the adaptively generated operator with the same fixed operator (shown below) in every population. It is made available at exactly the same local evolution step (), with all other settings held constant.
The fixed operator:
---
name: Dynamic_Strategy_Adjustment
parent_arity: 1
parent_selection: score_proportional
---
Analyze the parent skill and its failed trajectory summaries to identify recurring contexts where persistent strategies led to failure. Revise the skill to include generalizable cues for recognizing such contexts and guidance to prompt the solver to reassess assumptions, pivot reasoning approaches, or explore alternative decompositions at those points. Avoid specifying fixed alternatives; instead, emphasize principles for evaluating strategy effectiveness and triggering adaptive responses.
The results are avalable at: https://anonymous.4open.science/r/DIVE_experiments-8BC4/qwen_3_8b_ablation/fixed_operator_experiments.
Adaptive operators outperform the fixed operator because they are generated in response to the evolution history produced by the initial operators, allowing them to target the observed limitations and failure patterns.
Rollout-local evolution steps mapping. Each population tracks its task-solving rollouts and records the count at the end of every evolution step. A monitor sums these counts across populations. When the total first reaches a multiple of the checkpoint interval (500 in Figure 4), the monitor records a global checkpoint. At each checkpoint, we collect all skills whose evaluation has completed, retain the top (L=3) candidates from each population, jointly select up to (M=10) skills on the validation set, and evaluate the resulting set. Because populations evolve asynchronously, local evolution steps do not correspond one-to-one with global rollout checkpoints.
We will add the implementation details and results to the paper.
Response to Q1
See Response to W1.
Response to Q2
See Response to W2.
Response to Q3
Tables 2/6 and Tables 3/7 were produced by separate evaluation jobs with the same skills, model, and protocol; the latter additionally collected token and cost statistics. Stochastic decoding resulted in minor differences. We will use the canonical accuracy results from Tables 2/6 consistently in the revision.
Appendix A.6 inadvertently retained the aggregation rule used in an earlier implementation. All reported multi-candidate results, including the HMMT results in Tables 2 and 6, use the same ranker. We will correct the description in Appendix A.6 accordingly.
Follow-up on Author Response
Dear Reviewer,
Thank you again for your constructive feedback. We have posted our responses to your comments and would greatly appreciate any further thoughts you may have before the discussion period ends.
We would be happy to clarify any remaining concerns.
Best regards,
Authors
Thank you to the authors for the detailed responses and additional experiments.
The new GEPA + Joint Selection baseline and the clarification of the Figure 4 configurations, together with the additional operator ablation, have adequately addressed my main concerns. The minor reporting inconsistencies have also been clarified.
Overall, I am satisfied with the rebuttal and will maintain my rating.
Response to Reviewer W4vU (Part 1)
We sincerely thank the reviewer for their careful review and valuable feedback.
Response to W1
We conducted the requested controlled comparison: applying the same joint selector to GEPA. We applied DIVE’s selector to the original Multi-GEPA candidate pools across five runs.
We can see that the final selector contributes to performance but does not account for most of DIVE’s advantage. Qualitative inspection also shows that prompts from independent GEPA runs are often highly similar, providing relatively limited complementary coverage for the joint selector to exploit.
The complete task-level results are:
Response to W2
Figure 4 configurations. All variants use K=10 independently populations, B=10 local evolution steps per population, ∣Devo(k)∣=50, ∣Dref(k)∣=50, and ∣Dval(k)∣=50.
Reflective Repairthroughout evolution.Reflective Repair,Exploratory Revision,Compression, andRecombination, with uniform allocation (uniform random selection from the set of eligible operators) and no operator generation.Observations. Because UCB rewards the novelty of the adaptive operators, every population selects them at both remaining local steps: 10/10 selections at step 9 and 10/10 at step 10. Thus, 20% of the evolution budget is allocated to the newly generated operators, which we find sufficient to produce a measurable effect.
The 20 generated operators, 10 for each dataset, primarily perform five types of transformations:
Seven of the operators use two parents. Their transformations vary: some retain the structure of one parent, some organize the two parents as parallel modules, some reconcile conflicting strategies, some assign different parents to different problem types, and others synthesize the failure patterns of both parents.
Parent selection depends only on the number of parents declared by the operator:
We present two examples below. All generated operators are available at: https://anonymous.4open.science/r/DIVE_experiments-8BC4/qwen_3_8b_ablation/new_operators.