- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper examines how to attribute apparent recursive self-improvement in agents that repair executable world models. It introduces a checkpoint formalism and an evidence ladder comprising model/procedure crossings, owned versus replayed evidence, code/history crossings, generator locks, and non-recursive baselines. Experiments in an inspectable synthetic system, including fresh replications with 252 world families, show that descendant gains combine inherited model structure and procedure changes. Continued editing is practically equivalent to an evidence-matched non-recursive baseline, and its advantage over freezing depends strongly on the source-history contract.
Critical strengths
- The paper clearly distinguishes descendant quality from improver quality. The checkpoint-based interventions make this distinction concrete, while the history-contract experiment shows how frozen-versus-continued comparisons can be misleading.
- The experiments are transparent and carefully controlled. Replications, paired uncertainty estimates, equivalence tests, influence analyses, and an evidence-matched non-recursive baseline strengthen the findings.
Critical weaknesses
- The attribution framework is evaluated only in the authors’ own testbed. The paper does not apply its attribution measures to established settings such as STOP or DGM. Evaluating those settings with the proposed framework would show whether it can reveal attribution patterns beyond the task and environment designed by the authors [1, 2].
- The conclusion about generator editing is not fully supported by the main evaluation. In the main test, the generator is not executed during final evaluation, so the experiment cannot directly show whether editing it improves later descendants. The authors should evaluate generated descendants directly before concluding that generator editing has little value .
- The benefit of continued editing depends on how history is shared. The benefit appears with shared histories but disappears with separate histories, because history length changes which edits are proposed. The authors should test additional history settings and clarify which one best represents the intended system before generalizing this result .
[1] Zelikman, E., Lorch, E., Mackey, L., and Kalai, A. T. "Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation." Conference on Language Modeling, 2024.
[2] Zhang, J., Hu, S., Lu, C., Lange, R., and Clune, J. "Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents." International Conference on Learning Representations, 2026.
Questions for authors
How does the proposed evidence ladder provide additional insight beyond existing self-improvement evaluations such as STOP and DGM? In particular, which conclusion in this paper could not be obtained from descendant-performance comparisons or frozen-improver controls alone?
Separating code and history effects and testing the generator on descendants
Thank you for pressing us to say what a reader can learn beyond the controls in STOP and DGM. Your observation that the generator does not run during frozen transfer also helped us clarify why the two generator evaluations support different conclusions.
Figure 3 (p. 7) gives a concrete answer to your first question. Continued editing beat freezing by 0.01010 mean loss on shared source histories. Either the resulting code or the records carried to transfer could explain that difference. Running each final program with each final history gave a code contrast of −0.01029 and a history contrast of +0.00019, with exact history ties in 247/252 families. A comparison of the two unmodified endpoints cannot recover those contrasts. STOP already compares seed and evolved improvers from the same starting solution on a downstream task, and tests transfer to held-out tasks. DGM includes a fixed-modifier ablation. Section 2 credits those controls. A code-by-history crossing on either platform would be a new external experiment.
Section 5.3 of the original submission included a direct test of descendants. Each final program performs two editing rounds using the transfer task’s train/validation split before protected scoring. The natural continued-minus-generator-locked effect was −0.00260 (95% interval [−0.00622, +0.00044]). Its 90% interval crosses the −0.005 equivalence boundary. The revised abstract and Table 4 (p. 8) therefore describe natural generator benefit under live editing as inconclusive. The frozen-transfer equivalence result concerns what earlier edits leave in the final repairer and history.
Separate writable histories represent autonomous learners. A shared history represents a team permitted to read one another’s trials (§6, p. 9). We added an exploratory scheduling intervention on the same 126 families. When the base proposer advanced by stage, the interaction between the two history contracts fell from +0.00782 to +0.00092 (§5.4 and Appendix E.7). This tests the proposal rule under both ownership contracts. Validation on STOP, DGM or another external system remains open.