- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Gödel Ecology (GE), a framework that jointly evolves agents and evaluators for recursive self-improvement. Its main idea is to score evaluators not only by how well they match external judgments, but also by whether the agent lineages they influence become more productive, while continuously updating a mixture of evaluators.
Critical strengths
The paper identifies an important problem in self-improving agents, and the empirical evaluation is reasonably broad. The paper tests GE in closed-loop coding-agent evolution, offline evaluator comparisons, non-code revision tasks, and cross-model transfer.
Critical weaknesses
-
About reproducibility of closed-loop results. The end-to-end coding co-evolution experiment includes only three search runs. This provides limited evidence that the observed gains are robust across search trajectories.
-
About stress testing against evaluator exploitation. Although the paper introduces several safeguards against evaluator drift, it does not clearly report systematic adversarial tests in which agents deliberately exploit evaluator weaknesses. Their effectiveness against active reward hacking therefore remains uncertain. This is my biggest concern.
-
About human auditing of evaluator evolution. The paper does not clearly describe systematic human inspection of intermediate evaluator judgments. Aggregate metrics may miss systematic misjudgments, evolving biases, or cases where agents exploit weaknesses in evaluation criteria.
Questions for authors
-
The end-to-end coding co-evolution experiment uses only three search runs and evaluates the final improvement on 17 tasks. How sensitive are the reported gains to random seeds, search trajectories, and task selection? Can the authors provide results across more independent runs and a larger evaluation set?
-
evaluation hacking: How do the authors verify that agents improve genuine task-solving capabilities rather than exploiting weaknesses in the evolving evaluators? Have systematic adversarial tests been conducted in which agents deliberately optimize for evaluator weaknesses, and how effective are the proposed safeguards under such conditions?
-
Do human experts inspect intermediate evaluator judgments or changes in evaluation criteria during co-evolution? If not, how do the authors detect systematic misjudgments, evolving biases, or exploitable evaluation criteria that may not be reflected in aggregate metrics?