- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
Proposes a new benchmark of 10 AI tasks (including start code and models) that AI models are tasked with improving, to test the ability of models to improve the solution.
Critical strengths
I like the overall idea of creating benchmarks to test AI's ability to improve AI codebases and models. I also like the decision to retest the final code.
Critical weaknesses
The biggest weakness is the writing. It reads like it was almost entirely AI-generated. Even if it was not, it is incomprehensible in many places. Many sentences come out of left field and are confusing because they seem to refer to things the reader has not been told about (likely due to AI referring to past parts of the chat if AI generated). The abstract is a good example, but there are so many throughout the paper (lines 44-45, 96-98, 115-117,211,196, 233, 264 and on and on. Also, many key things are never explained.
Another huge issue is a lack of statistics. We don't know if anything is noise vs. signal, and that's especially true with the large number of experiments/comparisons.
The literature review is weak, overly dense, and doesn't even answer the most basic questions: is this new? what is similar to it?
Key methods are missing, like the prompts to the models.
The paper is also extremely repetitive.
Overall I don't learn much. Are these tasks good? Why these vs. others? Why not evaluate sustained progress vs. one-off deltas? Is the point to eval models out of the box for their ability to improve AI, or to test their ability to improve over time (seems more important), or to evaluate self-improvement algos? Do the results tell us about the benchmark vs prior benchmarks (no), so what do they tell us? About the models? If so, is the paper about testing the models or creating a benchmark?
More minor things:
- I think you should reference the literature more, including open-ended and AI-generating algorithms including things like the Darwin Godel Machine, HyperAgents, the Automated Design of Agentic Systems, etc.
- font is way too small in Fig 1
Questions for authors
- did you look for reward hacks?
- is this entirely new? what are other similar attempts?
- is it fair to average over all these different effort levels for different models?
- what does it mean that the agent can change the objective?
- how do you know the results are signal and not noise? What would be the proper stats to do to show that, especially given the multiple comparisons
- what's the real point here? to eval models out of the box for their ability to do one delta? what about sustained improvement over time by building on their discoveries? What about open-ended improvement algos like DGM/hyperagents? should they be tested included?