- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The problem this paper attempts to address is that a static verifier's ability to identify good outcomes acts as a ceiling on a trained policy's ability to achieve them. The proposed method, KDCE, trains verifiers based on outcomes of a curated set of policies, then uses the updated verifier to train a new policy. This achieves very minor improvements on baselines for coding and interactive tasks, though not math.
Critical strengths
None
Critical weaknesses
This paper appears to be almost entirely written by AI. The level of AI detected is not consistent with the AI Use Statement claiming it was only used for edits, and suggests that entire sections were written by AI.
The proposed method lacks novelty, being ony the combination of existing methods. As might be expected, this leads to very minor improvements in the experiments run, which are indistinct from noise, and this is despite using more compute. Major experimental details are not provided. Overall, this gives the flavor of authors who delegated the entire paper creation process to AI.
Questions for authors
None