- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper is about detecting reward hacking in self-evolving language models, what the authors propose or solve specifically remains unclear, see Weaknesses blow.
Critical strengths
None
Critical weaknesses
AI-generated paper. The paper is very difficult to follow and clearly AI-generated. The authors claim that AI was only used for language polishing. The authors are not honest about the AI use in their statement, the entire paper is full of Claude-ish words and phrases and does not follow scientific standards, clearly AI was used for more than simple language polishing.
Missing clear problem statement, contributions and take-aways. Due to the heavy use of AI-generated text, it remains entirely unclear what this paper is contributing, proposing or solving exactly. Figure 1 does not help identifying a core contribution or which problem is solved exactly either.
Unclear notation. Most notation is used before it's properly introduced. This is very difficult to follow for the reader, the notation overview in the Appendix is not sufficient to carefully follow the authors' text or arguments.
Missing related work. This paper is missing a proper positioning in the broader literature. The main text is further not self-sufficient, basically all references to related work are missing. This also holds in particular for core concepts used by the authors (to make concrete examples: "Page-Hinkley alarm", "Goodhart gap", "Sidak fusion"). The related work section in the provided Appendix is not enough.
Missing description of the experimental setup. The description of the experimental setup is not sufficient and not justified. Why do the authors select the specific datasets and hyperparameters? Most hyperparameters are not even sufficiently described or motivated (to make examples: what is T, n, S, q, L, , ...?) . It remains unclear why the experiments are sensible for supporting the authors' claims.
Modified conference format. The authors modified the conference style files to remove page numbers and the conference header, the objective of this modification remains unclear.
Overall, the paper's quality is not sufficient for this venue, recommending clear rejection.
Questions for authors
No further questions.