- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The problem itself—evaluating agents in competitive settings, and in particular in choice-based settings—is an important one. However, I struggle to identify any meaningful contribution in the submitted paper, certainly not one that would justify publication at ICLR.
The experimental setup is weak, the intellectual depth of the paper is low, the writing appears to have been produced by AI, and it is evident that little serious human thought was invested in the work.
I opened the paper’s code, which, like a large fraction of academic code written in 2026, appears to have been generated to a substantial extent using generative AI. That, in itself, is perfectly acceptable. However, the authors explicitly state that “we have no using generative AI tools... for develope evaluation.” This is not a minor mistake or an imprecise statement—it is a blatant falsehood. There is no place for such misrepresentation in academic work.
For this reason, I recommend rejecting the paper outright.
Critical strengths
None.
Critical weaknesses
See Summary.
Questions for authors
None.
We believe the basis of rejection should contain weaknesses and lapses in the method or novelty of the paper, not assumptions that the authors didn't put work into writing and designing the benchmark. This is the standard reviewer procedure in ICLR.
As for AI policy, it is an industry and academia norm since 2025 to use coding agents for implementation. Our statement "We have not used generative AI tools to ... develop evaluation code..." is for analyzing the results (both scripts for ranking and manually going through chat logs to observe behaviors), NOT for implementation.
As for the contribution of our work, we cite several papers that evaluate models under competitive setting and clearly highlight how our benchmark is different from existing works (Table 1).
We leave the decision to the Area Chair to judge whether the paper writing, results, and the review are up to ICLR standards or not.