- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies the relationship between AI-like review text, review scores, and subsequent discussion using 150,635 ICLR reviews from 2024–2026. Using two AI-text detectors, the authors find that reviews with higher AI-likeness scores tend to give higher ratings but are less likely to be followed by a rating increase. They also examine whether authors respond and how many tables their responses contain, with results varying across detectors.
Critical strengths
- The paper includes extensive sensitivity analyses, examining how the findings change with detector choice, score transformations, and sample restrictions. These checks help clarify which results are robust and which depend on the analysis setup.
Critical weaknesses
- Prior work such as the ai lottery has already examined the association between AI-like reviews and higher ratings. While this paper extends the analysis to author responses and reviewer updating, these additional analyses provide relatively little new insight. Participation results are inconsistent across detectors, and the relevance of response table counts to meaningful peer-review interaction is unclear. The association with less positive updating is potentially interesting, but the analysis offers limited insight into what distinguishes these exchanges or why reviewers retain their scores.
Questions for authors
n/a