acceptodds
Under review as a conference paper at ICLR 2027

AI-Likeness in the Peer-Review Ecology: Evaluation-Response Asymmetry

Abstract

AI-like language has been linked to favorable peer-review evaluations, but whether that association extends to the author–reviewer exchange remains unclear. We analyze 150,635 ICLR reviews from 2024–2026, linking reviews to author responses and reviewer follow-up. Using EditLens and CoCoDet as complementary continuous proxies, we benchmark their separation of matched human and directly generated reviews and compare downstream associations with earlier ICLR cohorts. Across both measurements, higher review-side AI-likeness is associated with higher ratings but less subsequent positive reviewer updating. In 2025–2026, its relation to author participation depends on the measurement: EditLens is associated with less rebuttal submission, whereas CoCoDet is associated with more. Pooled analyses generally link higher AI-likeness scores to more visible response organization, while within-paper comparisons attenuate or reverse the response-side association, suggesting that part of the pooled pattern reflects differences among papers. We call this pattern evaluation–response asymmetry: favorable evaluation does not extend uniformly to participation, organization, and reconsideration. These findings show that ratings alone do not characterize how AI-like language relates to peer review as an exchange.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.