- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper should be desk-rejected. There are two hallucinated references in this paper.
On page 12, the reference titled “Understanding the performance gap between online and offline alignment algorithms” (Line 645-647) is attributed to ICML 2024. However, its author list—including Mark Rowland, Pierre Harvey Richemond, and Bilal Piot—matches “Generalized Preference Optimization: A Unified Approach to Offline Alignment,” which appears in the official ICML 2024 proceedings. The paper bearing the cited title has a different author list in its original arXiv record, 2405.08448, and I could not locate that title in the ICML 2024 main-conference proceedings. This appears to conflate the title of one paper with the authors and publication venue of another. The mismatch is present in the manuscript itself.
There is also a separate venue error on page 13: “Free Process Rewards without Process Labels” (line 700-701) is listed as an ICLR 2025 paper, whereas its formal publication record is ICML 2025.
Critical strengths
The author honestly discloses the attempts of their failure work in Appendix F WHAT WE TRIED THAT DID NOT WORK.
Critical weaknesses
This paper should be desk-rejected. There are two hallucinated references in this paper.
On page 12, the reference titled “Understanding the performance gap between online and offline alignment algorithms” (Line 645-647) is attributed to ICML 2024. However, its author list—including Mark Rowland, Pierre Harvey Richemond, and Bilal Piot—matches “Generalized Preference Optimization: A Unified Approach to Offline Alignment,” which appears in the official ICML 2024 proceedings. The paper bearing the cited title has a different author list in its original arXiv record, 2405.08448, and I could not locate that title in the ICML 2024 main-conference proceedings. This appears to conflate the title of one paper with the authors and publication venue of another. The mismatch is present in the manuscript itself.
There is also a separate venue error on page 13: “Free Process Rewards without Process Labels” (line 700-701) is listed as an ICLR 2025 paper, whereas its formal publication record is ICML 2025.
Questions for authors
NA