- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper shows that the candidate-selection policy affects verifier evaluation results. The experiments are careful and the results are reproducible. However, the formatting does not comply with the template, the writing is hard to follow, the experiments are confined to small models and multiple-choice questions, and the contribution is thin. I am inclined to reject.
Critical strengths
I think the question is relatively clear and the main result replicates on 2250 new questions. Besides, authors report honestly the unfavorable results.
Critical weaknesses
The weakness is very obvious. I think this paper is not professional seriously. The formatting and writing don't comply with the iclr requirements. Let alone the thin contribution. Its motivation is not real and the experimental scope is narrow.
Questions for authors
Please revise carefully your paper presentation. At lease you need to use the right template, right?
Discussion Period - Awaiting Author Response
Dear Authors,
We have not yet received a response to the reviews. Unfortunately one of the reviewers has experienced a health crisis and could not complete their review, but if you respond to the two authors who did submit their reviews on time, we will only ask you to address their concerns,
Please let us know if you intend to continue with the discussion process or would prefer to withdraw the paper from consideration.
Best Regards,
AC