- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper asserts that existing learned judges suffer from a lack of clean labels and issues with graders. To solve this issue, the authors propose corrupting "correct" samples into "guaranteed-incorrect" ones by programmatically mutating them using a set of predetermined operands, thus essentially creating new labels.
Critical strengths
The paper correctly identifies that judges are often trained on limited/poor data and that grading steps often have flaws which ought to be removed.
Critical weaknesses
The paper does not support several of its key claims, for example:
- "We propose a way to build verified evaluation environments for LLM judges automatically from the executable structure of existing benchmarks" -> The paper proposes corrupting assumed-correct ground truth human labels to augment existing data with synthetic negatives. This is a well-known technique applied to a small subdomain.
- The introduction claims that the authors run pre-registered experiments but does not actually report running any.
- The proof of the "learning cap" is trivial and not helpful in practice.
The paper does not cite the long history of error-injection/perturbation for training robust judges and other models e.g., [1,2,3].
Lastly, the paper is very wordy and hard to follow, containing many AI-isms that obscure the underlying meaning.
[1] Kryściński, W., McCann, B., Xiong, C., & Socher, R. (2020). Evaluating the factual consistency of abstractive text summarization. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 9332–9346. doi:10.18653/v1/2020.emnlp-main.750 [2] Sellam, T., Das, D., & Parikh, A. P. (2020). BLEURT: Learning robust metrics for text generation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL), pp. 7881–7892. doi:10.18653/v1/2020.acl-main.704 [3] McAleese, N., Pokorny, R. M., Cerón Uribe, J. F., Nitishinskaya, E., Trębacz, M., & Leike, J. (2024). LLM critics help catch LLM bugs. arXiv preprint arXiv:2407.00215.
Questions for authors
Only fundamental changes to this paper would affect my assessment. I recommend a significant overhaul and resubmission in the future. My most important suggestions the authors would be to run the proposed experiments to ensure the synthetic labels actually allow for the training of meaningfully better judges, and citing and discussing the relevant literature to more clearly establish the novelty of the proposed approach.