- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper explores whether third party model evaluations are actually acted on or lead to changes by model deployers. They find that the majority of findings are not acted upon (80%).
Critical strengths
This is a really well-written and insightful paper. The layout and flow of the narrative has clearly had a lot of time devoted to it and is a very pleasant read.
With the common push that we need more independent third party evaluations, It's often not questioned how effective they are -- and the this paper tackles that head on, which is a novel area of investigation.
The methods are well-documented, honest, and robust. The sample of organisations and evaluations considered is broad, categorisation of responses to model findings is clear. The analyis here is simple, but performed to a high standard.
The findings themselves are important, and potentially quite impactful. I think the unfortunate starkness of the results is something that needs to be raised to the AI community and have a light shined on it. Resolving this lack of action is important for AI to be ensured safe.
Critical weaknesses
I think ultimately the only reason that I would recommend against acceptance is that this is not necessarily in scope for a main track ICLR submission. I do believe it is of interest to many members of the ICLR community, but this paper is more of a commentary / position about the current state of affairs in AI rather than itself advancing AI as a scientific discipline.
Questions for authors
How should the AI community go about addressing the issues that you highlight in your paper? This is briefly touched upon in section 5, but more concrete or opinionated suggestions would be helpful.
Thank you for taking the time to review our paper and share your feedback. We address your comments and questions below.
Question1: Recommendations for the AI community
We are not offering a formal position or making recommendations in this paper. However, if actors working on AI governance wanted to increase the likelihood of proportionate responses to discovered harms, our results might support an independent body to track significant-risk findings, set deadlines for written responses from the responsible developers, and record whether reported fixes have been independently verified. Such a body could report cases to a government authority when a developer crosses the set response deadline or a significant risk remains even after follow-up. If a law were to establish this process, it should specify which developers owe a duty to respond, which regulator can enforce that duty, and what penalties apply if there is noncompliance by the developer.
Three existing laws provide precedents for different parts of this mechanism:
An independent body or an established, enforced process involving these suggestions could be used for addressing the issues associated with significant risks and could make follow-up more consistent.
Action 1.1: We have added these suggestions in Appendix H.
Weakness 1: Eligibility of paper for ICLR
We believe it reasonably fits with ICLR. The ICLR 2027 Call for Papers lists “societal considerations including fairness, safety, privacy” and “datasets and benchmarks” among its subject areas. The Reviewer Guide mentions whether a paper contributes “new knowledge and sufficient value to the community” and explicitly recognizes empirical results as a basis for that contribution.
Our main contribution is an empirical study of what happens after third-party evaluations have identified risks in frontier AI systems. In our study, we found concrete evidence of no public response to any of the significant-risk findings by most frontier developers, concerning their models. Our study also provides a baseline for assessing whether future evaluation practices lead to more consistent public follow-up.
Question 2.1: If you remain concerned that this paper is marginal for ICLR's focus, could we propose (1) revision of score as if you had no concern, and (2) separately you can comment your concern in a comment to the AC whose formal responsibility it is to assess fit?