- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This position paper claims that ‘alignment’, the strategy to align AI output with human values for safety, is insufficient and unsolvable. Thus, the paper wants to warn against treating “alignment” as a technical solution to AI risk in society. This position is supported with three claims. Claim 1 argues that alignment is not well defined. For instance, if a misalignment has been observed through an event, it is hard to attribute that event back to the model’s alignment behavior. Moreover, it says that human intentions are subjective and change over time. Claim 2 argues that even if alignment was well defined (to supplement claim 1), it is hard to completely solve the problem in practice. For instance, values that are useful might also be used for harmful capabilities. There is also the likelihood that events placed at the tail of the probability distribution might be the most harmful (it seems to be connected with normal accident theory). Claim 3 says that alignment is not sufficient in reality, as the use of AI can shift human values through time, and such gradual change can accumulate into large change over time.
Critical strengths
-
It addresses an important problem that the AI community should think about. One of the recent related works (although not covered by the paper) has won the Outstanding Paper award at ICML 26.
-
The paper provides relatively strong empirical evidence for each of the claims. The reviewer agrees with the claims. The examples provided for each claim are reasonable.
-
This position paper might be useful for papers arguing the need for a better strategy other than alignment.
Critical weaknesses
- The paper reads very hard, with weak connections between paragraphs. For instance, the connections between paragraphs in Sec. Background reads disjoint. It is simply an aggregation of related works that are described without connection to one another. While it does provide a background, I strongly suggest that the authors rewrite the whole Background to make it more coherent and concise. For instance, where is this position paper positioned? How does it relate to previous arguments related to alignment? What stands out from previous works? Also, the paper should address the below work which received the Outstanding Paper award at ICML 26.
[1] The alignment community is unintentionally building a censor's toolkit
-
The paper also introduces terminology that reads as if it wants to impress the readers. For instance, what is “ex ante”? These terms are not suitable for a position paper that needs to be read by the general public or the ML community.
-
As a reader, the argument that “alignment” is not sufficient is not entirely new and have been reported in several works [1,2,3]. As such, it is not clear to the reviewer what additional value this paper is adding to the research community.
-
To provide additional value, this position paper should at least provide the direction which the community should head towards to. Currently, the paper simply reads and concludes as “There are problems with the current “alignment” strategy.” What should we do more? Where should the safety team spend more of their time? These are not discussed, which I think is a critical flaw for a position paper.
[2] Position: `AI Alignment' Encompasses Competing Technical Priorities
[3] Position: We Need Practical AI Alignment Methods that Mirror Human Reasoning
- Also, many of the recent related discussions of alignment were not discussed. I would recommend that the author go through the literature in the ICML 2026 position track for a more thorough discussion.
Questions for authors
-
Why did the authors put the bracket “[]” in quotations? Does it mean something?
-
Regarding C3c, how do we know that the individual agents were aligned in the first place? And what were they aligned to? The explanation in the paragraph skips much of the detail.