- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper examines absorption which is a failure mode in which an LLM incorporates a user's comment into text that the user intended only to edit. In this context, the authors introduced SEAM which is a benchmark of 300 editing examples tested under six matched conditions. They then evaluate a set of language models on this dataset and find that absorption occurs across all tested models.
Critical strengths
- The paper is easy to follow and it identifies an interesting and underexplored failure mode with practical implications for everyday LLM use.
Critical weaknesses
-
Perhaps my main concern with the paper is that it falls short of what it can bring. Particularly, the paper identifies and measures the problem but stops short of developing a method to prevent it (beyond explicit boundary markets). The contribution will be much more meaningful if beyond identifying the problem, the authors also propose a method or ways to circumvent this by the model through specific training or training data to be included.
-
Secondly, the relationship between the semantic content of the artifact and the trailing user comment needs further investigation. How much does semantic similarity, or the degree to which the comment naturally fits the artifact, explain absorption? This is important for understanding when the failure is most likely to occur. From my personal interaction with LLMs, I have never observed absorption and for that reason I worry about in what type of cases does this comes up.
Questions for authors
-
How does the semantic similarity between the pasted artifact and the trailing comment affect absorption? Can you isolate this factor from whether the comment fits the artifact's genre?
-
Beyond adding explicit boundary markers, have you explored methods that could help models reliably distinguish the artifact from the user's instructions or comments?