- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper raises the following research question: Attention Sinks attract a high degree of attention, do they actually have a significant impact on the model’s output? The paper outlines a rigorous experimental design. The paper did not reach any novel conclusions; it merely arrived at some conclusions that were to be expected.
Critical strengths
None.
Critical weaknesses
(1) The paper lacks novelty and significance.
(2) The paper fails to address the question posed at the beginning of the article.
(3) The discussion in the latter half of the paper strays from the main topic.
(4) The title and abstract of the paper in the PDF do not match those on OpenReview.
(5) The paper is very difficult for human to read.
Questions for authors
Could you read through your own paper before submitting it?