- Rating
- 1
- Confidence
- 1
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
I have to admit that the contributions of this paper are completely obscure to me. The authors wrote a highly mathematical paper (using AI) without properly motivating the reasons why such findings are important. The text is incredibly hard to read. I cannot understand why this paper has been written at all. Therefore, I believe the paper should undergo a more careful proofreading.
Critical strengths
I could not find critical strengths because I could not understand the paper. This is the first time this happens in my experience.
Critical weaknesses
My main concern is with the presentation and overall clarity of the manuscript. While the paper follows several formal conventions of theoretical research, I believe its exposition falls short of the standards expected at a machine learning conference. In particular:
-
Abstract: The abstract is extremely dense and difficult to parse, even for a technically oriented audience. Rather than providing an accessible overview of the problem, its relevance, and the main contributions, it immediately introduces specialized concepts and technical results with little context. An abstract should help readers understand the significance of the work and encourage them to read further. In its current form, it instead constitutes an initial barrier to understanding the paper.
-
Motivation and problem formulation: The introduction does not adequately motivate the research question. It opens with a technical claim involving the Rado graph and finite-dimensional attention, without first establishing why this particular problem is relevant or worth investigating. Although such a presentation might be more common in certain areas of pure mathematics, I would expect a paper submitted to a machine learning conference to provide a clear motivation, an explicit problem formulation, and a discussion of the implications for the field. The absence of this framing makes it difficult to appreciate the significance of the contributions, independently of their mathematical validity.
-
Terminology and accessibility: The manuscript makes extensive use of specialized terminology before providing sufficient definitions or intuition. While technical language is unavoidable in a theoretical paper, readers should be guided through the concepts needed to understand the main arguments. Here, the exposition frequently assumes familiarity with mathematical objects and techniques that have not yet been introduced. This substantially limits the paper's accessibility. In my view, effective communication is an essential component of scientific research, and mathematical rigor should not come at the expense of clarity.
-
Organization and preliminaries: The organization further exacerbates these issues. The preliminaries appear only in Section 2, after several pages devoted to results, techniques, related work, discussion, and open problems. Consequently, the paper presents numerous formal theorem statements before introducing the definitions necessary to understand them. While it is entirely reasonable to summarize the main theoretical contributions in the introduction, I find the decision to present so many detailed theorem statements before establishing the relevant mathematical framework counterproductive. A clearer separation between an intuitive overview of the contributions and their formal development would substantially improve the readability and logical progression of the manuscript.
--
Overall, I believe the manuscript would benefit from a substantial revision of its exposition. My concern is not with the use of advanced mathematics or the technical nature of the results, but with the limited effort devoted to making the problem, its motivation, and its contributions understandable to the intended audience. As currently written, the paper places an unnecessarily high burden on the reader, making it difficult to assess the significance of the work.
Questions for authors
I have no questions for the authors, as I could not understand the motivation or contributions of the paper.