- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper attempts to build a theoretical foundation for multi-agent LLM dialogues to answer when and how such LLM dialogues converge. The authors derive a boundary computable from model weights as a sufficient condition under which LLM dialogues stabilize.
Critical strengths
S1. The research question under exploration is interesting and important.
S2. The authors derive a boundary computable from model weights as a sufficient condition under which LLM dialogues stabilize.
S3. The empirical analysis covers 15 models, which is many.
Critical weaknesses
W1. The theoretical analysis appears sound but unreadable. The authors just put the maths there without clear explanations. Also, the practical significance of the results has not been clearly established.
W2. The paper appears to show strong signs of vibe writing, with numerous corrections to its experimental methodology, empirical results, and theoretical analysis, making it extremely difficult to understand what the paper is actually trying to say.
W3. The computable boundary overstates the local sensitivity by about and thus is overly loose. Only 2 of the 22 checkpoints fit the boundary.
W4. The key assumption that the agents' beliefs are updated via cross-attention lacks justification and evidence.
Questions for authors
Q1. Why does this paper involve a lot of corrections?
Q2. What justifies the assumption that belief updates in multi-agent LLM dialogue can be modeled using cross-attention?
I cannot understand what either the paper or the rebuttal is trying to say. I believe I am talking to an out-of-control AI rather than a responsible human being. I therefore decline to continue this discussion and will maintain my original score.