- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies how agreement emerges in conversations between LLM agents. The authors analyze both model outputs and hidden representations. They show that behavioral agreement can be approximated by a first-order Markov model. They also find a relationship between aggregated internal agreement and behavioral agreement, and report that internal agreement lags behind behavioral changes.
Critical strengths
The paper addresses an interesting question about agreement in multi-agent systems. I particularly like the idea of studying both internal representations and observable behavior.
The experiments cover several models and datasets. The paper is also clearly written, and the results are easy to follow.
Critical weaknesses
Section 4 shows that a first-order Markov model fits the aggregated agreement trajectories reasonably well. However, this does not necessarily mean that the underlying process is Markovian. Earlier conversation history may still influence the next state.
The authors use a linear classifier to find an agreement direction, but I couldn't find how well it actually predicts agreement on the test data. I'm also not sure whether it captures agreement or just the model's chosen answer or persona.
I'm also not fully convinced by the power-law relationship. It uses three parameters and is fitted on very few data points. Some of the results in Table 2 are quite weak. I wonder whether a simpler function, like a linear one, would work just as well.
Questions for authors
Have you checked whether earlier turns also affect agreement, rather than just the previous one? I think this would help support the Markov assumption.
How well does the classifier actually predict agreement on test conversations? Could it be picking up the model's chosen answer or persona instead?
Have you tried fitting simpler functions, like a linear one, instead of the power law? I'm curious whether they would give similar results.
Could the internal lag simply come from the fact that the two groups have different conversation histories, rather than from a real delay in internal agreement?
4 comments
Dear Reviewer bno6,
We hope that our clarifications and additional results address your concerns. Please let us know if there are any additional questions you may have.
Thank you,
Authors
Thank you for providing clarifications, I am raising my score
Thank you. We’re happy we were able to address your questions.
We thank the reviewer for appreciating that our paper studies both internal and behavioral data, the breadth of our experiments, and the clarity of the paper.
Below, we address your main concerns.
Section 4 shows that a first-order Markov model fits the aggregated agreement trajectories reasonably well. However, this does not necessarily mean that the underlying process is Markovian. Earlier conversation history may still influence the next state.
We agree with the reviewer; our paper does not claim that agreement is Markovian but that it can be approximated by a Markov model. To address the concern that earlier conversation history may still influence the next state, we further show in Section 4 that a second-order Markov model has only a small improvement to the approximation, indicating that a first-order Markov model is a good approximation of the behavioral agreement.
The authors use a linear classifier to find an agreement direction, but I couldn't find how well it actually predicts agreement on the test data. I'm also not sure whether it captures agreement or just the model's chosen answer or persona.
Thank you for this comment. We added an analysis of the internal agreement classifier AUROC and a visualization of the separation of agree and disagree labels in Appendix E. We show that the direction separates agreement from disagreement well above chance for all models: the AUROC is 0.74 for Ministral, 0.84 for Qwen, and 0.99 for Gemma. This analysis indicates the usability of our agreement direction. We further show that these AUROC results are consistent even when classifying between examples in which the speaker chose the same answer, holds the same persona, and comes from the same dataset. This indicates that the internal representation captures agreement beyond the model’s persona and chosen answer.
I'm also not fully convinced by the power-law relationship. It uses three parameters and is fitted on very few data points. Some of the results in Table 2 are quite weak. I wonder whether a simpler function, like a linear one, would work just as well.
We thank the reviewer for this comment. The power-law experiment aims not only to detect correlation but also to identify a specific function that captures it. Thus, given that correlation, regardless of form, can already indicate a possible relationship between the Markov and internal agreement, we added the Spearman correlation results at the start of Section 5.1. The results show a high correlation between the internal agreement and the Markov behavioral agreement (mean Spearman correlation across datasets = 0.85/0.95/0.93 for Ministral/Qwen/Gemma; p<0.05 in 14 of 15 model--dataset pairs). We also calculated Pearson correlation, which showed high correlation but lower than Spearman (mean Pearson correlation across datasets = 0.78/0.82/0.91 for Ministral/Qwen/Gemma; p<0.05 in 14 of 15 model--dataset pairs). Because Pearson is lower than Spearman, this suggests some non-linearity in the correlation. Note that in the power-law function, γ=1 is equivalent to a linear function. As seen in Appendix H, the parametric values in the power-law for each model and dataset, showing γ values larger than 1, even though the fitting algorithm minimizes the same error as regression.
In addition, while 9 points for 3-parameter functions is not a lot, it is also not that little, and, as explained in Appendix H, we further ran bootstrap samples of the points to improve the robustness.
Moreover, given your suggestion, we added simpler function analysis in Appendix K. In this section, we compared the power-law function to simpler two-parameter functions: linear, logarithmic, and exponential functions. We show that while the power-law describes the relationship best, the coupling between behavioral and aggregated internal agreement is somewhat detected in other functions as well. This result indicates the robustness of the relationship across functions, and because the power-law function has the best correlation, it can be a way to describe the relationship.
Could the internal lag simply come from the fact that the two groups have different conversation histories, rather than from a real delay in internal agreement?
Thank you for this comment. We added Appendix O to evaluate this. In this analysis, the reference agreement conversations start at disagreement, similar to the opinion-change test examples. This modification makes the reference group more similar to the opinion-change test group. In this section, we continue to see the lag, further justifying our paper's claim.
We appreciate your comments! We have added the suggested validations in line with your recommendations. We are happy to discuss any further questions.