- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies how polarization and discrimination develop in a population of agents that update both their opinions and their trust in others. It extends an existing Bayesian opinion-learning model by assigning agents arbitrary group labels and making some agents favour their own group. Simulations identify four collective states, including discrimination with and without opinions aligning with group membership. Separate experiments with one LLM show qualitative agreement with the local opinion and trust updates. The collective results, however, are demonstrated using mathematical agents rather than interacting LLMs.
Critical strengths
The distinction between discrimination with and without opinion alignment is the most interesting finding. It shows that group-based distrust can persist without a corresponding divide in opinions. This adds a useful insight beyond simply observing polarization, and the longer simulations and perturbation tests provide support that this behaviour is persistent.
The model provides a clear way to study how bias strength and prevalence jointly shape collective behaviour. Tracking opinions, trust, and group membership separately allows the authors to distinguish outcomes that a single polarization measure would miss. This makes the framework useful for studying collective behaviour, even though its applicability to LLM populations still needs validation.
Critical weaknesses
The connection to interacting LLM populations is not sufficiently established. The LLM experiments examine opinion and trust updates separately, using one model, whereas the main findings depend on their coupled evolution through repeated interactions. No experiment demonstrates the collective states in an actual LLM population. This leaves a substantial gap between the evidence and the paper’s broader claims about multi-agent AI safety.
The Bayesian justification needs clarification. Appendix A states that the covariance remains block diagonal, although the likelihood generally introduces dependence between opinion weights and distrust. Maintaining independence therefore appears to require an additional approximation. This matters because the derivation and claimed optimality are central to the paper’s justification of its update rules; the authors need to explain the approximation and establish whether the findings are robust to it.
The evidence for sharp phase transitions is limited. The main phase diagram averages only two realizations per parameter setting, and the population-size and duration checks cover selected points rather than the transition boundaries. These results support the existence of different collective states, but do not establish how reliably their boundaries can be located or whether the transitions remain sharp in larger populations.
Questions for authors
-
Clarification: Appendix A states that the covariance remains block diagonal. How does this follow, given that the likelihood couples opinion weights and distrust? If cross-covariances are discarded as an approximation, how does this affect the claimed optimality of the update rules?
-
Evidence supporting the scope of the claims: Beyond the separate single-interaction experiments, what evidence supports using these rules to predict the coupled evolution of opinions and trust in LLM populations? Have you tested repeated interactions where both evolve together? I am asking whether such validation supports the current claims, rather than suggesting a broader future research programme.
5 comments
I appreciate the authors conducting new experiments. Also, your explainaition of the independence assumption answers my question.
I was wondering what happened to trust as the opinions converged in your experiments. Did the agents continue to trust the members of their own group?
In the LLM experiment both trust and opinion converge. The collective do not polarize into two camps: agents from both groups trust on another, and their opinion converge to consensus.
I updated the manuscript with this changes.
We thank the reviewer for the helpful comments. The new results address repeated interactions in LLM populations, robustness of the learning dynamics, and the analytical basis for the collective states.
Additional results
-
-
-
\qquad r(x)=\frac{\phi(x)}{\Phi(x)}.$$ Here $b$ is bias strength, $f_c(b)$ is the critical fraction of biased agents, and $\phi,\Phi$ are the standard normal density and cumulative distribution. Overlaid on the numerical phase diagram, the derived curve separates the two phases with no adjusted parameters. Similar analytical expressions can be derived for the other boundaries using the microscopic update equations. - **R4. Stability and mechanism of IIIb.** From the microscopic update equations, we show under explicit conditions that the probability that a phase IIIb configuration survives all future interactions is bounded from below by: $$1-\sum_r\frac{D_r^2+\operatorname{tr}S_r}{d_r^2}.$$ Here $r$ labels agents, and $D_r$, $S_r$, and $d_r$ are quantities constructed in the proof from the agents’ microscopic states, the discussion agenda, and the bias parameters. Applied to 20 randomly sampled IIIb configurations, it guarantees persistence with probability at least 90%. ## Responses to weaknesses - **W1.** R1 directly addresses the absence of interacting LLM populations. It tests repeated exchanges in two models, with both opinions and trust updated throughout, rather than measuring the two updates separately. The resulting tendency toward consensus connects these experiments to the positive-$a$ regime in Appendix C. We will give these population experiments a central role in the revision and distinguish this observed behavior from the other collective states predicted by the mathematical model and observed in human societies, as one can attest in the recent elections. - **W2.** Independence is an explicit modeling choice: agents represent beliefs as a product of Gaussians. The general entropic derivation applies to this restricted family, within which the updates are optimal under its information criterion. Correlations in the unrestricted Bayesian posterior do not invalidate that result. We will clarify that block diagonality is imposed by the representation. R2 also shows robustness to perturbations of the modulation functions. - **W3.** R3 provides an analytical consistency criterion from the microscopic equations, and R4 gives sufficient conditions for IIIb persistence over all future interactions. These strengthen the evidence beyond the numerical diagram. ## Responses to questions - **Q1.** Block diagonality is imposed when choosing the belief family; it does not follow from the likelihood. The update retains each sector’s means and covariances, leaving out cross-sector covariances. Optimality holds within this representation, as explained in W2. - **Q2.** Yes. R1 tests ten societies of 40 LLM agents, across two models, with 7,800 joint opinion–trust updates per society. Their tendency toward consensus connects to the positive-$a$ regime in Appendix C and provides the requested evidence from repeated, coupled interactions.R1. LLM simulations and consensus. We simulated LLM multi-agent systems. We ran ten simulations, each with N=40 agents, using Claude Haiku 5.5 and GPT-6 Luna. Every ordered pair interacted five times, giving 7,800 updates per simulation. The striking result is that these LLM societies do not polarize, they approach consensus. In Appendix C, we studied other components of the group-bias tensor, in particular, the (a,fa) slice has a consensus regime for positive a: this component shifts perceived agreement upward regardless of group. Therefore, our results suggest that LLMs behave like agents with positive a, providing a theoretical model for LLM agreeableness.
R2. Perturbed modulation functions. We perturbed the modulation functions and repeated the simulations. The qualitative pattern of the phase diagram remained for most perturbations, suggesting substantial robustness to perturbations in the modulation functions.
R3. Landau–Ginzburg analysis. We derive an analytical approximation to the IIIa–IIIb boundary from the microscopic update equations which is given by