- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how collective stance dynamics in LLM-based multi-agent systems respond to controlled bias injection. Experiments use five models, groups of eight agents, six network topologies, and repeated random seeds. The study examines individual conformity responses, homogeneous-group consensus thresholds, mixed-group cascades, and polarization between opposing camps. Additional private-report prompts assess differences between publicly expressed and privately reported stances. The paper reports a homogeneous-group transition between injection levels 0.25 and 0.30, summarized by an approximate threshold of 0.27. It proposes a dose–drift crossing relation to locate this transition interval. In mixed groups, the fraction needed for a cascade depends on network structure and biased-agent placement. The contribution is a useful empirical characterization, although the predictive interpretation and measurement protocols require clarification.
Critical strengths
1.The controlled response-curve approach adds information beyond documenting bias amplification. Scanning injection levels and examining both continuous stance changes and consensus frequencies helps distinguish gradual drift from sharp changes. Comparing homogeneous groups, mixed groups, and opposing camps also reveals that these settings exhibit different collective dynamics.
2.The findings offer useful insights into the competing effects of network structure. Community separation can delay global cascades while sustaining local polarization, whereas dense interaction can encourage compromise under lower injection levels. The paper also appropriately qualifies “phase transition” as an operational finite-group phenomenon and acknowledges that the proposed early-warning indicators lack demonstrated runtime lead time.
Critical weaknesses
1.The dose–drift crossing relation has limited evidence as an a priori predictive law. Section 4.2 estimates drift from a nearby condition and combines it with the measured dose-response curve to locate the same transition interval. This is a useful approximation, but the manuscript does not establish predictive accuracy on held-out model or protocol conditions. The mean-stance crossing is also only a surrogate for the actual three-quarters consensus rule. Furthermore, fine-grid injection is constructed through numerical stance prompts, and Appendix B.1 reports different drift behavior for textual and numerical-anchor conditions. Their compatibility is important to the prediction claim.
2.Some measurement interpretations and protocol details remain unresolved. A private-report prompt measures a response under different instructions; it does not independently establish an underlying private belief or superficial compliance. There are also concrete inconsistencies: the abstract reports switching thresholds of 0.48–0.63, while Section 4.3 uses approximately 0.72; Sections 3.3 and the Figure 3 caption describe a final-round private probe, while Appendix C.1.5 describes probing after every round. These distinctions affect the interpretation and reproducibility of the collective-dynamics analysis.
Questions for authors
-
Injection-protocol clarification: Which scan points use persona text and which use numerical stance injection? Can you show that the transition and drift estimates remain consistent when the two injection procedures are analyzed separately?
-
Predictive-validation clarification: Do you have predictions made using independently estimated dose-response and drift parameters for held-out models or interaction protocols? What prediction uncertainty follows from the parameter estimates and grid resolution?
-
Reporting clarification: Please reconcile the 0.48–0.63 versus approximately 0.72 switching thresholds and the conflicting descriptions of private-probe timing. What evidence distinguishes the public–private response gap from a direct prompting effect?