- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes the SNLA framework to address the limitation of existing social network models in accurately characterizing the collective belief aggregation process of LLM agent populations, particularly the issue where final beliefs become overly biased toward a minority of agents.
By introducing two core parameters—attention width and social power—the paper establishes a mapping model from exposure to realized influence. Furthermore, the paper proposes a decentralized equalization protocol to eliminate the monopoly of high-power nodes.
Critical strengths
Rigorous theoretical modeling and analysis. The paper conducts an in-depth analysis through a proxy model to prove the impact of attention width and social power on collective belief aggregation. Furthermore, it establishes error bounds between the non-rational updates of LLMs and the linear proxy model through both theoretical derivation and empirical validation, making significant contributions to the theoretical foundations of multi-agent systems.
Critical weaknesses
-
Limited diversity of LLM backbones. The majority of experiments in this paper rely exclusively on the Qwen2.5 model family. This limited scope undermines the claim of generalizability; it remains possible that more capable or differently aligned models might naturally mitigate herding effects without requiring the proposed interventions. Additional validation across a broader range of model architectures is necessary to establish the universality of these findings.
-
On both HiddenBench and Werewolf benchmarks, the study focuses solely on scenarios where the high-centrality hub node holds incorrect information. The authors should demonstrate that increasing attention width or applying the decentralized equalization protocol can improve (or at least maintain) collective belief accuracy when non-hub nodes err.
-
The convergence of the decentralized pricing protocol is independent of initialization, whereas in most practical scenarios, the initialization of weights carries significant semantic meaning. For instance, the paper initializes hub nodes with high weights, yet after pricing, these weights revert to average levels. So what is the purpose of this initialization design? Consequently, this limits the practical value of the proposed protocol.
Questions for authors
See weaknesses.
What's more, the arrows in Figure 1 are composed of straight lines and triangles, and the arrows from A2 and A4 to A5 are incorrect, and the connections between A1 and A3 should be bidirectional. This leads me to suspect that the figure was AI-generated; however, this is not disclosed in the AI Use Statement.