- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors introduce the Flag Game, an experimental multi-agent framework in which agents receive different crops of a flag and exchange messages to identify the correct country. The authors explore how collective performance changes with population size, communication protocols, social-awareness prompting, and model heterogeneity. The results show that collective performance scales non-monotonically with the number of agents and that, as the population grows, failures shift from incorrect consensus to polarization between competing beliefs.
To investigate these phenomena, the authors propose two approaches. First, they introduce "social circuit attribution", a method that combines crop accuracy gain and temporal closeness to predict the influence of individual agents, which is tested through causal interventions. Second, they develop a mean-field model which implies three different phases based on the number of agents, that explain the non-monotonic behavior of the population size.
Critical strengths
The attempt to adapt methods inspired by mechanistic interpretability to investigate emergent collective behavior is a relevant research direction. The authors develop a simple and controlled experimental framework that allows the study of interaction and how macro-level phenomena emerge.
The experiments cover several orthogonal dimensions (size, protocols, models, heterogeneity, social-awareness, ...) and the authors successfully isolate the key variables governing the phenomenon under study.
Critical weaknesses
The experimental protocol and information flow are not completely clear in the main manuscript. Section 3 introduces the main components of the simulation: memory, patches, etc., but some important details are missing. To exemplify: it is not clear what a memory entry is made of. Are models given a set of candidate countries, or are the options open-ended? When does a game end if there is no 100% consensus? The low-level description of the game (with prompts and textual memory) can stay in the appendix, but Section 3 should contain all the details needed to picture a high-level overview of the experiments.
The method "social circuit attribution" is presented as a main contribution; however, there is not enough evidence supporting its effectiveness in the main manuscript. In particular, Figure 6b validates the method on a single illustrative game with 8 agents. It is not clear whether the proposed attribution score reliably predicts causal influence across different games, communication schedules, and population sizes. Finally, even if the method predicts influence reliably, the outcome is a ranking of the agents for a specific communication pattern, which might be highly correlated with their temporal centrality (especially if the number of available flags is small). It is not clear if the proposed method adds something new. A comparison with two baselines based solely on temporal centrality or crop accuracy would help clarify the contribution.
The theoretical model assumes a truth-biased adoption probability. However, since agents do not know the correct country, it is unclear why they should systematically favor messages supporting the ground truth over messages supporting a rival country. This should be supported by empirical evidence.
The authors don't list which models are used for each experiment. Some figures mention specific models, but a table or description of which models have been used throughout the whole manuscript is missing.
The related work section could be significantly improved. Currently, it reads as a high-level list of loosely related papers rather than critically engaging with existing literature or contextualizing the paper's novelty.
The core takeaway of the paper is somewhat diffused. The authors would benefit from focusing on fewer aspects of the problem and analyzing each in greater depth.
A vision task might not be a suitable choice, as individual agent performance might depend on the vision capabilities of a model. In Figure 1a, for instance, the agents' initial guesses are inconsistent with the visual crops they observe. This contradicts the results of figure 3, which instead demonstrate overall high accuracy of two models.
Questions for authors
In Section 5.1, the experiment social memory probing is not clearly explained. In particular, it is not clear what the authors mean by target ratio and social alignment. Could the authors clarify these definition?
Why were social awareness and memory omitted from the mean-field model? How do you explain the existence of a zealot supporting an incorrect flag?
It seems that some experiments were conducted for a subset of models. Why?
In Figure 6d, how does the number of interactions scale with N? This could explain the weaker impact of patching when N increases.
Could the authors conduct more experiments to validate the predictive power of your circuit tracing method and compare it to the baselines described above?
The paper "Group size effects and collective misalignment in LLM multi-agent systems" (PNAS) analyzes changes in macro-behavior when N increases. How does this work connect to that paper?
Did the author consider the voter model in finite populations without zealots? This model suits the memetic drift phase, which would imply the exact consensus probabilities based on initial opinions (see, e.g., Hassin & Peleg, Information and Computation, 2001).