- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates how explicit model-family identities affect cooperation and coordination in multi-agent LLM systems. Across tasks including Leader Election, Exclusion, and GPQA-Diamond, the authors compare labeled agents with unlabeled agents and agents assigned shuffled or misleading identities. They find that identity labels can induce factional behavior, alter agreement patterns, and reduce task success while increasing token costs. The results suggest that making model identities visible can influence multi-agent dynamics beyond agents’ underlying capabilities.
Critical strengths
The paper studies a timely and practically relevant question as multi-agent LLM systems become more common. The use of truthful, shuffled, and neutral identity conditions is a compelling experimental design that helps investigate whether behavior depends on identity labels rather than model capabilities alone. The evaluation spans multiple tasks and team sizes, and the combination of task outcomes, agreement-graph analysis, and qualitative examples provides several perspectives on how identity cues may affect agent interactions. The findings also suggest a concrete design implication: identity disclosure should be considered carefully when constructing multi-agent systems.
Critical weaknesses
The paper’s central claim about degraded cooperation is stronger than the experiments fully establish. The agreement-graph measures may conflate communication patterns, strategic voting, and genuine factional preference, while the tasks, particularly Exclusion, may make coalition formation strategically useful rather than simply dysfunctional. The experiments also do not fully disentangle the effects of an agent’s own identity label from the identities of other agents. In addition, statistical uncertainty and multiple-comparison concerns across the many experiments and outcomes deserve more attention, and the reported cost-performance trade-offs are mixed. This make it difficult to determine how broadly the findings generalize to genuinely cooperative settings.
Questions for authors
- How do you distinguish identity-driven factionalism from strategic coalition formation? Would the main findings persist in a task where agents have an explicitly shared objective and forming identity-based coalitions offers no strategic advantage?
- Can you isolate the causal effects of own identity versus others’ identities? For example, have you considered a factorial experiment that independently varies whether an agent sees its own model-family label and whether it sees other agents’ labels, while controlling for prompt length?