- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper studies how seemingly small implementation choices can have great implication on the collective outcomes of LLM social simulations, challenging the scientific soundness of this field. It specifically studies controlled perturbations on sequential Prisoner's Dilemma and social-media echo chamber simulation. TRAILS (Taxonomy for Robustness Audits In LLM Simulations)
Critical strengths
- The paper presents an interesting perspective of studying multi-agent LLM interaction, challenging the soundness of most LLM social simulations. It reframes validation of LLM social simulations away from realism and toward robustness, asking whether a certain conclusion holds across implementation choices.
- Clear writing and compelling examples. The paper is easy to follow. Figure 2 makes a strong point: three formats of an identical strategic persona (PLAIN, DESCRIPTIVE, TABULAR) produce a 75.2% cooperation gap.
Critical weaknesses
- Figure 2 sends a strong information but it is only one model. The SD error bars are also very wide, especially for the descriptive condition case. One cannot conclude enough from this figure, and this figure is the headline result. My suggestion is to constrain the cooperation decision output to a binary token "Yes/No" so that the authors could read per-round action probabilities from the logits instead of inferring a rate from 30 sampled trajectories, yielding a much tighter estimate of the same quantity. You can refer to the logit method in https://arxiv.org/abs/2601.13518.
- The paper reports that sensitivity varies across perturbations and models and that reciprocal interaction can amplify or attenuate it, but offers neither hypothesis for the underlying mechanism, nor follow-up experiment that would further explain the observations. One plausible hypothesis is that plain format makes it easier to digest for language model and easy to follow comparing to tabular encoding. I would like to see the authors deliberately design further experiments to testify pursue your hypothesis.
- nit: Section 3.1 conceptual framework is a bit redundant.
Questions for authors
- The paper proposes a Social Simulation Audit Card asks researchers to run perturbations across TRAILS dimensions and multiple models, but the paper does not report what the audits cost in API spend, tokens, or wall-clock time. Most labs don't have sufficient resources to run all these perturbations over all the models. An auditing protocol that is unaffordable for most groups will not be adopted.
- Do the authors have hypothesis for (1) the persona-representation effect on cooperation behavior in Figure 2 (2) the cross-model pattern, in particular why deepseek-v3.2 attenuates the persona contrast (A = -0.087, Table 6) while the other three amplify it?
4 comments
Response to W1 (Visualization in Figure 2 and a logit-based alternative)
The reviewer points out a caveat in how Fig. 2 visualizes the headline result: the SD error bars are wide, especially under Descriptive, which makes the result harder to read than it should be. We agree that our choice of visualization was not ideal for this figure. The reviewer also suggests estimating per-round action probabilities from the logits as a tighter alternative to sampling trajectories.
Changes to Figure 2 (). We agree that the original visualization did not show the result clearly. The revised figure makes three changes:
- Error bars now show 95% confidence intervals of the mean instead of standard deviations.
- Dots show individual runs, so the shape of the run-level distribution is visible.
- The significance heatmaps now use Holm-corrected Mann–Whitney tests on run-level means.
The wide spread under Descriptive reflects a two-peaked outcome rather than imprecision. Some runs lock into mutual cooperation and others into mutual defection, which is the path dependence we analyze in . The mean difference itself is precisely estimated: −75.2 pp, 95% CI [−88.3, −62.0]. Fig. 2 illustrates GPT-5.2. Results for all four models are reported in and .
New experiment: action-token probabilities (). We appreciate this suggestion and applied the logit method the reviewer pointed to (Yuan et al., 2026, now cited). We kept the original prompt and read the probability of the action token from the model's JSON answer, since switching to a Yes/No output would itself change how the actions are represented.
Unfortunately, the method applies to only one of our four models. Claude's API does not return log-probabilities. Gemini 2.5 Flash reasons before it answers, so by the time it writes the action, the probability is almost always 0 or 1 and carries no more information than the sampled action. For DeepSeek V4 Flash, the API's top alternatives did not include the action actually generated, so its probability could not be read reliably. We therefore report the analysis for GPT-5.2.
| GPT-5.2, Descriptive − Plain | Estimate [95% CI] |
|---|---|
| Sampled actions | −0.75 [−0.87, −0.62] |
| Action-token probabilities | −0.77 [−0.87, −0.67] |
The two estimates agree closely, so the persona effect is not an artifact of sampling a small number of trajectories. The logits also show how each representation responds to the same situation: after a round of mutual defection, the probability of cooperating is 0.36–0.82 under Plain but 0.00 under Descriptive and Tabular.
Summary. The logit analysis confirms the effect with a different estimator. The interval narrows only slightly because most of the uncertainty comes from differences between trajectories, the path dependence analyzed in . We therefore keep trajectory sampling as our main estimate and report the logit results alongside it.
Response to Q1 (Time and cost of an audit)
The reviewer asks what an audit costs in API spend, tokens and wall-clock time, noting that a protocol most groups cannot afford will not be adopted.
New analysis: audit cost (, ). A study already runs its baseline, so each audited perturbation adds only the runs for the new condition. Using the token counts recorded in our experiments, one perturbation with 30 runs costs:
| Model | Prisoner's Dilemma | Echo chamber |
|---|---|---|
| GPT-5.2 | $2.44 | $38.32 |
| Claude Haiku 4.5 | $1.36 | $22.89 |
| Gemini 2.5 Flash | $0.23 | $7.13 |
| DeepSeek | $0.09 | $1.33 |
Wall-clock time is set mainly by API rate limits.
Beyond cost: making audits feasible. We understand that the reviewer's concern goes beyond time and money to whether the card is feasible in practice. The card does not require every dimension to be audited on every model. Researchers record which dimensions they audited and bound each verdict by that coverage. To help them decide where to start, the revised paper adds explicit criteria for prioritizing perturbations (, ). Context relevance separates choices that define a claim's scope from choices that reveal implementation dependence. Among the latter, we recommend auditing first those that have no standard value and enter every agent decision, such as persona and prompt representation ().
Response to the nit on Section 3.1
We reduced the redundancy in and kept only the definitions used in later sections.
Thank you again for your thoughtful review and constructive suggestions, which have improved our paper. We would be happy to discuss any remaining questions during the discussion period.
Sincerely, The Authors
Gentle reminder for reviewer feedback
Dear Reviewer e6rd,
Thank you again for your thoughtful review. Following your suggestions, we have added a mechanism analysis and a logit-based estimate. As the discussion period is coming to an end, we would greatly appreciate it if you could let us know whether they address your concerns.
Sincerely, The Authors
Thank you for adding the mechanism analysis and logit-based estimate I asked for. I believe this is a strong paper and it meets my bar of acceptance. I will keep my rating as it is.
Response from authors
Dear Reviewer e6rd,
Thank you for your thoughtful review and for recognizing our contribution in reframing the evaluation of LLM social simulations around robustness. We also appreciate your positive assessment of the paper’s clarity and the persuasive empirical example demonstrating sensitivity to implementation choices. Below, we respond to your suggestions and questions with additional experiments, analyses, and clarifications. All changes are highlighted in blue in the revised paper.
Response to W2 and Q2 (Mechanism behind the butterfly effect)
The reviewer notes that we show sensitivity varies across perturbations and models, and that interaction can amplify or attenuate it, but we offer no hypothesis or follow-up experiment to explain why. The reviewer also suggests candidate hypothesis to test.
We thank the reviewer for pushing us to deepen both the contribution and the analysis. In response, we added a mechanism analysis built on additional experiments to the revised paper (Sec. 4.3), built around two hypotheses that we test directly.
Hypothesis 1: representation matters when the persona conflicts with the model's default behavior (App. D.2, Fig. 8). If structured formats were simply harder to follow, as the reviewer suggests, the effect would appear for any persona. Instead:
Representation therefore matters most when the persona pushes against the model's default tendency to cooperate.
Hypothesis 2: interaction amplifies representation effects that appear early in the game (App. D.4, Figs. 5 and 10). Reciprocity carries the first move forward, so a representation that changes round-1 behavior is amplified, and one that does not is attenuated. The round-1 gap tracks A across all 12 model–representation pairs (Spearman ρ = 0.76):
DeepSeek V3.2 opens cooperatively under every representation, so there is no early difference to amplify. DeepSeek V4 Flash, held out from deriving the pattern, opens differently under Descriptive, and both Descriptive contrasts are amplified, as predicted. Beyond the opening, after a forced mutual-defection opening only Plain agents return to cooperation, and the share of stated reasons citing exploitation risk tracks defection (ρ = −0.90).
Limitations of these hypotheses. Sensitivity to small differences is a long-standing topic in the study of social systems. In human collective behavior, social influence makes outcomes unpredictable even across groups facing identical conditions (Salganik et al., 2006). In agent-based modeling, a small change to a single agent can alter macro-level behavior (Bertolotti et al., 2020), and implementation choices can introduce artefacts into a model's results (Galán et al., 2009). Our hypotheses explain the patterns in our two testbeds, but they do not provide a general account of why LLM agents are sensitive to representation. Our contribution is to show that LLM social simulations introduce an additional source of sensitivity, the representation of agent specifications, which is currently overlooked and needs to be measured and reported. A full mechanistic explanation remains future work.
References
Salganik, M. J., Dodds, P. S., & Watts, D. J. (2006). Experimental study of inequality and unpredictability in an artificial cultural market. Science, 311(5762), 854–856.
Bertolotti, F., Locoro, A., & Mari, L. (2020). Sensitivity to initial conditions in agent-based models. In Multi-Agent Systems and Agreement Technologies (EUMAS/AT 2020), Lecture Notes in Computer Science, vol. 12520, pp. 501–508. Springer.
Galán, J. M., Izquierdo, L. R., Izquierdo, S. S., Santos, J. I., del Olmo, R., López-Paredes, A., & Edmonds, B. (2009). Errors and artefacts in agent-based modelling. Journal of Artificial Societies and Social Simulation, 12(1), 1.