acceptodds
Under review as a conference paper at ICLR 2027

Unlocking Many Voices in LLM Social Simulation

Abstract

Constructing populations for LLM social simulation requires agents that reflect differences among real people. Prompting many agents from a shared model often produces a small set of similar voices, compressing the diversity of the resulting society. To address this problem, we propose ReMap, a method that learns individual variation from real writing and composes it into synthetic populations. We first encode individual variation into model weights through lightweight adaptation. We then compose these learned adaptations across model depth to create agents assembled from multiple source individuals. Experiments across three domains and six backbones show that ReMap populations stay close to human writing while supplying far more mutually distinguishable agents than the library contains, and that they produce more diverse collective behavior than prompted populations inside external simulators. These results suggest a path toward more representative LLM populations for studying collective behavior.

Primary area:
alignment, fairness, safety, privacy, and societal considerations
Keywords:
LLM social simulation, multi-agent systems, population modeling, large language models, low-rank adaptation

Reviews

Among:
Shape:
1234this paper, Top 49%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.33 over 3 reviews, above 51% of the others.
Reviewer_KWX3OpenReview ↗
Rating
2(+1)
Confidence
3
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

This paper tackles diversity collapse in LLM-based social simulation, where agents differ only by persona prompts on a shared model. The proposed ReMap trains one LoRA module per source individual on their real posts, then builds new agents by assigning each depth block of the model the LoRA factors of a randomly sampled source, so that a small module library yields a much larger population. Across three domains and six backbones, the authors report that ReMap populations are closer to human text than prompted populations, contain far more distinguishable agents than the library size, and produce more diverse collective behavior in OASIS and YSocial, while remaining cheap to serve on a single GPU.

Critical strengths
  1. Important problem, clear motivation, and a simple, easy-to-follow method. Homogeneity of persona-prompted populations is a recognized threat to the validity of LLM social simulation. The moving individual variation into weights is a sensible, under-explored direction. Block-wise recombination of aligned LoRA factors requires no per-agent training, yields a standard adapter, and is easy to understand and plug into existing simulators.
  2. Some informative ablations and analyses in the experiments. The experiments cover three domains, six backbones and two external simulators. The ingredient study separates training on human text, distinctness of modules, and parametric vs in-context storage; the block-count and cross-block dependence sweeps, the context comparison, and the matching analysis with a K/N bound and Hoeffding lower bound (Appendix C) all provide useful evidence.
Critical weaknesses

1. Unfair comparison; insufficient baselines and related work . Table 1 compares ReMap only against untrained conditions, which any model fine-tuned on in-domain text should easily beat. The key fine-tuned baselines (single-source LoRA and a shared adapter on pooled source text) appear only in appendix analyses on one backbone, where they are as faithful as or more faithful than ReMap; they should be in the main table and be discussed in detail. Also, learned composition baselines (e.g., gated or routed LoRA modules, persona-conditioned shared adapters) are missing. Closely related multi-LoRA role-playing work such as Neeko and HIRPF [1-2] is not discussed, and the advantage of depth-wise hard splicing over learned same-layer composition is not explained.

2. "Distinguishable" is not the same as "a plausible new individual". Re-identifiability across sessions does not show that ReMap creates distinct, coherent individuals: it may reflect surface artifacts of block combinations, and there is no evidence that recombined agents hold consistent stances across related topics. Frequent self-repetition of ReMap agents in OASIS may also artificially inflate stance diversity and lower conformity, and the claimed tenfold expansion overstates the effective population size.

3. The "representativeness" claim conflicts with how source individuals are sampled. The sources are the 40 most prolific Reddit users, the 40 highest-volume congressional accounts, and 40 SCOTUS advocates. Highly active users are a notoriously unrepresentative slice of any platform, and 40 people cannot cover the variation of a society; recombination can only interpolate within this narrow base. The paper repeatedly claims to construct "more representative LLM populations" without measuring representativeness against any demographic or attitudinal target. The authors should either narrow this claim or show how fidelity and diversity change with larger K (e.g., 200 or 1,000 sources) and with less active users.

4. Limited insight into why block-wise recombination works. The method relies on the assumption that LoRA blocks trained independently for different individuals on the same backbone remain functionally compatible when spliced together. The paper offers no analysis of this, such as which depths carry stance versus style, how often recombination produces incoherent text, or how the choice of block boundaries interacts with model depth. The so-called "theoretical derivations" consist only of the K/N matching bound and a Hoeffding interval, which are correct but elementary. A layer-wise analysis would substantially strengthen the contribution.

[1] Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent
[2] Identity-Driven Hierarchical Role-Playing Agents

Questions for authors
  1. What ReMap gains over single-source beyond population count? I suggest adding single-source LoRA and the shared all-source adapter as rows in Table 1 for all backbones and analyze the results.
  2. How do fidelity, Vendi, matching accuracy and attribution change as K grows (e.g., 40 → 500 → 1,000 sources), and when sources are sampled uniformly rather than as top-volume users?
  3. Do recombined agents hold coherent positions across related topics? For instance, does an agent's stance on gun policy predict its stance on related claims at a rate similar to human authors in the same corpus?
  4. Which depth blocks carry most of the stance signal versus stylistic signal? A swap experiment that varies one block at a time would answer this.
Reviewer_KSV3OpenReview ↗
Rating
3
Confidence
3
Informativeness
3
Presentation
3
Soundness
2
Read review
Paper summary

This paper proposes ReMap (Recombining Modular Adaptations into Populations), a method for building behaviorally diverse agent populations for LLM-based social simulation. ReMap first trains person-specific LoRA modules using writing data from real individuals. It then divides the Transformer layers into several blocks and independently selects LoRA parameters from different individuals for each block to create new agents. The authors conduct experiments across three domains (Reddit, SCOTUS, and Congress) and six LLM backbones. The results show that ReMap outperforms persona-based methods in terms of text distribution fidelity, agent distinguishability, and population diversity. In addition, the authors integrate ReMap into the OASIS and YSocial social simulation frameworks to further validate its effectiveness.

Critical strengths
  1. The proposed method is simple, effective, and scalable. In addition, the experiments and discussion on serving costs in Section 4.6 help address concerns about the resource overhead of scaling this method to large-scale agent simulations.

  2. The experiments are comprehensive, covering three different domains and six LLM backbones. Beyond text generation metrics, the authors also integrate ReMap into OASIS and YSocial to examine its effects on population opinion distributions, conformity, and responses to misinformation.

Critical weaknesses
  1. The representativeness of the synthetic population is still limited by the real individuals used as training data, and cross-layer composition does not necessarily produce genuinely new individual characteristics. All adaptation modules in ReMap are learned from a limited set of real individuals, and cross-layer composition essentially recombines parameter updates learned from these individuals. If the source individuals have systematic biases in demographic attributes, cultural backgrounds, or behavioral patterns, combining their modules may not be enough to generate characteristics that are missing from the source data.

  2. The current evaluation is not sufficient to fully demonstrate that ReMap produces more realistic social behaviors. There is still a gap between diversity at the text level and realism at the social level. Greater behavioral diversity does not necessarily mean more realistic social simulation. For example, Table 3 shows that ReMap reduces Conformity from 0.991 for Base to 0.684. However, the paper does not provide a corresponding conformity level from real human populations under the same experimental setting. Therefore, it is difficult to tell whether this change makes the simulation closer to real society or simply increases disagreement among agents.

Questions for authors
  1. How can the authors show that ReMap creates agents with genuinely new behavioral characteristics? Do the new combinations simply form similar response clusters around a few source individuals, or do they actually produce new and stable response patterns? Also, I would like the authors to clarify to what extent ReMap can address the lack of population representativeness when the source module library itself is not representative.

  2. Could the authors clarify whether there are comparable real human behavioral baselines for key metrics such as Conformity and Opinion Entropy in Table 3? If not, why should changes in these metrics be interpreted as improvements in social simulation realism rather than simply increases in diversity?

Reviewer_XmosOpenReview ↗
Rating
2
Confidence
1
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

The paper proposes ReMap, a method for constructing diverse LLM populations for social simulation. The method combines person-specific LoRA training on real writing with cross-layer recombination of the learned adapters. Experiments show improved alignment with human text distributions and population expansion beyond the source library size, while ablation studies examine the contributions of LoRA training, source-specific modules, and block composition.

Critical strengths
  1. The idea of constructing agents through layer-wise mixing of person-specific adapters is interesting.

  2. The ablation studies are comprehensive and help clarify the effects of the main design choices.

Critical weaknesses
  1. The evaluation lacks comparisons with relevant existing methods, such as Mixture-of-Personas (MoP) [1]. The authors should include these baselines or clearly explain why they are not applicable to the proposed setting. This is my main concern, and I would raise my score if it were satisfactorily addressed.

  2. It would be valuable to analyze the functional roles of different layers or depth blocks. Such an analysis could clarify their contributions to agent behavior and provide insight into why layer-wise mixing is effective.

[1] Bui, Ngoc, et al. “Mixture-of-personas language models for population simulation.” Findings of the Association for Computational Linguistics: ACL 2025, 2025.

Questions for authors
  1. In Table 11, ReMap has higher (worse) C2ST scores than the single-source LoRA baseline. Does this suggest that the gains in distributional fidelity primarily come from LoRA training rather than cross-layer recombination?

  2. Could the method be extended to mixing at a finer granularity than depth blocks?

Comments on the paper

1 comment
Reviewer_KWX3OpenReview ↗

Response to the Authors

Thank you for the detailed response and the new experiments. Some of my concerns have been addressed, so I have accordingly raised my score. However, a few concerns remain. The new results show that the uniform recipe used in all main experiments yields low cross-topic stance consistency, and the proposed fix relies on group labels, which seems at odds with the claim that ReMap requires no explicit specification. In addition, the collapse of the learned gating baselines may stem from their setup (e.g., no per-agent gate inputs or load-balancing regularization) rather than an inherent limitation, so please clarify how these baselines were configured.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.