- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes "full-event simulation", in which a model generates, in closed loop, not only what users say but also who acts, when, and to whom. Its system, ACT-AWARE, combines a learned actor ranker and reply-target head, an OSim-4B text model, and a data-calibrated controller, and the paper shows that trailing-window simulators face a model-independent coverage ceiling (Proposition 1). On Reddit data, it outperforms 15 zero-shot LLMs at picking real actors and reaches 2.35× the coverage ceiling of a 6 h pool using a 7 d pool.
Critical strengths
1. An interesting perspective. Existing LLM-agent simulators mostly delegate "who acts and when" to mechanisms outside the model. The paper proposes treating it as an output rather than an input of the model, and formalises this as the six-factor decomposition. This perspective is a useful contribution to the social simulation community.
2. Solid engineering analysis of closed-loop dynamics. The loop-gain analysis of the rate model, the use of DAgger to handle feature-distribution drift, the diagnosis of the reply-target head's "support failure", and the analysis of how composition drives aggregate precision are all convincing and reusable insights.
Critical weaknesses
1. Text does not enter the structural dynamics, so the core element of social simulation is missing. Section 2.1 states explicitly that x_e only affects the text of events replying to it, and that structure can be sampled first with text filled in afterwards; none of the ten features of the reply-target head carry any textual information either. This means that what a post says has no influence at all on who replies to it, how many reply, or whether a long chain forms. This contradicts content-driven dynamics observed in practice (such as topic diffusion, opinion evolution). At least the authors should (a) state this limitation clearly in the abstract and introduction, and (b) provide an ablation in which text affects structure, or argue why the decoupling does not harm fidelity.
2. Lack of the macro-level distributional and counterfactual evaluation that social simulation actually cares about. The goal of social simulation is usually fidelity of distributions and mechanisms, not merely predicting specific users. Yet the evaluation focuses on identity-level coverage and precision, reports almost no distributional metrics such as cascade/thread size, inter-event times or the heavy tail of posts per user, and includes no intervention or counterfactual experiment. The few macro-level metrics that are reported show clear deviations that go undiscussed.
3. Insufficient comparison with and discussion of related work. The authors claim that existing LLM-agent simulators leave "who acts and when" to hand-written rules, but some existing work lets agents themselves decide whether to act and which action to take. Moreover, rules or priors are often a deliberate trade-off between fidelity, cost and controllability: they are cheap at the scale of millions of agents, transparent, and make it easy to specify scenarios, drive synthetic populations and run interventions. The paper does not discuss these trade-offs: it gives no runtime or scaling data, and its controller targets numerical stability rather than scenario control. The authors should discuss and compare against this line of work.
4. Overclaiming: the claim that "who acts is learnable" does not match the actual system. Only candidate ranking and reply targets are learned. Most quantities that determine population dynamics are fixed or hand-tuned: the total D̂_t depends only on the clock, the recency composition is fixed to its measured value, per-actor event counts come from an empirical table, and τ, ρ and K are tuned on validation. In other words, the system still has an external scheduler (the controller), only more finely calibrated.
Questions for authors
- What is the cost of a full rollout? Please report per-step runtime, throughput, and scaling with candidate-pool size and number of actors. What would it cost to generate text for all events, and how does this compare with LLM-agent simulators that use rule-based scheduling?
- How would a researcher specify scenarios in this framework, such as adjusting the activity of a particular group, or injecting new agents or a synthetic population? Does the method still apply where real historical trajectories are unavailable?
- Is the decoupling of text and structure a deliberate modelling choice or a compute constraint? If the actor head and reply-target head read a representation of post text, how would closed-loop coverage, attachment rate and the reply-chain depth distribution change? Without such a change, can you provide evidence that the decoupling does not harm fidelity?