- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies whether reproducing observed human choices can generalize to simulating human choices at large. To do this, they rely on counterfactuals for things like price and time in the SwissMetro domain. Their results show discrepancies even when baseline choices actually match humans (as fitted populations).
Critical strengths
This is a very important problem. So much research goes into getting LLMs to simulate human behavior (and so much capital in industry) without any sort of verification. I think the counterfactual approach is the right one, and the paper is well formulated.
Critical weaknesses
I think this work has potential to be great, but as of now, it’s quite unambitious. Collecting (or even finding) a human dataset with counterfactuals seems rather inexpensive. Instead, the paper is compromising the potential analysis by using fitted human responses. This, combined with using just one domain and one model family, makes the paper underwhelming.
I say this because I believe that LLM simulators of human behavior are overhyped, and I have been waiting for work to prove it. If I had to play devil’s advocate, I could say that perhaps frontier models can in fact simulate behavior, that one domain is not enough to justify your claims, or that it’s not enough data to simulate effectively. I encourage the authors to think bigger and help us show the limitations of LLM simulators.
Although not critical, you might want to review more existing literature. Other researchers are using counterfactuals to study AI systems:
- Cherep, M., Ma, C., Xu, A., Shaked, M., Maes, P., & Singh, N. (2026, April). A framework for studying ai agent behavior: Evidence from consumer choice experiments. In International Conference on Learning Representations (Vol. 2026, pp. 63296-63326).
- Karvonen, A., Ong, E., Kantamneni, S., & Marks, S. (2026). Would this change your answer? Evaluating Explanations of LLM Behavior In The Wild with Counterfactual Experiments. arXiv preprint arXiv:2608.16747.
- Yang, T., Mi, Z., Huang, Y., Zhang, G., Chen, J., Yang, Y., & Yi, J. (2026). AgentBoundary: Counterfactual Evaluation of Safety in Tool-Using LLM Agents. arXiv preprint arXiv:2609.33658.
Questions for authors
I don’t have any questions that could change my assessment. I think this work should be accepted once it tackles this problem more rigorously, and that should not be possible to do in a rebuttal period.
2 comments
I'm considering this more an acknowledgement than a rebuttal, but if there's something you'd like to discuss, I'd appreciate a human-written response.
We thank the reviewer for this assessment and for recognizing the potential value of the work. We agree that the central methodological concern requires a more rigorous and comprehensive treatment than can realistically be completed within a rebuttal period, and we do not regard the additional analyses reported here as a definitive resolution of that concern. Nevertheless, we have taken concrete first steps to clarify and strengthen the evidence: benchmarking the associated human models on a common reconstructed test set, adding a nested-logit robustness check, constructing semi-synthetic settings with known post-change choices and independent response ground truth, and directly quantifying the circularity of closed-reference evaluation. These analyses help delineate what the current evidence does and does not establish. In particular, they show that reference-based evaluation can materially understate residual response error, while external validity beyond SwissMetro and generalization across LLM scales and families remain open. Accordingly, we will revise the manuscript to narrow its claims, distinguish alignment with a fitted response operator from true human counterfactual fidelity, and present the new analyses as preliminary stress tests rather than comprehensive validation. We agree that a full resolution would require broader real intervention data, stronger independent evidence about human responses, and controlled cross-model experiments beyond the rebuttal period. We appreciate the reviewer’s clear articulation of the standard that this line of work should ultimately meet.