- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces SocialReasoner, a framework for improving LLM-based modeling of human decisions from structured survey data. It uses heterogeneous machine-learning experts to identify predictive relationships between respondent attributes, perception information, and behavioral choices, then converts these relationships into natural-language reasoning supervision for LLM fine-tuning. Across nine reconstructed survey datasets covering 281,995 respondents and over 8.7 million responses, the method improves individual response prediction, population-level distribution alignment, and transfer to an unseen survey and additional finance and healthcare tasks.
Critical strengths
- The paper is easy to understand.
- It proposes a new method and constructs a dataset.
- The performance is better than baselines
Critical weaknesses
- The definition of “human social reasoning” are overly broad. The paper frames social reasoning as understanding how humans interpret situations, weigh information, and make decisions, but operationalizes it mainly as predicting a held-out survey response from demographics and answers to other survey questions. This task is closer to individual behavioral or preference prediction and does not cover other established aspects of social reasoning such as theory of mind, mental-state inference, pragmatic understanding, or interpersonal reasoning.
- The claim that current LLMs fundamentally lack social reasoning is not sufficiently supported. Social reasoning is multidimensional, and established tasks such as Theory of Mind evaluate abilities such as inferring beliefs, intentions, desires, and emotions; recent work such as DialToM[1] shows that modern LLMs can already perform strongly on mental-state inference. Therefore, weak performance on the proposed survey-response benchmark demonstrates a limitation in individualized behavioral prediction, rather than a general deficiency in LLM social reasoning.
- The newly constructed benchmark lacks sufficient human validation of its central construct. Although the labels are authentic responses from large-scale human surveys, the paper does not report human evaluation showing that the proposed profile-to-response prediction task is a valid measure of social reasoning. In particular, there is no human baseline, estimate of task predictability, or human verification of whether the generated reasoning traces actually reflect plausible human reasoning processes.
- The motivation that current LLMs are fundamentally limited in social reasoning is not fully established. Several key observations in Figure 2 are demonstrated mainly with relatively small or older models, while frontier-model performance is evaluated only on the paper’s own survey-response task. Moreover, even question-specific supervised ML models trained directly on the structured data achieve only around 55–64% accuracy, making it difficult to interpret moderate frontier-model performance without a human upper bound.
- The large gains over pretrained models are difficult to interpret because the main evaluation is largely in-domain adaptation. Training and test respondents are disjoint, but the target questions and survey domains are shared, so substantial improvement after fine-tuning on these survey data is expected.
- It is unclear how much of the improvement is actually attributable to the proposed social-reasoning supervision. The appendix shows that an answer-only variant using the same expert-selected records and multiplicities already captures a large fraction of the gain, suggesting that expert-guided data selection and reweighting are themselves strong supervision signals. On the unseen GSS2022 survey, LLM-selected evidence already recovers most of the transfer benefit, with SocialReasoner providing only a small additional improvement.
[1] Yadav, Neemesh, et al. "DialToM: A Theory of Mind Benchmark for Forecasting State-Driven Dialogue Trajectories." arXiv preprint arXiv:2604.20443 (2026).
Questions for authors
-
How do the authors justify using held-out survey-response prediction as a general operationalization of “human social reasoning,” rather than a narrower task of individual behavioral or preference prediction?
-
What evidence supports the broader claim that current LLMs fundamentally lack social reasoning, given that other established dimensions such as Theory of Mind and mental-state inference have shown substantially stronger performance in modern LLMs?
-
How was the newly constructed benchmark validated as a measure of social reasoning? In particular, is there any human baseline, estimate of task predictability, or human evaluation verifying that the generated reasoning traces reflect plausible human reasoning processes?
-
Do the key observations motivating SocialReasoner still hold for frontier models? Figure 2 establishes several of these observations primarily with relatively small or older models, and without a human or oracle upper bound it is difficult to determine whether the moderate accuracy of frontier models reflects a genuine capability gap or intrinsic uncertainty in individual response prediction.
-
How much of the reported improvement reflects learning transferable social reasoning rather than ordinary in-domain adaptation? The main evaluation holds out respondents but largely retains the same target questions and survey domains, whereas the gains are substantially smaller in the unseen-survey setting.
-
How much of SocialReasoner’s gain is actually attributable to the proposed reasoning supervision rather than expert-guided data selection and reweighting? The answer-only ablation using the same selected records and multiplicities already captures a large fraction of the improvement.
11 comments
Response to Weakness 2 (2/6) and Question 2 (2/6): Limitations of Current LLMs in Social Reasoning
We thank the reviewer for this insightful comment. We would like to clarify that social reasoning in SocialReasoner refers to our methodological approach, rather than a claim to comprehensively model human social cognition. Our work focuses on enabling LLMs to reason about human social decisions using individual characteristics, perceptions, and decision-relevant knowledge.
First, our motivation is supported by independent evaluations on well-established and widely adopted survey benchmarks, including ISSP, which has also been used in prior human behavior simulation research such as SocioBench [1]. As illustrated in Figure 1, even frontier LLMs with strong general reasoning capabilities still face substantial challenges in predicting individual human responses.
Second, we would like to highlight an important distinction in the Theory of Mind (ToM) literature. Importantly, DialToM [2], cited by the reviewer, distinguishes between Literal ToM (inferring mental states) and Functional ToM (using mental-state information to predict subsequent social interactions). The study finds that LLMs perform strongly on Literal ToM but remain considerably weaker on Functional ToM, demonstrating that successful mental-state inference does not necessarily translate into accurate social behavior prediction. Similarly, ToMBench [3] and Towards Dynamic Theory of Mind [4] identify persistent limitations in mental-state reasoning and tracking. These findings align with our observation that accurately reasoning about human social decisions remains challenging for current LLMs.
Nevertheless, we appreciate that our original wording may have been overly broad. We will refine our claim to emphasize the limitations of current LLMs in reasoning about individualized human social decisions, rather than suggesting a universal deficiency across all aspects of social cognition.
[1] SocioBench: Modeling Human Behavior in Sociological Surveys with Large Language Models. EMNLP 2025.
[2] DialToM: A Theory of Mind Benchmark for Forecasting State-Driven Dialogue Trajectories. EMNLP 2026.
[3] ToMBench: Benchmarking Theory of Mind in Large Language Models. ACL 2024.
[4] Towards Dynamic Theory of Mind: Evaluating LLM Adaptation to Temporal Evolution of Human States. ACL 2025.
Response to Weakness 3 (3/6) and Question 3 (3/6): Human Validation of Behavioral Prediction and Reasoning Traces
We thank the reviewer for this important suggestion. To directly address the concerns regarding human baselines, task predictability, and reasoning trace plausibility, we conducted two complementary human evaluations. Both evaluations involved three expert annotators with extensive knowledge and backgrounds in the social sciences, who performed their assessments independently.
(1) Human Baseline and Task Predictability.
We randomly sampled 100 respondent–question instances from ATP, EVS, and ISSP. Three social science experts independently predicted each respondent's answer using the respondent's profile, survey question, and answer options, without access to the ground-truth response. We evaluated frontier LLMs and SocialReasoner on the same instances.
Table 1. Human Expert and LLM Prediction Accuracy on 100 Survey Instances
| Predictor | Accuracy (%) |
|---|---|
| Human Expert 1 | 86 |
| Human Expert 2 | 81 |
| Human Expert 3 | 78 |
| Human Expert Average | 81.67 |
| GPT-6 Astra | 64 |
| GPT-5.6 Sol | 60 |
| DeepSeek-V4-Pro | 61 |
| SocialReasoner | 70 |
The three independent human experts achieve an average accuracy of 81.67%, demonstrating that the task contains meaningful predictive information accessible to informed human judgment. Meanwhile, SocialReasoner achieves 70% accuracy, outperforming the strongest evaluated frontier LLM by 6 percentage points. These results establish a human reference for task predictability while highlighting the remaining difficulty of individual behavioral prediction.
(2) Human Validation of Reasoning Trace Plausibility.
We further randomly sampled 100 constructed reasoning traces and invited three social science experts to independently evaluate each trace, without consulting one another. Each expert provided a binary judgment assessing whether the reasoning was relevant to the survey question, consistent with the respondent's information, and plausible in explaining the behavioral choice.
Table 2. Independent Human Expert Evaluation of Reasoning Traces
| Metric | Result |
|---|---|
| Expert 1 / 2 / 3 Approval | 99% / 99% / 99% |
| Overall Positive Judgments | 99% (297/300) |
| Majority Approval (≥2/3) | 100% |
| Unanimous Approval (3/3) | 97% |
| Exact Inter-Annotator Agreement | 97% |
Notably, 97% of the reasoning traces received unanimous approval from all three independent social science experts, providing strong evidence for the relevance, consistency, and plausibility of our constructed reasoning supervision.
Together, these evaluations directly address the reviewer's concerns: the human expert baseline establishes the practical predictability of individual survey responses, while independent expert assessments validate the plausibility of the generated reasoning traces. Importantly, our evaluation concerns LLM reasoning about human social decisions, rather than claiming to reconstruct respondents' actual internal cognitive processes.
Manuscript Revisions. We have added both human evaluations, including the expert annotation protocol, evaluation criteria, and inter-annotator agreement results, to the Appendix. We appreciate the reviewer's constructive suggestion.
Response to Weakness 1 (1/6) and Question 1 (1/6): Scope and Operationalization of Human Social Reasoning
We thank the reviewer for this thoughtful comment. We appreciate the opportunity to clarify a possible misunderstanding regarding the scope of social reasoning in our work.
First, social reasoning in SocialReasoner refers to our methodological approach, rather than a claim about reproducing human cognitive processes or a comprehensive measure of social cognition. Specifically, we investigate how LLMs can reason about human behavioral choices by integrating individual characteristics, perceptions, and decision-relevant knowledge. The term social reasoning emphasizes the social dimension of reasoning, distinguishing it from conventional reasoning tasks centered on mathematics, formal logic, or coding. This terminology is also adopted in prior research investigating LLM reasoning in social contexts, including Scaling LLMs' Social Reasoning [1] and SocialMaze [2]. While these studies explore different social reasoning tasks, they similarly distinguish socially grounded reasoning from general-purpose reasoning. We have already introduced this distinction in our manuscript and will further sharpen its formulation to avoid potential ambiguity.
Second, our evaluation follows an established paradigm in human behavior simulation. Prior studies, including Socrates [3] and OmniSapiens [4], investigate LLM-based human behavior modeling through individual-level behavioral prediction. Following this research direction, we adopt survey-response prediction as an empirically grounded and scalable evaluation task. We recognize that social cognition encompasses broader capabilities, including theory of mind, mental-state inference, and interpersonal understanding. Our work focuses specifically on improving LLM reasoning about human social decisions, rather than claiming to address every dimension of social cognition.
In summary, our contribution lies in developing a knowledge-guided social reasoning approach for human behavior prediction, rather than reconstructing the cognitive processes underlying human decisions.
Manuscript Revisions. We will further clarify the methodological meaning and scope of social reasoning in the Introduction and refine the corresponding claims to avoid similar misunderstandings. We appreciate the reviewer's constructive feedback.
[1] Scaling LLMs' Social Reasoning: Sprinkle Cognitive “Aha Moment” into Fundamental Long-thought Logical Capabilities. Findings of ACL 2025.
[2] SocialMaze: A Benchmark for Evaluating and Enhancing Social Reasoning in Large Language Models in Complex Social Environments. Findings of EMNLP 2026.
[3] Finetuning LLMs for Human Behavior Prediction in Social Science Experiments. EMNLP 2025.
[4] OmniSapiens: A Foundation Model for Social Behavior Processing via Heterogeneity-Aware Relative Policy Optimization. ICML 2026.