acceptodds
Under review as a conference paper at ICLR 2027

Think Socially via Cognitive Reasoning

Abstract

LLMs trained for logical reasoning excel at step-by-step deduction to reach verifiable answers. Yet, this paradigm is ill-suited for navigating social situations, which require an interpretive process for ambiguous cues that rarely yield a definitive outcome. To bridge this gap, we introduce Cognitive Reasoning, a paradigm modeled on human social cognition. It structures the interpretive process as an adaptive cognitive flow of interconnected cognitive units (e.g., observation or attribution) for effective social thinking and responses. We then propose CogFlow, a framework that instills this capability in LLMs. CogFlow first curates a dataset of cognitive flows through tree-structured simulation of the associative and progressive nature of human thought. After instilling the basic cognitive reasoning capability via supervised fine-tuning, CogFlow adopts reinforcement learning to enable the model to improve itself via trial and error, guided by a multi-objective reward that optimizes both cognitive flow and response quality. Extensive experiments show that CogFlow improves the social cognitive capabilities of LLMs and supports humans for more effective social decision-making, while generalizing promisingly to diverse reasoning tasks.

Primary area:
applications to neuroscience & cognitive science
Keywords:
cognitive reasoning, large language models, social intelligence, social cognition

Reviews

Among:
Shape:
1234this paper, Bottom 9%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.50 over 4 reviews, above 9% of the others.
Reviewer_YJWtOpenReview ↗
Rating
1
Confidence
4
Informativeness
1
Presentation
2
Soundness
1
Read review
Paper summary

This paper introduces CogFlow, which dynamically combines six cognitive units, including observation, attribution, and motivation, into social reasoning flows. It constructs training data through tree-structured generation and preference-based filtering with deepseek R1, then trains models using SFT and RL. Its main contribution is translating social cognitive theory into a structured reasoning framework, with experiments showing improvements in in-domain test sets.

Critical strengths
  • The direction of studying LLMs for social interactions is interesting.

  • The framework is complete, covering dataset construction, SFT, and RL. However, each stage appears to apply existing methods, making this a solid engineering effort with limited novelty.

Critical weaknesses
  • The title, “Think Socially via Cognitive Reasoning,” seems to overstate what the paper demonstrates. I am not convinced that the method improves social intelligence as a general capability of LLMs. The results mainly show improvements through in-domain training, and outperforming untuned models on an in-domain test set after fine-tuning, as shown in Table 2, is not particularly surprising. What I would find more interesting is whether the method also benefits more advanced LLMs across a broader range of social intelligence benchmarks, such as EmoBench, ETHICS, SocialIQA, and ToMBench, and whether the resulting models can outperform larger LLMs on these benchmarks. For example, Table 3 shows that on SocialIQA, the accuracy of 70.4% is even slightly below the original model’s 70.7%.

  • I find the motivating example in Figure 1 unconvincing. The scenario and question seem unusual, and I do not think the question has a clear or broadly agreed-upon answer. I am also not convinced that the “Cognitive Reasoning” shown in the example leads to a better-supported conclusion. The case seems too ambiguous to clearly illustrate the claimed advantage. So I doubt that the research task of this paper is ill-defined.

Questions for authors

Since this year, it seems to post at most two critical weaknesses of the paper. So I will post other weaknesses I observed in this paper to this section:

  • I find the technical novelty limited. The proposed method appears to combine several established components, including SFT, GRPO, and rejection sampling over rollout trajectories. The paper could explain more clearly what is technically new beyond combining these components.

  • The models used for data generation and training are relatively old, such as DeepSeek-R1 and Qwen2.5. I would encourage the authors to experiment with more recent teacher and backbone models to show whether the proposed method remains useful as model capabilities improve.

  • The expert annotation and pairwise evaluation rely on only six experts. Given the subjective and culturally dependent nature of social judgments, I am concerned about how representative their preferences are. A larger and more diverse pool of annotators would make the human evaluation more convincing.

  • The introduction needs improvement. I do not find the current motivation sufficiently convincing. It does not clearly explain what distinguishes social reasoning from general reasoning, whether social reasoning is a well-defined problem, or why the chosen social cognitive theory provides an appropriate foundation for the proposed framework. These points need to be clarified to better motivate the method.

Reviewer_a6RvOpenReview ↗
Rating
1
Confidence
2
Informativeness
3
Presentation
3
Soundness
2
Read review
Paper summary

This paper proposes Cognitive Reasoning, a structured reasoning paradigm designed to improve the social reasoning capabilities of large language models (LLMs). Motivated by the limitations of conventional chain-of-thought reasoning in ambiguous social situations, the authors introduce six cognitive units—Observation, Attribution, Motivation, Regulation, Efficacy, and Behavior—to organize reasoning into adaptive cognitive flows. To instantiate this paradigm, the paper presents CogFlow, a framework that combines tree-structured cognitive flow simulation, preference-based data filtering, supervised fine-tuning (SFT), and reinforcement learning (RL). The RL objective jointly considers response quality, cognitive diversity, and reasoning length.

Critical strengths
  1. Interesting motivation and problem formulation. The paper addresses an important limitation of current reasoning models: social reasoning often involves ambiguous observations, uncertain intentions, and multiple plausible interpretations rather than a single verifiable answer. The distinction between conventional logical reasoning and social cognitive reasoning is well motivated.

  2. A coherent training framework for structured reasoning. The proposed framework integrates cognitive flow simulation, preference-based filtering, SFT, and multi-objective RL. In particular, jointly encouraging cognitive diversity and controlling reasoning length is an interesting approach to reducing repetitive or inefficient reasoning.

  3. Relatively comprehensive within-framework experiments. The authors evaluate CogFlow on two different backbone models, compare it with direct-response training and conventional reasoning distillation, and conduct ablation studies on reward components and cognitive units. Human evaluations provide additional evidence beyond automated LLM judges.

Critical weaknesses
  1. Insufficient justification of the cognitive unit taxonomy and its coverage. The proposed framework relies on six predefined cognitive units, but it remains unclear whether this taxonomy is sufficiently comprehensive to capture the complexity of human social cognition. Although CogFlow allows flexible transitions and does not require every cognitive unit to appear in each reasoning trajectory, the paper does not investigate whether the model can reliably select all necessary units for a given social situation. For example, when Motivation or Efficacy is omitted, it is difficult to determine whether this reflects efficient reasoning or an incomplete understanding of the situation.

  2. Limited ability to explicitly represent conflicting motivations and contradictory psychological states. Human social behavior is often driven by competing motivations, conflicting beliefs, and seemingly inconsistent intentions. For example, an individual may simultaneously desire social acceptance and fear rejection, resulting in hesitation or avoidance. While CogFlow could potentially describe such conflicts through its cognitive units, the framework does not explicitly model competing psychological hypotheses or conflicting motivations. Moreover, the coherence-based filtering procedure emphasizes logical consistency without sufficiently discussing the distinction between contradictions caused by flawed reasoning and genuine psychological conflicts within the social situation. Although tree-structured exploration generates multiple reasoning paths during data construction, the final training instances are linear cognitive flows, raising concerns about whether the model can preserve multiple plausible interpretations rather than prematurely committing to a single explanation.

  3. Limited diversity and external validity of the constructed dataset. The proposed dataset contains 5,100 social situations derived from Reddit, covering five broad categories and sixteen subcategories. However, the data source remains relatively narrow and may disproportionately reflect the social norms, demographics, and communication patterns of English-speaking online communities. Furthermore, DeepSeek-R1 is heavily involved in scenario construction, question generation, cognitive flow simulation, and data filtering, potentially introducing teacher-specific biases throughout the pipeline. Since the main evaluation also relies on held-out instances generated through the same construction procedure, it remains unclear whether the observed improvements generalize to more diverse real-world social situations. Although the authors report transfer results on SocialIQA and Hi-ToM, evaluations on more challenging and independently constructed social reasoning benchmarks, such as ToMBench, SocialMaze, and SocialEval, are still missing.

  4. Insufficient comparison with specialized social reasoning methods. Although the paper includes extensive comparisons with general-purpose LLMs and conventional reasoning baselines, comparisons against methods specifically designed for social reasoning and social intelligence remain limited. Relevant approaches include Social-R1, SOTOPIA-π, and Cognitive Chain-of-Thought, which investigate related problems through specialized training or structured social reasoning. The authors acknowledge the unavailability of Social-R1's code and data at submission time, which is a reasonable practical limitation. Nevertheless, the lack of broader comparisons with reproducible, task-compatible social reasoning methods makes it difficult to determine whether the improvements arise from the proposed cognitive reasoning paradigm or more general benefits of specialized social reasoning training.

  5. The cognitive diversity reward does not necessarily reflect meaningful cognitive flexibility. The cognitive diversity reward encourages the use of relatively infrequent cognitive units across sampled trajectories. However, structural diversity does not necessarily imply contextually appropriate or psychologically meaningful reasoning. A model could receive higher diversity rewards by selecting less frequent cognitive units without improving its understanding of the underlying social situation.

  6. Evaluation is limited to relatively outdated backbone models. The main training experiments are conducted on Llama-3.1-8B-Instruct and Qwen-2.5-7B-Instruct, both of which are relatively old backbone models.

[1] Zhuang Chen et al. "ToMBench: Benchmarking Theory of Mind in Large Language Models." Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL), 2024.

[2] Zixiang Xu et al. "SocialMaze: A Benchmark for Evaluating Social Reasoning in Large Language Models." arXiv preprint arXiv:2505.23713, 2025.

[3] Jinfeng Zhou et al. "SocialEval: Evaluating Social Intelligence of Large Language Models." Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (ACL), 2025.

[4] Jincenzi Wu et al. "Social-R1: Towards Human-like Social Reasoning in LLMs." arXiv preprint arXiv:2603.09249, 2026.

[5] Ruiyi Wang et al. "SOTOPIA-π: Interactive Learning of Socially Intelligent Language Agents." Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL), 2024.

[6] Eunkyu Park et al. "Cognitive Chain-of-Thought: Structured Multimodal Reasoning about Social Situations." arXiv preprint arXiv:2507.20409, 2025.

Questions for authors

Q1. How does CogFlow determine whether a cognitive unit can be safely omitted? Have the authors examined cases where the generated flow is coherent but overlooks important motivations, beliefs, or contextual factors?

Q2. How does the framework represent social situations involving simultaneously conflicting motivations or multiple plausible interpretations? Could the coherence-based filtering procedure unintentionally exclude such examples?

Q3. Why were additional specialized social reasoning benchmarks, such as ToMBench, SocialMaze, or SocialEval, not included in the main evaluation?

Q4. Does the cognitive diversity reward improve the appropriateness of selected cognitive operations, or does it primarily encourage more diverse structural patterns?

Reviewer_JUqZOpenReview ↗
Rating
1
Confidence
2
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

This paper proposes CogFlow, a framework for improving LLM social reasoning through structured cognitive flows. It uses six cognitive units to construct training data and combines SFT with GRPO, optimizing response quality, cognitive diversity, and reasoning length. Experiments on two backbone models demonstrate promising results.

Critical strengths
  1. The paper addresses an interesting problem and presents a well-structured framework combining cognitive reasoning and reinforcement learning.

  2. The experiments include multiple baselines, ablation studies, and human evaluations, providing evidence for the effectiveness of the overall framework.

Critical weaknesses
  1. The specific contribution of the cognitive-unit structure remains unclear.

Table 2 provides SFT, GRPO, and reward ablations. However, the Distilled-R1 baseline uses R1-generated reasoning chains and responses, while CogFlow uses preference-filtered cognitive-flow data (Appendix F.2). The Direct baselines remove explicit reasoning altogether.

Thus, the current comparisons do not fully establish whether the cognitive-unit structure is more effective than conventional CoT under matched answer supervision. A response-matched free-form CoT baseline with comparable training budgets would help isolate this contribution.

  1. The contextual relevance of the cognitive diversity reward is not sufficiently validated.

The diversity reward (RDivR_{\mathrm{Div}}) encourages less frequent cognitive units, but rarity does not necessarily imply relevance to the social situation.

Although the ablation results demonstrate its benefit to overall performance and Figure 5 shows differences in transition patterns, it remains unclear whether (RDivR_{\mathrm{Div}}) promotes meaningful cognitive flexibility rather than simply diverse unit usage. An analysis relating unit diversity to contextual relevance and response quality would strengthen this claim.

Questions for authors
  1. Can the authors evaluate a free-form CoT baseline using the same final responses as CogFlow, under comparable SFT/RL budgets and matched applicable reward components?

  2. Could the authors provide a quantitative analysis relating cognitive-unit diversity to contextual relevance and response quality (or human judgments), along with representative examples?

  3. As a minor point, what do the error bars in Figure 3 represent, and is the difference between CogFlow and DeepSeek-R1 statistically significant?

Reviewer_Ts6yOpenReview ↗
Rating
3
Confidence
4
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

Reasoning models trained on math and code deliberate largely by long step-by-step deduction toward a checkable answer, but social situations do not work that way: cues are ambiguous, there is no single right answer, and over-analyzing a glance or a pause produces long, circular, worse judgments, which the authors call "rumination". Their aspiration is to give language models a different shape of thinking for social situations, borrowed from social cognitive theory. 1) Notice what happened, 2) attribute causes, 3) consider motives, 4) regulate one’s own reaction, 5) judge one’s capacity to act, and 6) form an intention. The hope is that a model which moves flexibly among these moves will reason about people more like people do, reach better judgments in fewer tokens, and perhaps even help humans think better about social situations. The author(s) built a full training pipeline. A strong model simulates branching “cognitive flows” over Reddit-derived scenarios. The better flows are filtered by comparative ranking. Small open models then learn the format by supervised fine-tuning and improve by reinforcement learning with rewards for response quality, varied use of the cognitive units, and bounded length. The trained models score higher than their own teacher on the authors’ evaluation, use fewer tokens, and, in a small study, the cognitive-flow explanations helped human participants choose better responses. They also report that the format transfers (with gains) to math and theory-of-mind benchmarks. The ambition is large, and the engineering is reasonably thorough. The evidence that the specific psychological structure, rather than brevity and tagging, does the work remains an open question.

Critical strengths

The paper had a complete pipeline with many ablations, human checks at several stages, and a limitations section that names the R1 circularity rather than hiding it (but it remained a circularity...see the weaknesses below).

Critical weaknesses
  1. Circularity remains the central problem. R1 writes the situations, the flows, the filter, the reference pool, and the main judge, and is also the baseline?! Even the Qwen and Claude judges score rank within a pool produced by the same pipeline, so the metric is proximite to the authors’ own generations.

  2. Human pairwise results (Table 6) show CogFlow at 51.9/1.0/47.0 against R1 and 49.1/1.2/49.7 against Simulated-CogFlow, with no significance test. “Surpasses its teacher” rests on what feels like a coin flip. Judge-human agreement is kappa 0.45–0.50.

  3. Direct-GRPO, which emits no reasoning at all, reaches 0.615 vs CogFlow’s 0.665 on the R1 judge and 0.763 vs 0.796 on the Qwen judge (Qwen backbone). The reasoning contributes little on two of three judges. The separation appears only under the Claude judge, which feels like it needs explanation.

  4. No control with arbitrary tags under the same length reward. The paper cannot distinguish “social cognitive theory matters” from “short tagged structure plus a length window matters.” Unit ablations retrain on different data, which confounds the assessment.

  5. The intervention study had only 20 volunteers, 10 per arm. Generalization: MATH-500 53.4 vs 52.0 for plain RLVR is seven items; SocialIQA direct transfer is 70.4 vs a 70.7 base.

  6. There is no established social benchmark in the main results. Everything is the authors’ test set.

Questions for authors

What are the results with a non-R1 reference pool and judges?

Is there a random-tag control?

What is the significance on Table 6?

Why does the Claude judge separate methods the other judges (apparently) do not?

Is there Reddit licensing and consent for the derived dataset?

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.