- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper aims for enhancing the social intelligence of LLMs. Their method is based on self-conditioned on-policy distillation, which is an existing technique. The key component in the paper is two parts: (1) constructing a skill bank for guiding social reasoning; (2) combining out-come based reward with on-policy distillation reward into one joint objective. Experiments are conduct on just two Qwen models and several Theory-of-mind benchnmarks and EmoBench.
Critical strengths
-
This paper discusses on-policy self-distillation for social intelligence. It is an interesting application of an existing technique to AI's social reasoning.
-
The paper is well written and easy to follow
Critical weaknesses
-
The experimental evidence is limited and does not sufficiently establish the method’s general effectiveness. Although ToMi, SimpleToM, and Hi-ToM are claimed in the paper as out-of-domain benchmarks, they all focus on Theory-of-Mind abilities closely related to those covered by the training data. I am therefore not convinced that improvements on these benchmarks demonstrate broader generalization in social intelligence. There is also no consistent advantage of S³D+GRPO over S³D, leaving the benefit of joint optimization unclear. I would like to see evaluations on a broader range of social intelligence-related tasks, such as social commonsense reasoning on SocialIQA and dedicated benchmarks for moral judgment and value understanding, with a clearer explanation of how they differ from the training distribution. EmoBench in Table 1 provides a somewhat broader evaluation, but the results there do not show positive signals.
-
The technical novelty appears limited. The paper itself cites Skill-SD and Skill-Conditioned Gated Self-Distillation, both of which already use skills as teacher-side privileged information for self-distillation. The main contribution here seems to be adapting this approach to social reasoning and designing the skill organization and retrieval pipeline. Without direct comparisons with these closely related methods, it is difficult to assess the additional technical value of the proposed approach.
Questions for authors
-
Only two qwen models are evaluated. Can the method work on other model families? Can larger size LLMs benefit as well from this method? How is the performance of model in this paper compared with advanced models like GPT-5.6 sol in social intelligence benchmarks?
-
There are many papers so far discussing enhancing social intelligence or theory of mind for LLMs now. I wonder why the authors did not compare with them.
-
The paper does not sufficiently clarify the relationship between social intelligence, social reasoning, and Theory of Mind. Social intelligence is a broader construct, with social reasoning representing one of its component abilities, while ToM focuses more narrowly on understanding and inferring mental states. The authors should clarify these conceptual boundaries and explain how improvements on predominantly ToM-based tasks support their broader claims about social intelligence.