- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes macro2mind, a framework that learns transferable behavioral reasoning from aggregate prediction-market signals rather than individual-level behavioral annotations. The method combines social behavioral decomposition, which explicitly models the belief updates and interactions of representative market participants, with a hindsight-regret curriculum that prioritizes informative market transitions during GRPO training.
Critical strengths
-
The paper explores an interesting and relatively novel direction: learning individual behavioral simulation capabilities from aggregate social signals. This potentially reduces reliance on expensive individual-level behavioral annotations.
-
The evaluation covers multiple downstream benchmarks and includes a synthetic data generation experiment, providing relatively broad empirical evidence.
-
The ablation studies suggest that the hindsight-regret curriculum plays an important role in transferring forecasting capabilities to user simulation.
Critical weaknesses
-
The central claim that macro-level market supervision teaches transferable individual behavioral reasoning is not sufficiently supported. The training reward only evaluates the final market forecast, without verifying whether the inferred constituent groups, belief updates, or social interactions correspond to actual human behavior. Moreover, the SFT warm-start uses teacher-generated reasoning traces conditioned on the realized market outcomes, potentially introducing post-hoc rationalizations. Consequently, the observed improvements could reflect better event understanding or structured reasoning rather than genuine behavioral reasoning. More direct evidence is needed to establish the claimed mechanism.
-
The contribution of the hindsight-regret curriculum is not sufficiently isolated from generic difficulty-based sampling. Since the proposed sampling weights combine hindsight regret with a difficulty filter, it remains unclear whether the improvements arise from identifying behaviorally informative transitions or simply selecting examples that provide more effective GRPO training signals. A controlled comparison against difficulty-only sampling is necessary. Furthermore, the transfer improvements are not consistent across benchmarks: the gains on PRISM are relatively small, and the main component ablations are conducted primarily on Humanual. This limits the evidence for a generalizable behavioral reasoning capability.
Questions for authors
-
How can the authors distinguish genuine behavioral reasoning from general event understanding or structured reasoning? Is there any independent evidence that the inferred constituent behaviors and belief updates reflect actual human behavior?
-
Can the authors compare hindsight-regret sampling against difficulty-only sampling under the same training budget and report the results across all four downstream benchmarks?
4 comments
[Ablation on SFT Initialization and Post-hoc Rationalization] We use SFT on SWM-Bench to initialize the behavioral reasoning structure, without any downstream individual-level training data. Subsequent GRPO training generates reasoning without access to realized market outcomes in its rollout prompts.
We further compare different SFT initializations across four downstream benchmarks. Our full pipeline achieves the best performance across all seven metrics. Importantly, outcome-blind SFT with the same GRPO curriculum also achieves strong transfer performance, suggesting that the gains do not solely depend on outcome-conditioned teacher traces. We believe access to realized outcomes helps the teacher generate more informative, outcome-consistent behavioral reasoning traces, providing a stronger initialization for subsequent RL.
| SFT Initialization | GRPO | Curriculum | Humanual State ↑ | Humanual Resp. ↑ | CAD Acc ↑ | Overton MAE ↓ | Overton Spearman ↑ | PRISM MAE ↓ | PRISM Pairwise Acc ↑ |
|---|---|---|---|---|---|---|---|---|---|
| Outcome-conditioned BR-SFT | No | No | 7.5 | 1.4 | 0.3335 | 0.6958 | 0.5984 | 22.592 | 0.6248 |
| Outcome-conditioned BR-SFT | Yes | Full | 9.5 | 3.4 | 0.4220 | 0.6350 | 0.6530 | 21.200 | 0.6330 |
| Outcome-blind BR-SFT | Yes | Full | 8.1 | 2.8 | 0.4110 | 0.6596 | 0.6346 | 21.611 | 0.6262 |
| Without SFT | Yes | Full | 7.0 | 1.6 | 0.3915 | 0.6458 | 0.6347 | 21.916 | 0.6185 |
Thank you for the review. We truly appreciate the time and expertise you dedicated to it. As the discussion period draws to a close, we would appreciate it if you could take a moment to review our responses. If you have any further feedback or additional questions on any point, we would be happy to discuss it.
If our responses have addressed your concerns and questions, we kindly request a reconsideration of the merit of our work and an adjustment to the overall assessment score. Thanks again for your time!
Thank you for the new ablations. They address my sampling concern and ease my concern about post-hoc rationalization. I encourage the authors to temper their claims about behavioral reasoning pending direct validation against actual market participant behavior. I keep my original rating.
We sincerely thank the reviewer for careful reading and constructive feedback. Below, we address each concern and question in detail. We will incorporate the relevant clarifications and additional analyses and experimental results into the revised manuscript. We would be happy to provide further clarification during the discussion period.
[Distinguishing Behavioral Reasoning from General Event Understanding] (1) Our evidence comes from zero-shot transfer to four downstream benchmarks that directly evaluate the ability to predict individual human behavior rather than event forecasting. Specifically, these benchmarks (Humanual, OvertonBench, PRISM, and CAD) require modeling individual perspectives, reactions, and preferences. The consistent zero-shot transfer improvements across these distinct tasks suggest that the learned capabilities extend beyond general event understanding. (2) Also, our ablation shows that simply imposing a structured reasoning format is insufficient to explain the transfer gains, with the strongest improvements emerging when behavioral reasoning is combined with curriculum-based training.
[Independent Evidence of Actual Human behavior: Human Evaluation] We also conduct human evaluations (Section 6, Figure 5), where five annotators assess the plausibility of inferred constituent behaviors, event interpretations, and belief updates. macro2mind achieves 72.2, outperforming Qwen3-4B (47.1) and Qwen3.5-397B (51.4) under the same reasoning structure. This provides independent human-judged evidence that our model learns more plausible behavioral reasoning rather than merely following a structured format.
[Independent Evidence of Actual Human Behavior: Synthetic Data] On Twin-2K-500, training with macro2mind-generated data achieves 60.0% accuracy on unseen users, compared to 46.8% with Qwen3-4B-generated data. This provides further evidence that the learned capabilities can generate useful supervision for predicting real human decisions in behavioral economics and consumer preferences, as evaluated against held-out responses from actual participants.
[Comparison of Hindsight-Regret and Difficulty-Based Sampling] We compare hindsight-regret and difficulty-only sampling with the same GRPO optimization settings and further evaluate different sampling weights across all four downstream benchmarks. Both sampling strategies improve performance on different metrics, while combining them achieves the best results across all four benchmarks, with our default weighting (0.4 regret / 0.6 difficulty) performing best on all seven evaluation metrics.
[More analysis on the different roles of hindsight-regret sampling against difficulty sampling] These terms serve complementary purposes: the regret term evaluates whether a transition is informative, while the difficulty term determines whether it is currently learnable.
Specifically, the regret term prioritizes transitions whose outcomes hinge on critical constituents that the policy currently overlooks. The difficulty term accounts for the optimization dynamics of GRPO. Because GRPO learns from the relative differences among M responses to the same transition, the advantage signals are strongest when a group contains a mix of successes and failures. This variance peaks at intermediate success rates and vanishes when the policy consistently succeeds or fails, regardless of the regret magnitude.