- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work propose to study trader behaviors by modeling heterogeneity, defined as their divergent from market consensus, in a structured way. In doing so the proposed method compute the behaviour residual of a particular trader and use it for simulating its behaviors. The proposed method uses estimation from PolyMarket and evaluated using Monte Carlo replays, showing better performance in modeling behavior aggregatively than baselines.
Critical strengths
The overall question and idea is okay. While the application may be limited, this work presents a neat, self-containing workflow that is somewhat inspiring. Especially, the idea of modeling players by considering their heterogeneity from a statistical point of view is useful.
This study is okay with selected underpinning models as well as baselines. The construction of experiments is okay, although it could benefit from having more details and more models, as well as more experiments.
Overall this work gives an interesting read. It would be, still, strengthen further.
Critical weaknesses
However there are two noticeable limitation of this work: (1) the modeling focuses on observations visible in the market, and the heterogeneity of a particular player (wallet) is from what is observed from its behaviour, not intrinsic to that player. (2) the construction of proposed method is specific to PolyMarket style binary market (only yes and no) with only buy and sell actions. It does not explicitly modeling the impact of external forces, and only see the market changes in general.
The choice of (1) excludes modeling of more complex real work market. Along this line, heterogeneity are defined as more deeply as what intrinsic to the players (to name a few works, https://aclanthology.org/2024.acl-long.829/ https://arxiv.org/abs/2505.17648). It is oaky for this work to select a scope, but this also means proper discussion is needed for correctly positioning this work and its limitation.
The modeling choice of (2) also limits the proposed work in explaining more complex market structure. For example it does not explicitly model external forces and the change of consensus over time, nor it models collective behaviors in subset of players (e.g. collusion, https://arxiv.org/abs/2404.00806 ).
Presentation Issue: Fonts size in Figure 2 is too small for reading.
Questions for authors
None
2 comments
Thanks for your response to my reviews. I think the response slightly strengthens points where I raise questions. Yet my concerns on the limitation and scope remains. So I'd like to keep my current Weak acceptance rating.
Response to Reviewer GWop
We sincerely thank the reviewer for the positive assessment and constructive suggestions. In response, we have conducted additional experiments, clarified the methodological scope, and revised the manuscript and appendix accordingly. Below, we provide point-by-point responses and summarize the corresponding revisions.
Regarding observed behavior versus intrinsic trader attributes, CRBM models heterogeneity observed in transaction histories rather than traders' intrinsic preferences, beliefs, utility functions, or personalities. The residual represents a wallet's persistent observed deviation from past market consensus and should therefore be interpreted as an empirical behavioral representation rather than a causal explanation of trader motivation.
We had previously explored a richer four-dimensional representation by adding two past-only behavioral statistics capturing preference for trading at more certain prices and breadth and intensity of market participation. The extension slightly improves test Outcome Macro-F1 from 0.6114 to 0.6174 but does not consistently improve Action F1, Strict Accuracy, or validation performance. We therefore adopted the compact two-dimensional representation in CRBM.
Importantly, the specific choice and number of residual dimensions are not the primary focus of this work. CRBM is not restricted to two dimensions and can incorporate richer behavioral representations in future research. We have revised the terminology to emphasize observed behavioral heterogeneity and distinguish our empirical representation from intrinsic participant attributes. These clarifications appear in the Introduction and Section 5, while the exploratory four-dimensional results are reported in Appendix C.3 and Table 10.
Regarding the scope beyond binary prediction markets, the current empirical evidence is restricted to binary Yes/No Polymarket markets. This setting provides a structured environment for studying consensus and individual deviation, but the reported results should not be generalized directly to equities, futures, or continuous limit-order-book markets.
CRBM is evaluated here as a behavioral decision layer rather than a complete order-book simulation system. Extensions to richer market states and output spaces require appropriate data and remain future work. Section 5 states the current empirical scope and its limitations.
Regarding changing consensus, external forces, and coordinated behavior, CRBM dynamically recomputes ci for every target transaction using only earlier transactions from other wallets in the same market. The pre-trade state xi is constructed exclusively from information available before ti (Section 3 and Appendix A.1).
External forces such as news, political events, and liquidity shocks are represented only indirectly through observed market states and historical order flow. CRBM neither provides a causal model of these forces nor models coordinated behavior among subsets of wallets, such as collusion or coalition formation. The descriptive groups in Appendix C.6 summarize population structure rather than detected coalitions. Section 5 now states these limitations and identifies structured event signals, closed-loop market simulations, and coordinated multi-wallet behavior as future extensions.
Regarding experimental coverage and presentation, we added JANUS and CoPL to the common market-replay protocol, three-seed training results, a six-setting replay sensitivity analysis, and an enlarged Figure 2. CRBM outperforms JANUS on all six replay metrics and CoPL on five of six; its RMSE remains within the top two methods across all six sensitivity settings. These additions strengthen the evidence without extending the claim beyond the controlled historical-replay setting.
The expanded replay comparison appears in Table 3, the robustness analyses in Appendices B.3 and C.2, and the enlarged visualization appears in Figure 2.