- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a semantic expert-following strategy for prediction markets. Wallet expertise is modeled as topic-dependent: past settled trades are weighted by the semantic similarity between historical and current market questions. The strategy combines this local skill estimate with market activation rules, multi-wallet consensus, and risk-aware capital allocation. On a historical Polymarket archive, the primary configuration reports a 257.25% return with 13.64% maximum drawdown.
Critical strengths
- Interesting formulation of local rather than global trader expertise. Using semantic similarity to condition wallet skill on the current question is intuitive and better motivated than assuming that successful traders are uniformly skilled across unrelated market domains.
- Careful portfolio-level analysis. The paper considers drawdown, capital allocation, wallet concentration, execution delay, fees, and several sensitivity analyses rather than reporting only raw prediction accuracy or trade-level returns.
Critical weaknesses
- The evaluation is not out-of-sample. The authors explicitly state that parameters and configurations were selected after inspecting the same historical archive used for evaluation. Given the strong sensitivity to thresholds—for example, changing the semantic threshold from 0.50 to 0.45 or 0.55 reduces returns substantially—it is difficult to assess how much of the reported performance would generalize to unseen markets.
- The execution model does not establish realizable trading performance. The replay ignores order-book depth and allows a single observed print to fill the requested quantity. In the primary configuration, 94 of 104 simulated purchases exceed the quantity of the print used for pricing, with a median purchase-to-print ratio of 40.23. This makes the headline return difficult to interpret as practically executable performance.
Questions for authors
- How would the strategy perform under a genuinely out-of-sample temporal split with all hyperparameters fixed beforehand?
- Can the authors estimate how sensitive the reported returns are to realistic order-book depth and fill constraints?
- How much of the gain specifically comes from semantic expert selection compared with a global wallet-skill baseline?