- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper suggests a novel method for symbolic alpha factor discovery that uses on-policy distillation. Since there is no teacher model, the method replaces token logits with structural counterfactuals. The advantages of the approach are that learned samples are on-policy, meaning that the trajectories are reachable. Also, the credit assignment is local, in addition to assigning a single reward for the whole sequence. It tries multiple alternative steps and completes each one in the same way, so the score differences are attributed to the local step. Experiments on Chinese and U.S. stock markets show strong performance compared to baselines on some markets.
Critical strengths
- The method is well motivated. Since a formula gets scored only once it's complete, it's hard to attribute which term really helped. By swapping one step and comparing the scores, it is possible to train the GFlowNet using on-policy samples with different reward signals for different steps, rather than only a single reward for all the terms.
- Requires no external teacher, samples are generated from current policy.
- Experiments on Chinese and U.S. stock markets show strong performance compared to baselines on some markets.
Critical weaknesses
- The paper is hard to read, with heavy jargon and broken references (lines 367 and 455). Table 1 text size is very small, and the figures don't look professional.
- The reproducibility statement mentions the appendix, but it is missing from the pdf.
Questions for authors
Could you please include the appendix of the paper?