- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
AlphaRef generates symbolic alpha factors by completing prefixes sampled from Alpha101 and Alpha158. A Transformer conditions on these prefixes, market data, and the current factor zoo, and is trained with a modified GRPO objective. Reference use decays during training. The mined factors are combined through dynamic OLS, with predictive and portfolio evaluation on three Chinese stock universes and an additional U.S. backtest.
Critical strengths
-
Reusing established formulas is a sensible starting point for this problem. They contain structures that a generator trained from scratch would otherwise have to rediscover. Completing partial formulas gives a straightforward way to retain some of that knowledge while allowing changes, and the drop in performance when references are removed supports the usefulness of this idea.
-
The reported improvements are reasonably consistent across the three Chinese stock universes and extend to portfolio returns. I also appreciate the comparison with the original factor libraries using the same combination procedure: it provides some evidence that refining these formulas is worthwhile in practice.
Critical weaknesses
-
[Major] It remains unclear why prefix completion is the right way to use the reference library. Removing references shows that prior knowledge helps, but a simpler approach, such as initializing an evolutionary search with the same formulas, might obtain similar benefits. The paper also discusses TLRS, which learns from expert formulas through reward shaping, without comparing against it. These are particularly relevant controls because using existing formulas is the main contribution here. The subtree-masking experiment is useful, but the need to gradually remove references is still untested. I would like to see whether the proposed approach retains an advantage when another method receives the same references and search budget, and whether the decay schedule actually helps over keeping references throughout training.
-
[Major] I cannot reconcile the stated KL penalty with the training procedure. In Eq. 10, the log-probability difference is averaged over formulas sampled from the old policy. With those samples fixed, the reference log-probability contributes no gradient, and minimizing the remaining term can simply lower the probability of the sampled formulas. This does not provide the claimed constraint on departure from the reference policy. The issue matters because the paper uses this regularizer to explain training stability and resistance to collapse. Is the implementation using a different estimator? If the equation is accurate, the authors need to correct the penalty and check whether the reported gains still hold.
-
The main figure is very poor.
Questions for authors
See weaknesses