- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes UCAPS, a framework that uses LLMs to generate executable asset-selection programs. The framework evaluates asset-universe and reward pairs through downstream PPO training and uses the results to fine-tune the code generators. Experiments on an asset pool report improvements over classical portfolio strategies, RL baselines, and LLM-based trading agents. The authors also provide ablation studies and analyses of different model backbones, asset pools, and re-selection frequencies.
Critical strengths
The paper is well-written. The paper treats executable asset-selection programs as an optimization target rather than directly selecting assets with LLMs. Using downstream RL performance to improve the program generator is an interesting approach to portfolio optimization.
The paper evaluates multiple Selector backbones and compares against a broad range of baselines. The matched selection experiments and component ablations provide useful evidence for the effectiveness of the proposed framework.
Critical weaknesses
The paper lacks a direct comparison with a simple best-of-N approach that samples multiple asset universes, trains PPO for each, and selects the best based on calibration performance. The random-universe baseline reports average performance over 50 draws rather than selecting the best candidate. A comparison under matched computational budgets is important to establish whether the proposed Selector fine-tuning and co-evolution framework provide benefits beyond straightforward search.
The main experiments rely on a single 30-asset pool and one test period. It remains unclear whether the reported improvements generalize to different market periods and asset universes.
Questions for authors
Can the authors compare UCAPS against a best-of-N universe search baseline using the same PPO evaluation budget and calibration protocol? This would help determine whether Selector fine-tuning provides benefits beyond searching over more candidate universes.
Can the authors provide additional out-of-sample evaluations across different market periods or asset pools using the full UCAPS pipeline? This would help assess the generalizability of the reported improvements.
The reference to Forging Better Rewards is listed as Anonymous (2025). Since the authors' names have now been disclosed, could the authors update the citation?
The R&D-Agent-Quant reference lists seven authors, whereas the official NeurIPS proceedings version lists six. Could the authors correct the citation?