- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes TradeGrad, which treats trading strategy design as black-box program optimization and iteratively revises strategies through experience-guided textual gradients. It combines global optimization memory, archived-strategy sampling, and multi-scale program revisions. It also introduces CPRO, a cross-period objective that emphasizes poorly performing historical periods. Experiments cover cross-sectional and time-series strategy design on CSI 300 and S&P 500, with out-of-sample backtests, component ablations, and optimization-trajectory analyses.
Critical strengths
S1. TradeGrad combines optimization memory, comparisons across strategies, and multi-scale revisions so that textual gradients can draw on previous search experience. The ablations in Table 2 support these components under the same objective and search budget.
S2. The evaluation covers two markets and two strategy settings, with transaction costs included in backtesting. The out-of-sample results and component ablations provide preliminary support for the method’s practical value.
Critical weaknesses
W1. The main comparisons use different optimization objectives. TradeGrad searches and selects strategies using CPRO, while most baselines use in-sample Sharpe ratio. Although Table 3 evaluates CPRO within TradeGrad, it does not establish how much of the advantage over other methods comes from the optimizer rather than the objective.
W2. The out-of-sample evidence for temporal robustness is indirect. CPRO emphasizes poorly performing historical periods, but the out-of-sample evaluation mainly reports metrics aggregated over the entire period. It remains unclear whether the method improves performance during unfavorable or worst-performing periods.
W3. Some advantages are small relative to run-to-run variability. For example, the CSI 300 cross-sectional OOS Score is 65.65, compared with 60.69 for the Volatility baseline, while TradeGrad’s standard deviation is 12.15. Three runs with means and standard deviations provide limited evidence that these smaller advantages are reliable.
Questions for authors
Q1. Could the authors compare TradeGrad with the main automated-search baselines under the same optimization and strategy-selection objective, such as CPRO, while keeping the search budget fixed? This would help separate the benefit of the textual-gradient optimizer from that of changing the objective.
Q2. How does TradeGrad perform across individual out-of-sample periods, particularly unfavorable ones? Could the authors report results by year or other predefined time segments, including worst-period or lower-tail performance, and compare them with objectives that do not use lower-tail aggregation?
Q3. Could the authors increase the number of independent runs and report performance differences with confidence intervals against the main competing baselines, particularly Volatility in the CSI 300 cross-sectional setting? If the analysis uses daily returns, please account for temporal dependence.