- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2(+1)
- Soundness
- 2
Read review
Paper summary
This paper proposes RASP, a framework for adapting hierarchical portfolio agents to changing market conditions without retraining their models. The framework uses three portfolio strategies: a basic return prediction model, an expert-based consensus model, and a model that incorporates additional market features. Rather than selecting a single fixed strategy, RASP dynamically adjusts the weights of these strategies based on recent investment performance using the Hedge and fixed-share algorithms. It also includes a validation-based gate that selects a fixed strategy when the adaptive mixture does not achieve better performance. The authors report that RASP generally achieves higher risk-adjusted returns and lower trading costs than several existing portfolio methods.
Critical strengths
One strength of this study is that it addresses a practical and meaningful problem in portfolio management. I find the motivation generally reasonable, as the best investment strategy may change depending on market conditions, and selecting an appropriate strategy is important for real-world applications. The idea of adapting an existing portfolio system without retraining its models also seems reasonable from a practical perspective. In addition, the study compares multiple investment strategies using a shared portfolio allocator and evaluates their performance using long-term historical market data. The experiments consider actual portfolio performance, including risk-adjusted returns and transaction costs, rather than focusing only on prediction accuracy. The proposed method also reports generally better performance than existing approaches in long-horizon experiments. These aspects make the motivation of this study reasonable from an application-oriented research perspective.
Critical weaknesses
Despite the well-motivated research problem, I found it somewhat difficult to follow the details of the paper. In particular, the presentation of the methodology seems more complicated than necessary given the relatively straightforward main idea of the study.
This study is closer to an application-oriented study that uses existing methods rather than proposing a new machine learning methodology. Therefore, I do not think that proposing a new machine learning algorithm is necessarily required. However, even for an application-oriented study, the authors should provide sufficient justification for why existing methods were selected and combined, and why the resulting design is appropriate for addressing the research problem. In particular, Hedge and fixed-share are well-established algorithms designed to track the best experts over time, and applying them to the selection and combination of multiple portfolio strategies is also similar to existing approaches. Furthermore, the authors do not sufficiently explain the rationale for selecting the three operating points or the additional benefits of the hierarchical structure compared to conventional portfolio ensembles. For these reasons, I find it difficult to see what substantial advantages or practical differences RASP offers over existing expert selection and portfolio ensemble methods.
This concern is also reflected in the ablation results, which do not clearly demonstrate the contribution of test-time adaptation itself. In Table 5, removing the validation gate reduces the Sharpe ratio from 0.954 to 0.750, whereas removing fixed-share from the ungated Hedge strategy only reduces it from 0.750 to 0.718. This suggests that the validation gate plays a substantial role in the reported performance improvement. However, as far as I understand, the validation gate is determined before the evaluation period and does not perform dynamic adaptation during testing. Please correct me if I have misunderstood this. Therefore, I think it is reasonable to question whether the performance improvement comes from online mode adaptation or from selecting a fixed strategy based on validation data.
In addition, the word "Equation" is repeated in lines 297 and 303. I recommend that the authors carefully review the manuscript for grammatical and typographical errors to improve its overall readability.
Questions for authors
-
The performance difference between RASP and Hedge seems to reflect the effect of adding the validation gate rather than the superiority of a new online selection algorithm. What are the authors' thoughts on this interpretation?
-
RASP appears to show a larger performance advantage over existing methods in Table 2 than in Table 3. Could the authors provide a possible explanation for this difference?
-
In Section 4.4, why is each operating point's utility normalized using its own historical range? Since this may not preserve relative performance differences across modes, could the authors explain the rationale and whether a common normalization scale would affect the results?
3 comments
Response to Reviewer DxnP (2/2): Q3, W2, W1, revision
Q3. Normalization. The code uses one common range (meta_policy._causal_scale: min/max over all modes' past utilities), and Sec. 4.4 is aligned with it. We also ran the per-mode variant you describe (E2), mean U_MV per quarter:
| Sample | O1 | Hedge, shared | Hedge, per-mode |
|---|---|---|---|
| Selection F1–F2 | 0.0457 | 0.0417 | 0.0399 (shared ahead, p = 0.045) |
| US test | 0.0832 | 0.0829 | 0.0831 (p = 0.34) |
| JP+EU | 0.0417 | 0.0386 | 0.0370 (shared ahead, p = 0.049) |
| Per-mode scaling discards level differences and is worse on the selection folds and on JP+EU. On the US test folds the two versions do not differ. Neither version changes the gate. | |||
| W2. Why these components and three operating points. |
- Hedge/fixed share. Only delayed quarterly net utility is observed, mode leadership is not predictable from state, and the leader switches. Exponential weights gives O(√(T ln|Π|)) regret without a loss model; fixed share handles switching leaders (Herbster & Warmuth 1998); FTL is its η → ∞, β = 0 limit. A contextual bandit/RL selector would need state features and tuning on 22 validation cells.
- Router (Eq. 4), consensus (Eq. 6), allocator (Eq. 7) are the cost-net certainty equivalent, the Gaussian posterior mean, and the exact ℓ1-cost problem with one solver for every mode, so mode differences are not unit or solver artifacts.
- Three points: base O1, plus coordination (O2) or more information (O3): the minimal set that separates the two. No point dominates (best mode: 11 US universes O1 4 / O2 2 / O3 5; JP+EU 8 / 1 / 3). O2 is the weakest mode in every sample, with the highest turnover (14.2×/yr in the US). O3 matches the base on Sharpe (0.752 vs 0.754). W2. Versus portfolio ensembles (new, E5, post hoc, so exploratory). On mean–variance our modes have no advantage over a conventional ensemble; the advantage is limited to CVaR. Same Hedge rule over the five classical allocators, and over those five plus O1–O3: | Policy | US SR | US U_MV | US U_CVaR | JP+EU U_MV | JP+EU U_CVaR | |---|---|---|---|---|---| | Deployed | 0.754 | 0.0832 | −0.486 | 0.0417 | −0.570 | | Ensemble, 5 classical | 0.851 | 0.1103 | −0.529 | 0.0531 | −0.636 | | Ensemble, 5 + O1–O3 | 0.834 | 0.1037 | −0.511 | 0.0512 | −0.600 | | Equal-Weight | 0.914 | 0.1219 | −0.533 | 0.0623 | −0.663 | U averaged over quarters (Table 3's JP+EU CVaR averages per cell: Deployed −0.577).
- On mean–variance the classical ensemble beats our modes and EW beats the ensemble; the gate rule would deploy 1/N for that menu.
- On CVaR-95 (Table 3; all portfolios fully invested) Deployed beats both ensembles in the US and JP+EU (p ≤ 0.004). Adding O1–O3 to the classical menu improves its CVaR but lowers its MV utility (−0.0066, p = 0.008). W1. Presentation. In the revised PDF, Sec. 4 opens with a five-line summary; derivations and Defs. 4.1–4.2 move to the appendix; the repeated "Equation" at l. 258, 297, 303 and the Fig. 1 caption are fixed. Table 4 moves to the appendix with the evaluated grid {50, 100, 200, 400} plus per-cell validation selection (Deployed SR 0.628 / 0.714 / 0.764 / 0.785 at fixed λ; 0.754 as deployed). Revision. Tables 2–5 report the deployed configuration and the reproduced baselines; the abstract, Sec. 5 and conclusion state three findings: no operating point dominates; selection from realized utility is limited by signal-to-noise, so the gate deploys O1; the deployed policy has a CVaR advantage over 1/N (US +0.047, p = 0.004; JP+EU +0.096, p = 0.0002), while 1/N leads on Sharpe and mean–variance, now stated as the main limitation.
summary of rebuttal revision
- Q3 normalisation → B7 (the formula now matches the code) and A2 (shared range ahead on F1–F2, p ≈ 0.045, and on JP+EU, p ≈ 0.049; tied on U.S., p = 0.34).
- W2 vs portfolio ensembles → A1, E5 rows (CVaR: Deployed ahead of Ens-classical and Ens-all in U.S. and JP+EU, p ≤ 0.004).
- W2 static mixture → A1, E4 row (JP+EU +0.0045, p = 0.032).
- W1 presentation → B5, B6, B8.
Hope the revision and clarify in rebuttal can solve your concern and consider increase the rating of the paper.
Response to Reviewer DxnP (1/2): baseline protocol, deployed configuration, W3/Q1, Q2
Thank you for the review. Your reading of the gate (W3) is correct, and Q2 bears on which numbers are being compared, so we give the baseline protocol and the deployed configuration first. Baseline protocol. The five recent systems in Table 3 — FinCon (Yu et al., 2024), TradingAgents (Xiao et al., 2024), MetaTrader (Niu et al., 2022), MacroHFT (Zong et al., 2024) and FINSABER (Li et al., 2026) — are reproduced and run by us from each paper's method description and released code, mapped onto our protocol rather than quoted: the same universes, the same daily OHLCV-derived information set (≤126 trading days), the same weekly Friday calendar, the same risk model, the same cap-constrained ℓ1-cost allocator and the same 25 bps one-way cost. Their published numbers use different assets, frequencies and horizons and are not comparable, so we do not use them. Under this protocol each reproduced system's book reduces to the static rule to which its allocation step corresponds (App. C.3), and the systems are reported together with those rules as one baseline family. Deployed configuration. The RASP row of the submitted Table 3 reports the gate-free mixture at fixed λ_alloc. The revised paper reports the deployed policy: the gate is fitted once on F1–F2, before any test fold, and kept O1, so the deployed policy is the fixed mode O1, at 0.754 / 9.4 / 0.462. The gate-free mixture appears beside it at 0.750 / 10.4 / 0.439. Table 3. 25 bps one-way. US: 44 cells, F3–F6, 2014–2026. JP+EU: 69 held-out cells, evaluated once.