- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper argues that fixed look-back windows mismatch non-stationary financial log-returns. A Mixture-of-Experts framework called RAVEN was proposed. RAVEN scores patches in reverse chronological order, and Cumulative Importance Thresholding (CIT) cuts nested contiguous contexts at thresholds, each fed to its own expert. CAW reduces redundancy among experts, while GCR sees the full window. Experiments on financial and traffic time series validate the performance of the proposed RAVEN.
Critical strengths
-
The idea is simple and sensible: per-sample look-back with chronological contiguity preserved.
-
Broad evaluation (two equity markets, fund sales, traffic) with a rolling out-of-sample protocol, ablations, sensitivity analyses, efficiency results, and routing visualisation.
-
Clear writing and a candid limitations appendix.
Critical weaknesses
-
The paper does not adequately explain how gradients propagate through the hard thresholding operation in CIT to train the scoring function (\phi). Although the entropy regularizer can update patch importance scores, it is unclear whether and how the forecasting loss provides predictive supervision for context selection. The authors should clarify the gradient flow and specify whether a differentiable approximation or an alternative optimization strategy is used.
-
The "adaptive'' and "regime-aware'' claims are weakly supported. With only 7--8 patches, CIT effectively chooses among a few prefix lengths. Since pushes the importance distribution toward uniform, CIT approaches fixed windows (), and the empirical distribution of is not reported. Figure~5 shows only that scores vary across inputs, which any input-dependent scorer would do.
-
The experimental evaluation does not fully isolate the contribution of adaptive context selection and expert routing. Although the w/o AR ablation replaces adaptive routing and learned context selection with predefined windows, the construction of these windows and the individual contributions of the two components could be described and evaluated more clearly. The authors should consider comparisons with fixed nested windows combined with learned soft expert weights, recency-biased attention, and multi-window forecasting ensembles. In addition, comparisons with more relevant financial forecasting methods and time-series mixture-of-experts models would help establish the method’s advantages. The paper should also clarify whether the baselines were tuned under comparable experimental budgets.
-
The reported improvements over strong baselines are relatively modest in absolute terms, particularly in MSE. However, the paper does not report sufficient repeated-run statistics or significance tests to establish the robustness of these gains. The authors should provide results across multiple random seeds, including means and standard deviations, and conduct appropriate statistical tests for the main comparisons.
-
No Sharpe ratio, information ratio, drawdown, or turnover is reported for the financial time series backtest, so the abstract's "risk-adjusted alpha gains'' has weak supporting metrics.
Questions for authors
Please see the weaknesses.
3 comments
Thank you for your response and for providing the detailed experimental settings and results that were missing from the original submission. While your responses have addressed some of my concerns, I have decided to maintain my original rating, considering the explanations of the model's underlying mechanisms and its performance advantages in financial time-series forecasting.
Thank you for your feedback.
We would appreciate any further feedback on which aspects of the underlying mechanisms or performance advantages remain insufficiently addressed. Your suggestions and guidance would help us provide more clarifications or additional experimental results, and also further improve the quality of the paper.
Thank you again for your time and consideration.
Thank you for the constructive assessment. We clarify the mechanism and provide additional evidence below.
Q1. Predictive supervision through CIT.
Patch scores select windows and weight their embeddings. Eq. (5) expands as:
The blocks include residual and normalization operations. Indices are fixed during backpropagation. Forecasting gradients reach the scorer through weighted embeddings and within-window softmax, without differentiating through the hard threshold or using a straight-through estimator. The scorer thus receives predictive supervision alongside entropy regularization. We will clarify this in the revised PDF.
Q2. Adaptive contexts, patch count, and regime awareness.
Uniform scores yield fixed lengths 2/4/6 for seven patches. Entropy regularization encourages uniformity but does not enforce it under the joint objective. Table 1 shows multiple lengths per expert, with the most frequent lengths being 1/3/5 on HS300 and 2/3/5 on S&P500.
Table 1. Selected window lengths (%).
Table A.4 evaluates N=6/7/10/15, yielding HS300 Corr of .0372/.0390/.0384/.0384. Additional fixed-window experiments show that the best length varies across years in both markets.
These distributions support input-adaptive selection. The ablations below assess its predictive benefit.
Q3. Component isolation, baselines, and tuning.
Fixed windows. In w/o AR, we remove CIT and patch importance learning. Assuming equal patch importance, we predefine three nested windows containing the most recent 2/4/6 patches for Experts 1–3. These windows are fixed across inputs, while expert encoders, learned aggregation, and other components are retained.
The w/o CAW variant separately evaluates correlation-aware aggregation. Global confidence parameters αk are learned from equal initialization and fixed after training. Final weights remain input-dependent through CAW.
Table 2. HS300 ablations (mean ± SD).
Both controls reduce overall Corr, supporting the contributions of adaptive contexts and correlation-aware aggregation. We'll add full results in revised pdf.
Baselines. Patch-Ensemble already provides a multi-window ensemble comparison. We add financial baselines and recent time-series methods, including LightGBM(with raw input and also with Alpha360 factors), TFPS, TimeSqueeze.
Table 3. Additional HS300 comparisons.
Table 3 also shows that RAVEN performs best on both metrics among these methods.
Tuning protocol. We tune all reproduced SOTA methods using their official implementations, released scripts, and hyperparameter configurations as references. We will document the configurations explored and the model-selection procedure in the revision.
Q4. Reproducibility and gain magnitude.
Table 4 reports 10-seed mean ± SD for 2020–2024. RAVEN achieves better means and lower seed variation than MLF on all reported metrics in both markets.
Table 4. Ten-seed comparison.
Corr improves by 9.5%/20.5% and CS-IC by 14.3%/22.2% on HS300/S&P500. Full annual results will be added to the appendix.
Q5. Risk-adjusted performance.
HS300 Qlib backtests use the same strategy and transaction-cost settings across models.
Table 5. Portfolio performance. MDD is drawdown magnitude.