- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper investigates the limitations of traditional financial time-series forecasting methods, which primarily rely on point regression objectives and struggle to effectively identify extreme market movements and rank returns. The authors propose a probabilistic market-state forecasting framework that represents historical OHLC data and future returns as discrete states. Experiments conducted on ten major equity indices across different time periods demonstrate that the proposed method outperforms several regression-based forecasting models in return ranking and extreme-movement identification.
Critical strengths
S1: This paper points out that traditional financial time-series forecasting methods primarily optimize MSE or MAE, but lower prediction errors do not necessarily lead to better return ranking or extreme-event identification. The authors shift the research focus from continuous numerical prediction to probabilistic market-state modeling, making the forecasting objective more aligned with decision-relevant information in financial applications. This perspective offers a certain degree of novelty and provides a valuable research direction for financial time-series forecasting.
S2: This paper transforms the traditional regression task into a probabilistic classification task through historical price patch discretization, directional anchor selection, and dual target-state codebooks. Specifically, two independent state spaces for upward and downward movements are used to model market changes in different directions, enabling the model to generate corresponding prediction scores for extreme upward and downward events.
Critical weaknesses
W1: The paper mainly compares the proposed probabilistic classification framework with traditional regression models optimized using MAE. However, these two types of methods have different training objectives, and the regression models are not directly optimized for return ranking or extreme-event identification. Therefore, the observed performance improvements may partially result from better alignment between the training objective and evaluation metrics, rather than solely from the proposed model architecture. Although the paper compares several classification output formulations, it still lacks systematic comparisons with independently optimized binary classification, learning-to-rank, and other probabilistic forecasting methods.
W2: The paper lacks systematic experiments with different historical lookback window lengths and prediction horizons. Therefore, the applicability of the proposed model to more complex financial forecasting scenarios remains to be further validated.
W3: The paper constructs directional prediction scores by selecting the five cluster states with the highest or lowest average returns. However, extreme events in financial markets are typically rare, and the analysis in Appendix B.2 also shows that the selected Top-5 or Bottom-5 states contain very few samples in some training periods. In such cases, the cluster mean returns estimated from a small number of samples may be significantly affected by random fluctuations and outliers.
W4: The paper considers the dual-directional K-Means codebooks as one of its core designs. However, Figure 8 in Section 5.5 shows that simpler output formulations, such as equal-width discretization, dual binary classification heads, and a single three-class classification head, can also achieve competitive performance in return ranking and extreme-event identification. This makes the practical advantages of the dual-directional K-Means codebooks over simpler classification strategies less convincing. I hope the authors can further clarify the necessity of this relatively complex design and provide more direct comparisons to demonstrate its irreplaceable contribution.
If the authors can adequately address the above concerns and provide appropriate clarifications or additional experimental evidence during the rebuttal phase, I would be willing to reconsider and potentially raise my score accordingly.
Questions for authors
See Weaknesses
3 comments
Response to Reviewer HjXt (2/2)
W3. Robustness of the Top-5 and Bottom-5 scores. In some training periods, the Top-5 and Bottom-5 states contain few observations (Appendix B.2). This raises the question of whether the resulting tail rankings are sensitive to random fluctuations or outliers in these small samples.
(1) The Top-5 and Bottom-5 scores deliver significant AUROC gains in both test periods. Table 9 reports upward and downward AUROCs of 0.8131 and 0.7557 in 2015–2019, and 0.7741 and 0.7082 in 2021–2025. In each period and direction, the AUROC gain over every evaluated point-forecasting baseline is statistically significant (Holm-adjusted ). Appendix A.7 assesses these gains with a market-stratified moving-block bootstrap using 1,000 resamples and 20-trading-day blocks.
(2) Tail discrimination is similar when the score aggregates 40 states per direction. This comparison addresses how much the forecast depends on using only the five states at the extreme end of each training-set ordering. Figure 9 shows that expanding the aggregation from 5 to 40 states increases the number of selected training observations by more than a factor of 100 in each direction and period, with event purity of at least 99.82%. In Table 3, the largest absolute change across both test periods and directions is 0.0112 in AUROC and 0.0031 in AP.
The five-state scores therefore achieve significant out-of-sample gains in both periods, and those periods also show comparable tail discrimination when the probabilities of a much broader group of states are aggregated.
W4. Practical advantage of the dual-directional K-Means codebooks. We do not claim that this design is irreplaceable. As stated in Section 5.5, the probabilistic state framework is not tied to a particular output discretization, and the competitiveness of simpler discrete outputs further supports our central claim (see W1). The dual K-Means codebooks are the instantiation that performs best, with two concrete advantages.
(1) High-confidence event concentration (K-Means). Section 5.5 identifies high-confidence event concentration as the practical advantage of our codebooks (lines 466–475). Figure 8(d) directly compares K-Means with equal-width binning, two binary heads, and a single three-class head using the same input tokens and Transformer backbone. To compute directional precision (DP@N), we take the highest-scored observations for each direction, calculate the fraction that moved at least 2% in that direction, and average the two hit rates.
At , K-Means achieves the highest directional precision in both periods, reaching 15.60% in 2015–2019 and 13.57% in 2021–2025. At , K-Means also ranks first in 2015–2019 and is nearly tied with equal-width binning in 2021–2025 (10.51% versus 10.55%). These results suggest that the finer, data-adaptive states can place more realized extreme moves among a fixed number of high-confidence predictions, a distinction that aggregate metrics such as IC, AUROC, and AP do not fully capture.
(2) Dedicated directional codebooks (dual). Removing the downward branch (upward-only codebook) lowers Spearman IC from 0.0372/0.0364 to 0.0362/0.0303 in 2015–2019/2021–2025, and replacing the anchored dual codebooks with a shared codebook lowers it to 0.0354/0.0314 (Table 2). When the score aggregates 40 states, the dedicated downward codebook keeps downward AUROC at 0.7576/0.7194, whereas the bottom states of the upward codebook drop to 0.2484/0.2891 (Table 3).
Summary. The two components are supported by different evidence. The K-Means state construction is supported by high-confidence event concentration (DP@N, Fig. 8d). The dual-directional design is supported by the stability of the dedicated downward score under broader aggregation (Table 3) and by the ranking gain from dual-branch training (Table 2). Together with the same-backbone comparison in W1, these results show that probabilistic state prediction drives the main improvement over regression, and the dual K-Means codebooks further refine it.
I thank the authors for their detailed response, which has addressed most of my concerns. However, the paper still has some limitations, particularly the lack of systematic evaluations across different historical input lengths and forecasting horizons. In addition, I have carefully reviewed the comments from other reviewers and the authors' corresponding responses. Although the authors have clarified some issues during the rebuttal phase, I believe that the available evidence is still insufficient to fully resolve my remaining concerns. Therefore, I have decided to maintain my original score.
Response to Reviewer HjXt (1/2)
We thank the reviewer for the constructive comments. We address each point below.
W1. Training objective and direct classification baselines.
Our central question is whether probabilistic market-state forecasting is better suited than point-error minimization to ranking next-day returns and identifying extreme moves. The objective alignment noted by the reviewer is therefore the effect we aim to test, rather than a confound. We do not claim that our model dominates all alternatives.
(1) Why MAE-trained regressors are the primary baselines. Financial forecasting models are routinely trained and selected by MSE or MAE, so whether this serves ranking and extreme-event identification is our central question (Section 1, lines 57–59). Figure 2 shows that lower MSE or MAE can coincide with weaker IC and AUROC. Proposition B.2 shows that MSE/MAE regression recovers the conditional mean/median, whereas the Bayes-optimal AUROC ranking is given by the event posterior; Proposition B.3 gives a counterexample where the MSE-optimal predictor inverts the tail ranking.
(2) Same-backbone binary and three-class classifiers support this conclusion. Section 5.5 fixes the input tokens and Transformer backbone and changes only the output layer. In 2015–2019 and 2021–2025, the dual binary head reaches Spearman ICs of 0.0422 and 0.0390, the three-class head 0.0442 and 0.0378, and our codebooks 0.0372 and 0.0364, all well above PatchTST, the strongest regression baseline (0.0317 and 0.0140; Table 9). The improvement thus comes from replacing point regression with probabilistic state prediction, not from one specific output design.
(3) What our codebooks add over direct classification.
(4) Other probabilistic and ranking methods. We already compare with Kronos, which predicts categorical distributions over discrete K-line tokens but decodes them into continuous prices. On 2025–January 2026, our model achieves a higher IC (0.0511 vs. 0.0153/0.0067) and higher AUROCs in both directions (Table 9). Out of respect for the reviewers' suggestions, we also added Gaussian NLL and quantile heads on the same input tokens and backbone (see our response to Reviewer kVbL, W1/Q1): our dual codebooks rank first in 6 of 12 entries, and all probabilistic heads remain far above the MAE-trained baselines.
W2. Lookback window and forecast horizon. Our model uses 10 trading days of daily index OHLC observations to forecast the next-day return. This follows the standard practice in financial forecasting, which differs from general time-series forecasting in this respect.
(1) One to two weeks of input and a next-day target are the mainstream setting. Unlike long-term time-series benchmarks, financial forecasting studies rarely evaluate multiple prediction lengths or input lengths. For next-day prediction, 10 trading days is a common choice: Shahabi Nejad and Ebadzadeh [1], Ding et al. [2], and Yoo et al. [3] use 10-day lookbacks for next-day price and movement prediction, and Wang et al. [4] use nine daily closes to predict the next index close. Such short-term tasks typically do not use more than two weeks of history, and our 10-day setting follows this convention.
(2) In finance, the horizon defines the task rather than its difficulty. In long-term forecasting, multiple horizons (e.g., T∈{24,36,48,60} for PatchTST on ILI [5]) measure how point error grows with lead time on the same series. In financial forecasting, changing the horizon changes the holding period and the event being ranked: a 2% next-day move and a 2% weekly move are different decision targets with different base rates. Fixing the next-day target lets all methods be compared on the same daily decision.
References
[1] Shahabi Nejad & Ebadzadeh, Stock market forecasting using DRAGAN and feature matching, ESWA 2024.
[2] Ding et al., Hierarchical Multi-Scale Gaussian Transformer for Stock Movement Prediction, IJCAI 2020.
[3] Yoo et al., Accurate Multivariate Stock Movement Prediction via Data-Axis Transformer with Multi-Level Contexts, KDD 2021.
[4] Wang et al., Stock market index prediction using deep Transformer model, ESWA 2022.
[5] Nie et al., A Time Series is Worth 64 Words: Long-term Forecasting with Transformers, ICLR 2023.