- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a generative model, E-VAE, tailored to learning the tail distribution of financial returns. To this end, the method adopts Student's -distributions for both the decoder and the prior, while additionally incorporating jump distribution modeling. Two types of jump components are introduced: common and private jumps. These components are parameterized using Bernoulli distributions, resulting in mixture formulations for both the decoder and the prior. The paper empirically demonstrates that the proposed model achieves competitive performance in distribution fitting as well as in a downstream portfolio evaluation task.
Critical strengths
- The paper derives an analytically tractable training objective while jointly incorporating heavy-tailed distributions and explicit modeling of jump behavior.
Critical weaknesses
-
Training the proposed model appears to require tuning a relatively large number of hyperparameters. Appendix E.3 lists nine hyperparameters, including mixture probabilities, relative scale parameters, and degrees of freedom. This may result in a substantial computational burden during hyperparameter selection and raises concerns regarding the practical efficiency and robustness of the proposed method.
-
In the synthetic-data experiments, the comparison with the baseline methods is currently presented primarily through the visualizations in Figure 1. Quantitative evaluation would be necessary to more objectively assess the differences shown in this figure. For example, statistics based on the Kolmogorov-Smirnov test could be used to summarize the distributional discrepancies illustrated in the bottom panels of Figure 1.
-
Theorem 2 is introduced in the middle of the experimental section without citation, but its role in the overall contribution is not sufficiently explained. In particular, it is unclear (1) why this theorem is theoretically meaningful for the proposed method and (2) how its result is connected to, or supported by, the subsequent empirical findings.
Questions for authors
-
In line 196, the Bernoulli parameter associated with is denoted by . However, unlike , which is regularized through a KL-divergence term involving , there does not appear to be an explicit loss term that regularizes . Please clarify why such a regularization term is not required for learning .
-
Appendix E.3 specifies the search spaces for several hyperparameters. I have two related questions.
- First, does mean that all seven integer values from 4 to 10 are considered as candidate values?
- Second, is the same hyperparameter optimization budget applied to the baseline methods? This is an important concern because Appendix H.1 (around lines 1121 onward) appears to indicate that fixed configurations are used for the baselines. If the proposed method is extensively tuned while the baselines use fixed configurations, this could result in an unfair comparison. Please clarify the tuning protocol and optimization budget used for all methods.
5 comments
4. The role of Theorem 2
Theorem 2 aims to identify a restriction of the affine factor model. With finite second moments and a nonzero common tail contribution, the common covariance and common tail angular components both span . Thus, common variation in the body and the tail shares the same linear factor space. Our empirical analysis, however, finds that the estimated body and tail subspaces do not coincide. This finding suggests that a single linear factor-loading space may be insufficient to describe both ordinary and extreme return variation, and therefore motivates a nonlinear decoder. The controlled decoder ablation further supports this choice: under the same radial specification, nonlinear decoding reduces 2.5% QMAE from 0.916 to 0.448 in the U.S. and from 1.613 to 0.595 in China.
Thank you for your detailed response and additional experiments. I appreciate the authors' efforts in addressing my concerns.
I have two remaining questions.
1. Hyperparameter tuning
While the additional sensitivity analysis is helpful, the hyperparameter tuning budget for the proposed method remains unclear. Could the authors clarify how many hyperparameter configurations were evaluated during the grid search described in Appendix E.3 and compare the tuning budget with those of the baselines?
2. Quantitative synthetic evaluation
The additional quantitative results on S1 are helpful. Since S2 and S3 involve nonlinear factor-to-return mappings, could the authors also provide quantitative results for these settings?
We thank the reviewer for the careful reading and for recognizing the tractability of the training objective. We appreciate the suggestions on quantitative evaluation, parameter robustness, and the role of the theoretical result.
1. Why private jumps have no separate KL term
The common Bernoulli KL compares the variational common-state posterior with its prior. Private states are instead integrated out in the likelihood:
=(1-\rho_i)t_{\nu_{i,0}}(y_i;f_{\theta i}(z),s_i) +\rho_i t_{\nu_{i,1}}(y_i;f_{\theta i}(z),a_{i,1}s_i).$$ Here, the last argument of each univariate Student-$t$ density is its scale. The ELBO includes the log of this mixture likelihood, and no separate variational approximation to the private state is introduced. As such, there is no additional private-state KL term. In the original experiments, $\rho_i$ is a selected hyperparameter; if learned, it can be optimized through this marginal likelihood. **2. Quantitative synthetic evaluation** Following your suggestion, we computed the two-sample KS distance between standardized return-norm CDFs and report quantitative results across five independently generated S1 datasets. E-VAE-CP has a mean norm KS distance of 0.1230, compared with 0.2597 for Tail-GAN and 0.3166 for Tail-Diffusion. Both comparisons favor E-VAE-CP on every dataset. **Quantile errors and return-norm KS distance on S1.** | Model | QMAE 2.5% | QMAE 5% | QMAE 7.5% | Norm KS | |---|---:|---:|---:|---:| | G-VAE | 0.0669 ± 0.0094 | 0.0442 ± 0.0056 | 0.0613 ± 0.0077 | 0.1214 ± 0.0092 | | E-VAE (no jumps) | 0.0668 ± 0.0107 | 0.0398 ± 0.0047 | 0.0339 ± 0.0027 | 0.1576 ± 0.0070 | | E-VAE-C | 0.0580 ± 0.0061 | 0.0388 ± 0.0039 | 0.0366 ± 0.0033 | 0.1176 ± 0.0054 | | E-VAE-P | 0.0681 ± 0.0104 | 0.0392 ± 0.0055 | 0.0305 ± 0.0018 | 0.1192 ± 0.0094 | | E-VAE-CP | 0.0568 ± 0.0068 | 0.0388 ± 0.0040 | 0.0365 ± 0.0034 | 0.1230 ± 0.0039 | | Tail-GAN | 0.0549 ± 0.0024 | 0.0394 ± 0.0050 | 0.0358 ± 0.0052 | 0.2597 ± 0.0200 | | Tail-Diffusion | 0.2533 ± 0.0120 | 0.2125 ± 0.0086 | 0.1925 ± 0.0121 | 0.3166 ± 0.0090 | | $t^3$-VAE | 0.3934 ± 0.0157 | 0.3686 ± 0.0198 | 0.3466 ± 0.0211 | 0.2996 ± 0.0108 | | Pareto-VAE | 0.1800 ± 0.0261 | 0.2896 ± 0.0409 | 0.3331 ± 0.0418 | 0.3894 ± 0.0296 | Entries are means ± pointwise 95% Student-t confidence-interval half-widths over five independent S1 datasets (N=60, k=5, T=6,000). Norm KS is the two-sample CDF distance for standardized return norms. QMAE is in return percentage points. All measures are smaller-is-better. **3. Parameter sensitivity and joint learning** In the reported implementation, radial hyperparameters are global settings, while the decoder and asset-specific residual scales are learned during training. We varied the common jump probability and jump-component degrees of freedom one at a time and found that the reported metrics were relatively insensitive within the tested ranges. **Local sensitivity of E-VAE-CP on S1.** | $\pi_f$ | $\nu_{f,1}$ | QMAE 2.5% | FD/N | Energy | |---|---:|---:|---:|---:| | 0.010 | 4.5 | 0.0600 ± 0.0093 | 0.0299 ± 0.0031 | 0.0243 ± 0.0007 | | 0.005 | 4.5 | 0.0626 ± 0.0078 | 0.0311 ± 0.0029 | 0.0244 ± 0.0007 | | 0.020 | 4.5 | 0.0562 ± 0.0080 | 0.0286 ± 0.0041 | 0.0251 ± 0.0012 | | 0.010 | 3 | 0.0607 ± 0.0083 | 0.0290 ± 0.0027 | 0.0251 ± 0.0014 | | 0.010 | 6 | 0.0597 ± 0.0072 | 0.0312 ± 0.0046 | 0.0249 ± 0.0022 | Entries are means ± pointwise 95% confidence-interval half-widths over the five datasets. One parameter is changed from the local reference setting (0.01, 4.5) at a time. This is a separate local-sensitivity experiment. We also evaluated a variant that learns selected radial parameters jointly with the neural networks, while keeping the degrees of freedom fixed. Its overall distributional fit is similar to that of the fixed version. **Fixed and learned E-VAE-CP at the local reference setting.** | Radial specification | QMAE 2.5% | FD/N | Energy | |---|---:|---:|---:| | Fixed | 0.0600 ± 0.0093 | 0.0299 ± 0.0031 | 0.0243 ± 0.0007 | | Learned | 0.0649 ± 0.0079 | 0.0307 ± 0.0029 | 0.0241 ± 0.0008 | Entries are means ± pointwise 95% confidence-interval half-widths over the same five datasets. The common jump-component degrees of freedom remain fixed at 4.5; the common jump probability is set to 0.01 in the fixed variant and initialized at 0.01 in the learned variant.