- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3(+2)
- Soundness
- 2
Read review
Paper summary
The authors propose Diachronic Sample Integration (DSI), a method for estimating tail-risk measures (VaR and ES) with generative models. Instead of drawing all synthetic samples from one trained checkpoint, a fixed sampling budget is split across several checkpoints from the same training run. The method itself is not tail-specific, but the authors argue that tail behaviour is learned poorly and fluctuates between checkpoints, so pooling lets these checkpoint-specific errors partly cancel. This is supported with a bias-variance decomposition, in which the error splits into a persistent bias that pooling cannot remove and a fluctuation term that shrinks as more weakly correlated checkpoints are pooled. The experiments follow the TailGAN benchmark, and VaR and ES are estimated from generated paths on synthetic and NASDAQ data.
Critical strengths
- The method is simple and cheap to use. There is no need to change the model, training objective or architecture. It can in principle be applied to any generator. The comparison in Table 7 is a nice result: the pooling of checkpoints from only one training run reaches about the same accuracy as an ensemble of independently trained models.
- The paper is open about when the method is assumed not to help (persistent bias, strongly correlated checkpoint errors), and the diagnostics in Table 2 match the results in Table 1. I appreciated that the paper explains its failure cases instead of only reporting where it works.
Critical weaknesses
- It is hard to understand what is being generated and why.
- The introduction motivates the method in general terms ("rare adverse scenarios", "tail-dependent functionals") but never describes the actual setup: the model generates multi-asset price paths, these are passed through trading strategies to get profit-and-loss distributions, and VaR and ES are estimated from those. I only understood this once I reached Section 5.
- The paper also does not really explain why a generative simulator is needed instead of estimating risk directly from historical data. This matters because historical simulation does about as well as DSI in Table 1.
- A short, concrete description of the pipeline and its motivation early in the paper would make the contribution much easier to follow.
- Some results in Table 1 are hard to interpret, and a few claims go further than the results.
- Some reported numbers need more explanation, in particular the standard deviation of DSI and the backtest results for the Oracle (see Questions 1 and 2).
- The abstract says DSI outperforms "state-of-the-art tail-aware baselines", but TailGAN is the only tail-aware method in the comparison.
- Section 5.2 says DSI keeps the dependence structure "without visibly degrading" it, while Figure 2(a) suggests it is somewhat worse than the single-checkpoint DDPM (though still clearly better than the GANs).
Questions for authors
- In Table 1, DDPM (DSI) has a standard deviation of ±0.2 on synthetic data, while SE(1000), which samples directly from the true distribution with the same budget of 1000, has ±2.3. How can DSI vary less across runs than sampling from the true distribution? Are the generated samples redrawn in every repetition?
- The Oracle is rejected by the Kupiec coverage test in 16.32% of trials, and HSM in 17.19%. For the true data-generating process I would expect a rejection rate close to the nominal level of the test. How do you explain this, and how should DSI's 20.26% be read relative to it?
- On synthetic data, historical simulation (3.4) has a lower error than DDPM (DSI) (3.7) and a lower coverage rejection rate. In which situations would you expect a generative simulator with DSI to be preferable to historical simulation?
- Did you consider comparing against other tail-aware generative methods mentioned in the related work, such as FIDE or heavy-tailed diffusion models?
7 comments
R3 (2/3) - Q1-3
“Section 5.2 says DSI keeps the dependence structure ‘without visibly degrading’ it, while Figure 2(a) suggests it is somewhat worse than the single-checkpoint DDPM (though still clearly better than the GANs).”
Following the evaluation in TailGAN [1], correlation and autocorrelation (Corr/ACF) diagnostics serve as checks that generated scenarios retain the basic dependence patterns of the reference data. These linear summaries provide a partial view of the nonlinear dependence relevant to portfolio tail risk. Their intended role is to assess whether the overall patterns in the correlation heatmaps and the shapes of the ACF curves are preserved, rather than to rank simulators by raw distance alone. The distances should therefore be interpreted alongside these plots, with attention to whether generation introduces structural distortions. Although Figure 2(a) reports somewhat higher distances for DSI than for single-checkpoint DDPM, DSI retains the overall dependence patterns while improving VaR/ES estimation. We will clarify this diagnostic role in the final manuscript and explain that the retained patterns, rather than identical distance values, underpin our description of preserved dependence structure.
Q1: Variability across repetitions and sample redrawing
“How can DSI vary less across runs than sampling from the true distribution?”
SE(1000) represents the error of ordinary i.i.d. Monte Carlo sampling from the true distribution. TailGAN [1] introduced it as an empirical reference for average relative error (RE), not a lower bound on the variance of RE. TailGAN [1] also reported standard deviations below those of SE(1000).
Crucially, DSI does not use naive Monte Carlo sampling. It combines checkpoint ensembling with stratified sampling across checkpoints, which can reduce both checkpoint-specific fluctuations and sampling variance. The consistently reduced standard deviations in Table 1 are consistent with this variance-reduction mechanism.
“Are the generated samples redrawn in every repetition?”
Yes, the samples are redrawn in every repetition.
Q2: Oracle and DSI coverage rejection rates
“The Oracle is rejected by the Kupiec coverage test in 16.32% of trials, and HSM in 17.19%. For the true data-generating process I would expect a rejection rate close to the nominal level of the test. How do you explain this, and how should DSI's 20.26% be read relative to it?”
The nominal 5% rejection rate corresponds asymptotically to testing the exact population VaR. Our Oracle instead estimates VaR from 1,000 samples drawn from the true process, so the estimated threshold has sampling uncertainty, which can raise the rejection rate above the nominal level. The Oracle therefore provides a finite-sample reference under the same limited estimation budget.
DSI's rejection rate of 20.26% is 3.94 percentage points above the Oracle's 16.32%, compared with 53.62% for single-checkpoint DDPM. DSI achieves the lowest coverage rejection rate among the learned methods in Table 1 and comes closest to the finite-sample Oracle reference. Historical simulation (HSM), at 17.19%, also remains close to that reference.
Q3: When to prefer a generative simulator
“On synthetic data, historical simulation (3.4) has a lower error than DDPM (DSI) (3.7) and a lower coverage rejection rate. In which situations would you expect a generative simulator with DSI to be preferable to historical simulation?”
The settings described in W1, including restricted access to historical data and downstream scenario-generation requirements, motivate using a generative simulator. DSI improves the tail-risk accuracy of such a simulator through checkpoint reuse under a fixed generation budget. On the synthetic benchmark, HSM has lower RE (3.4 versus 3.7), while on the market benchmark DSI has lower RE (9.6 versus 11.4). These results support DSI as a practical improvement to learned simulation, with the choice between a simulator and historical simulation depending on the available data and the downstream task.
R3 (3/3) - Additional Baseline and References
Q4: Additional baseline comparisons
“Did you consider comparing against other tail-aware generative methods mentioned in the related work, such as FIDE or heavy-tailed diffusion models?”
Yes. We considered SHD [2], which we identified after submission, and the heavy-tailed diffusion models of Pandey et al. [3], both of which incorporate Student-t distributions into the diffusion process. We chose to reproduce SHD as the additional heavy-tailed baseline because it was developed for a similar purpose, with experiments on multivariate financial data and VaR estimation that closely match our evaluation setting than the weather-focused experiments of [3]. Table G1 in the general response reports the comparison, with DDPM (DSI) achieving lower tail-risk error on both benchmarks.
We have also added the comparisons requested by Reviewer 1: snapshot ensembling, post-hoc EMA, and dispersion-adjusted single-checkpoint controls, including variance matching and oracle inflation. DSI achieves comparable tail-risk error to snapshot ensembling, while post-hoc EMA and the dispersion controls have higher errors on both benchmarks. The “Additional baselines” section of the general response reports the results, and our response to Reviewer 1 provides the implementation details.
We also considered FIDE [4] and made repeated implementation attempts. The main difficulty in constructing a comparable baseline is the difference between its generation setting and our multivariate portfolio-risk task:
- Multivariate adaptation. FIDE is formulated for a univariate series conditioned on a scalar block maximum. Extending it to joint multi-asset paths would require specifying how the conditioning mechanism represents multivariate extremes and their dependence, introducing methodological choices beyond the original formulation.
- Conditional generation. FIDE requires a block maximum as its generation condition, whereas our evaluation uses unconditional generation. FIDE can sample this condition from a fitted generalised extreme-value (GEV) distribution, but doing so introduces an additional parametric tail assumption. We preferred to avoid introducing such assumptions, since the choice of tail family and its suitability for our data would require additional justification for risk-modeling in regulated environments.
Our implementation attempts did not yield satisfactory performance in this setting. Given the adaptations required, we could not establish a comparison that faithfully retained FIDE's original formulation while matching our task.
References
[1] R. Cont, M. Cucuringu, R. Xu, and C. Zhang. “Tail-GAN: Learning to Simulate Tail Risk Scenarios”. Management Science, 2025. https://doi.org/10.1287/mnsc.2023.00936.
[2] H. Liu, T. Zhu, N. Jia, J. He, and Z. Zheng. “Learning to Simulate from Heavy-Tailed Distribution via Diffusion Model”. Operations Research, 2026. https://doi.org/10.1287/opre.2024.1450.
[3] K. Pandey, J. Pathak, Y. Xu, S. Mandt, M. Pritchard, A. Vahdat, and M. Mardani. “Heavy-Tailed Diffusion Models”. International Conference on Learning Representations (ICLR), 2025.
[4] A. H. Galib, P.-N. Tan, and L. Luo. “FIDE: Frequency-Inflated Conditional Diffusion Model for Extreme-Aware Time Series Generation”. Advances in Neural Information Processing Systems, vol. 37, 2024.
R3 (1/3) - Weaknesses
We thank the reviewer for the careful reading and for recognising the practical value of checkpoint reuse and the diagnostics explaining when pooling provides limited benefit. We appreciate the candid feedback on the writing and hope that the revised presentation below makes the setup and motivation clearer. We will upload a revised PDF with changes highlighted in blue before the discussion period ends. We also clarify the reported results and summarise the additional baseline comparisons.
W1: Simulation pipeline and motivation
Following Tail-GAN [1], our application is scenario simulation for portfolio risk management: generating realistic joint asset-price dynamics to estimate the risk of large portfolio losses. For static portfolios, this requires preserving cross-asset dependence, while dynamic trading strategies also depend on the temporal evolution of prices. We therefore evaluate generated scenarios through the Value-at-Risk (VaR) and Expected Shortfall (ES) of the profit-and-loss distributions they induce for benchmark static and dynamic strategies. DSI improves this simulation procedure by dividing a fixed generation budget across checkpoints from one training run and pooling their generated scenarios before estimating these risk measures.
The terms “rare adverse scenarios” and “tail-dependent functionals” refer to extreme losses and quantities sensitive to the tails of these distributions. Our submission emphasised the probabilistic formulation, in line with its primary area of Probabilistic Methods (Sampling and Uncertainty Quantification). We agree an earlier description of the concrete pipeline would make the connection to the application easier to follow, and will update our manuscript accordingly.
Historical simulation is a useful reference when sufficient, representative observations are available. Generative simulators are used in several settings where direct reuse of historical observations is insufficient for the downstream task:
These applications motivate improving the tail fidelity of learned simulators. The challenge extends beyond sample scarcity: empirical VaR/ES computation involves ranking and sorting losses, introducing non-smooth operations into gradient-based training. The “Economic importance” discussion in the general response provides further context.
W2: Interpretation of results and scope of claims
We address the standard deviations in Q1 and the Oracle coverage results in Q2 below.
TailGAN [1] was the direct tail-aware comparator in the submission. We have since added Score-based Heavy-tailed Diffusion (SHD) [2], which studies multivariate financial returns and VaR estimation. Table G1 in the general response reports this comparison, with DDPM (DSI) achieving lower tail-risk error than both TailGAN and SHD on the synthetic and market benchmarks. Q4 discusses this baseline and the additional comparisons requested by Reviewer 1.