- Rating
- 4
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper addresses the problem of estimating expectations of functionals of stochastic processes. Obtaining accurate estimates with Monte Carlo is expensive but the cost can be reduced through use of a well-chosen importance sampling proposal or well-chosen control variates integrand. The paper introduces the use of foundation models for this purpose thereby reducing computational costs of Monte Carlo estimation whilst retaining unbiased estimates. The foundation models are tested on a range of applications in finance and biology and demonstrate significant variance reduction whilst matching wall-clock speed. Improvements in this area have important applications in many disciplines.
Critical strengths
Whilst task-specific trained models have previously been used to achieve Monte Carlo variance reduction in related ways, the use of reusable foundation models that adapt to new tasks without retraining or explicit task parameters appears to provide a significant and novel development. The construction of the models is clever and technically imaginative, and the experimental results show considerable promise for this new approach. This is a strong and well-written paper that lays the foundations for a new methodology with potential applications across a wide range of disciplines.
Critical weaknesses
It is unclear whether the models fully capture the breadth implied by the term ‘foundation model’. Broader evaluations and stronger ablations would help determine the full generality of the approach. But in my view, for a paper that is introducing this new approach to the ML community, such limitations do not detract too significantly from the novelty or promise of the paper
I think it would be helpful to expand and summarise limitations of the method in one place (at present several caveats are dispersed across the paper). This would be helpful to the reader and, I believe, strengthen the paper rather than weaken it.
Questions for authors
(1) Can you expand on the way in which the engineering and stressed financial benchmarks are out of distribution relative to foundation model pre-training distribution and to what extent the resulting experiments support the claimed generality of the approach.
(2) Do you have suggestions for how users might select the pilot and estimation budgets?
(3) Are you able to describe what formal protection the importance-sampling mixture provides and/or how sensitive the results are to its mixing weight?
3 comments
Thank you for addressing my comments in detail and for making corresponding changes to the pdf. I have no further questions nor need for further clarification and maintain my acceptance-recommendation score of 4.
We thank you again for your time and efforts in providing improvements to the manuscript!
We thank the reviewer for the efforts and time spent reviewing the manuscript and for the encouraging feedback and comments that help improve the manuscript.
This is a good point, we included a new set of experiments on extrapolating far outside the training domain in terms of dimension to see how the model performs on the engineering and finance tasks. We extrapolate in terms of both dimension and time and include the results in Figure 14 in the appendix. The results indicate the models still provide variance reduction on inference for higher, unseen dimensions with a gradual degredation as dimension increases.
Thank you for this suggestion, we included a new limitations section at the end of the main text. We specifically included some of the assumptions we required and commentary on how we can relax such assumptions in future work.
By out of distribution, we mean that the benchmarks use stochastic-process and function constructions not sampled by the pretraining generator. Specifically, we change the governing dynamics and the path dependence of the payoff from pretraining to test. Note that some of the components may overlap with pretraining: for example, pretraining includes cubic reaction terms, while the Allen–Cahn benchmark uses this with a nearest-neighbor spatial Laplacian which was never used in pretraining.
To give a few examples, we included the following table which describes the held out structure being tested for the benchmarks:
Finally, the real data experiments involve data that are not used during pretraining.
Thank you for this suggestion. As an example, we performed a scaling law analysis for the control variate foundation to predict the matched time variance ratio compared to MC as a function of the number of parameters of the model, the number of estimation paths and the number of pilot paths. At a fixed time budget, one can then predict the optimal number of estimation and pilot paths: while both numbers of paths need to generally increase as the time budget increases, the increase for the number of estimation paths is smoother than for the number of pilot paths, see appendix F.3.
This is a great suggestion, we included a figure (Figure 16 in appendix E.2) in the revision on how the α parameter plays a role in the variance reduction of the method. The results indicate that the model is fairly robust across different values of α. Note that the model construction is guaranteed to be unbiased for all α.
The defensive mixture provides an explicit bound on importance weights. Specifically, $ q_\alpha=\alpha p+(1-\alpha)q_\theta $ with $ 0<\alpha\leq1 $, where p is the original sampling distribution, we have qα≥αp, and w=qαp≤α1 which gives us $ \mathbb E_{q_\alpha}[(Fw)^2] \leq\frac1\alpha \mathbb E_p[F^2]. $ This means that under our default α=0.2 level, the importance weight is bounded by 5 and preserves a finite second moment whenever the original payoff has one. This protects against extreme likelihood ratios caused by proposal mismatch.
We thank you again for your review, and we hope that our response provides additional clarification on the points in the review.