1. Paper framing:
The contribution sits a bit awkwardly between a general purpose uncertainty method and applications to surrogate models. For example, the abstract directly mentions neural operator, although they are never used. Similarly, a whole paragraph of the introduction concerns surrogate modeling, although it is later only one specific dataset/experiment.
Section 3.2 on the energy score is also overly complicated for general spaces and metrics, probably to accommodate a possible function space setting. However, it could be much simplified to the reader by just using dY=∥⋅∥2, since ultimately all used models operate on Rd (the functional setting uses an MLP as well, to my understanding).
I would either claim the method to either be
- A general-purpose method (which I think it is) that can be combined with almost any architecture and is a simple way to improve MCDropout to accommodate more complex distributions. This goes in line with the controlled experiments and the regression benchmarks. The functional uncertainty should then be claimed and seen as a possible extension or just as another benchmark
- A method for surrogate modeling, which would at the moment raise the question why most of the paper focuses on the multivariate setting and provides only a single PDE experiment.
At the moment the motivation is not really clear and it reads like the surrogate part was somehow forced into the paper. This diminishes the contribution and makes the paper sit awkardly between two almost adjacent parts that are not sufficient on their own. I encourage the authors sharpen the contribution, which (together with addressing the following points) can lead to a great paper with an interesting uncertainty representation method.
2. Experiments, baselines and dataset selection:
I believe that the experimental section requires a major update in order to properly assess the performance of OTD.
I like the controlled experiments here and in this case comparing only to MCDropout is generally sufficient. However, here it would be a good place to state more clearly the runtime/compute differences of the method and the performance with respect to the amount of parameters (compare question 6).
However, the real-world data experiments are in my view not sufficient in their current state. The Ginzburg-Landau experiment compares only to the deterministic method and the MCDropout and can only verify improvements against the latter, which are expected since OTD adds extra compute/parameters to provide a more flexible dropout distribution. Instead it would be much more interesting to compare to other (functional) uncertainty estimation approaches, for example those mentioned by the authors themselves or for example from Magnani et al. [1] or Diaconu et al. [2].
For this task the current baseline selection is not sufficient to assess the performance of OTD with respect to functional uncertainty estimation.
The regression benchmarks are claimed to be "established in the literature" (l. 453), but only cite an arXiv preprint. I would at least add corresponding citations for the UCI datasets and any published benchmarks. Similarly, the corresponding baselines are not described and not referenced so there is no information which category the corresponding baselines fall into and what method they are based on. At the same time, reasonable baselines that are cited by the authors themselves are not compared, for example Pacchiardi et al. [3]. Further baselines that go into the same direction and might be interesting to add could be Kelen et al. [4] or Han et al. [5].
As you already provide many baselines, I suggest to strengthen the benchmark claim, explain the methods in more detail and provide more detailed results, for example providing tables similar to Table 14 for all metrics (same for Figure 5). Together with addressing the fair parameter count (compare question 6) and addressing the additional runtime for OTD this could significantly strengthen the regression benchmark setting.
3. Kinetic regularization:
I understand and like the idea of applying the kinetic regularization, especially with the motivation of the smooth and rough paths in Appendix E. However, the impact, at least in the ablation, seems overstated. While the authors acknowledge that the kinetic regularization has a smaller effect, Table 3 shows that there is actually no significant (in terms of seed standard deviation) effect of setting λkin=0. The only significant improvement is in MACE where however both OTD variants are within the same standard deviation of MCDropout. This raises the question whether the regularization is needed in practice at all and leads to any improvement gains. A the same time, the selection of λkin seems not clear, l. 1808 claims selection so that it "remains small relative to the Energy Score", which does not offer clear selection guidance.
I would suggest the authors to
- More thoroughly analyze the effect of the kinetic regularization and its effect on the quantitative performance across all studied datasets. This would show whether λkin>0 is required in general, for some specific tasks, or not at all.
- At the same time, provide a clear way to select λkin, for example based on hyperparameter tuning or some heuristic and analyze its interplay with the resulting performance of the regularized OTD.
4. Minor points and style
- Gθ is never properly defined.
- ρ0,l not properly defined, maybe just include the space it lives on and a symbol for the used distribution? I assume that l denotes the index of the hidden representation/unit?
- The table in l. 396 is not a proper table with title etc.
- Table 2: The width highlighting is misleading as a very small width is not better if the corresponding PICP is far away from α. Otherwise, any deterministic baseline would be best with=0. I suggest to remove the width highlighting overall and only supply it as an addition to PICP to check width in well-calibrated cases.
- Figure 1: Maybe the two right plots could be scaled to the same size as the left one to improve visibility? Also in the left panel P denotes the KDE estimate, so since it is a density it should probably be written as small p with a corresponding definition before.
- Z1 in l. 155 should use a definition symbol
- l. 230 & l. 237. P∗ is never actually defined, I assume you mean Px∗ ?
- The papers [1,2] mentioned earlier with regards to baselines, would also be a good addition to the related work on uncertainty in functional surrogates.
References
[1] Magnani, E. et al. Linearization Turns Neural Operators into Function-Valued Gaussian Processes. ICML 2025.
[2] Diaconu, C. et al. Probabilistic retrofitting of learned simulators. ICML 2026.
[3] Pacchiardi, L. et al. Probabilistic Forecasting with Generative Networks via Scoring Rule Minimization. JMLR, 2024.
[4] Kelen, D. et al. Distribution-Free Data Uncertainty for Neural Network Regression. ICLR 2025.
[5] Han, X. et al. CARD: Classification and Regression Diffusion Models. NeurIPS, 2022.
We thank the reviewer for the positive assessment and constructive suggestions. We have addressed the two principal concerns by substantially expanding the probabilistic baseline comparisons and strengthening statistical reliability. The revised manuscript additionally reports predictive accuracy, distributional scores, calibration diagnostics, model complexity, and computational costs, providing a more comprehensive assessment of OTD. We appreciate the reviewer's contribution to the experimental design; the resulting additions are detailed in Section 4.2 and Appendices D.1-D.5.
Critical Weaknesses
We have implemented the requested families of probabilistic baselines, together with the implicit generative approaches of Pacchiardi et al. and Kelen et al. GP and PCA-GP are evaluated on the UCI/OpenML benchmarks. For Ginzburg-Landau, the stochastic models generate complete-field realisations, allowing comparisons through field-level Energy Scores and functional diagnostics. We report predictive metrics, parameter counts, hyperparameters, and training times. The synthetic experiments retain MC Dropout as the main comparator because they are designed to isolate specific properties of transported masking rather than provide comprehensive method rankings. We thank the reviewer for prompting these broader tests, which have strengthened the empirical comparison in Section 4.2, Appendix D.4 (Tables 11 and 12), and Appendix D.5 (Tables 16-19).
We have extended the component ablation and the Ginzburg-Landau experiments to ten independent seeds (0-9), reporting means and standard deviations (Table 5). We have also done so for the bimodal, misspecification, model-capacity, integration-depth, temperature-sensitivity, and timing analyses, where corresponding results are reported. The revised ablation study considers eight configurations and more clearly separates the contributions of the Energy Score, learned transport, kinetic regularisation, and model capacity. For UCI/OpenML, we retain the five-fold cross-validation protocol and report fold-wise variability separately from the ten-seed experiments; we do not present those folds as ten independent runs. We thank the reviewer for stressing statistical robustness, which motivated the updated tables in Section 4.1 (Tables 1,2), Appendix D.3 (Table 9), Section 4.2 (Table 3), Appendix D, and Appendix F.