- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how to select pre-trained stochastic neural operators for specific path-dependent events. DLCD scores candidate models using local drift, covariance-sensitive increment statistics, and occupancy in reference-defined regions. The experiments suggest that the method can improve model selection when only a limited number of diagnostic trajectories are available.
Critical strengths
Good agreement on global statistics does not necessarily mean that a model can accurately predict threshold-crossing events, so this is a useful problem to study. The comparison with direct event estimation is particularly helpful. The budget sweep shows when DLCD helps and where its advantage begins to weaken. The second Allen–Cahn cohort provides additional evidence. I also appreciate that the paper reports pools and conditions where DLCD performs worse.
Critical weaknesses
Appendix M states that the released records do not include the original evaluation horizon, the reference population used to estimate the quantiles, or the interpolation convention. These choices define the event being measured. Without this information, I find it difficult to assess the reported 9.3% improvement. The proposed replication protocol is useful, but it does not establish which settings were used in the reported experiments.
DLCD includes an occupancy component, while P2 does not. The paper acknowledges this and proposes adding that component to P2. I would like to see this experiment carried out, since it seems important for understanding how much of the improvement comes from the new residual construction.
Questions for authors
Table J.3 reports a regret of 0.0292 when 4,096 paths are allocated uniformly across eight candidates. This appears to correspond to 512 paths per candidate, but Table 1 reports 0.0251 at that budget. The two tables may use different evaluation protocols; if so, that difference should be clearly stated.
2 comments
Response to rebuttal
Thank you for providing the response. I decide to maintain my original score. While the authors provided additional ablation results, the method itself appears to have an overkilled complexity for the marginal performance gain with simple method like DIRECT-D1.
Thank you for recognizing the importance of path-dependent selection, the direct-event estimator comparison, the budget sweep, the separately trained Allen-Cahn cohort, and the inclusion of adverse pools and conditions. We answer the three questions in the review directly.
1. Exposure-controlled P2: yes, DLCD retains lower mean regret in both cohorts. At frozen B = 512, the comparison on F-M is 0.02693 original P2 / 0.02610 P2 + exposure / 0.02510 DLCD; on independently trained N-U it is 0.03055 / 0.02990 / 0.02926. Relative to P2 + exposure, DLCD achieves 3.83% and 2.14% lower mean regret. The additional feature accounts for a meaningful part of the original P2 gap but does not eliminate it. The experiment addresses the reviewer's question using the already specified Appendix N comparator and without changing the submitted DLCD method. These are cohort means; original P2 favorable-pool counts are not relabeled as counts for the new comparator.
2. Kolmogorov event definition and interpretation. The original six KF pools test the enstrophy event in Section 5.3: cross a DEV-reference q90 threshold and persist above q85 for 0.05T. The reported six-pool regret is 0.03913 DLCD versus 0.04313 P2, with KF4 unfavorable. Appendix G specifies a distinct event-level replication protocol at T = 10 with a 201-point monitor, 0.5-unit dwell, and explicit interpolation/censoring. We do not equate these prospective choices with unidentified historical settings. The original released scientific-unit tables reproduce the reported six-pool comparison, while the paper's independent N-U cohort supplies a separate and fully specified held-out candidate-training replication. These historical and independent-replication protocols are distinct and serve complementary evidentiary roles.
3. Tables 1 and J.3: comparison of study definitions. The primary Table 1 result (0.02510) aggregates the fixed B = 512 per candidate-condition evaluation across C0-C3 and eight F-M pools. The Table J.3 uniform row (0.02920) belongs to a separately recorded fixed-total candidate-library allocation study with a 4,096-trajectory total budget. Therefore, 4,096/8 = 512 does not establish identical per-condition allocations, diagnostic draws, or pool-level selections. These two reported averages should not be treated as duplicate estimates from an identical experimental protocol. Table 1's primary result can be reconstructed from its pool-level records. The fixed-total release includes only policy-level aggregates, so it does not permit attribution of the 0.00410 difference to a specific execution factor. We will clarify the distinct study and budget definitions.
The exposure-controlled comparison strengthens the original fixed-budget evaluation, while the Appendix J allocation study remains a separate analysis rather than a replication of the primary fixed-B result. The new exposure-controlled experiment, the separately trained Allen cohort, and the original budget, localization, and adverse-case analyses jointly support the practical value of decision-localized physical selection in its stated regime.