- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper quantifies uncertainty for spatial distributions represented by event locations over an entire period. Events are encoded as empirical probability measures on the sphere, and a conformal prediction set is constructed using spherical sliced Wasserstein (SSW) distance. An empirical manifold constraint based on proximity to training empirical measures is introduced to restrict spatial configurations that deviate from historical patterns. The paper bounds the additional miscoverage induced by this constraint and derives a coverage bound for the underlying distribution after enlarging the set. A constrained velocity field generates candidate distributions. Simulations and cyclone and earthquake case studies illustrate trade-offs between manifold discrepancy (MD) and energy distance (ED).
Critical strengths
The prediction target is an entire period's spatial distribution rather than a single location or scalar, making the problem relevant to spatial statistics and geoscience.
The theory explicitly distinguishes empirical measures from underlying distributions and quantifies the coverage cost of the additional constraint.
The authors acknowledge limitations involving temporal splitting, the sampling-error radius, and the interpretation of the generated ensemble. The experiments also show that the constraint is not uniformly beneficial across datasets.
Critical weaknesses
-
The relationship between the theoretical constraint and the implementation as described is unclear. Equation (8) measures proximity to a single complete training empirical measure, whereas Section 3.3 describes pointwise matching to pooled reference support. These distances are generally different, leaving the connection between the numerical outputs and the theoretically defined set unresolved. Moreover, the constraint is operationally a union of SSW balls around training measures; no smooth-manifold structure is assumed or established. The terminology should distinguish empirical proximity from geometric manifold estimation.
-
The reported real-data coverages of 11/13 and 15/15 concern the ambient SSW ball and do not establish coverage of its intersection with the empirical manifold constraint. The stated lower bound, , applies when , where is the training leave-one-out maximum defined in Equation (10). Smaller tolerances are not covered by this guarantee, and the bound can be substantially below the nominal level when the training sample is small.
-
The practical benefits and scientific interpretation require stronger evidence. The constraint mainly improves MD, which is aligned with its optimization objective, whereas ED does not improve consistently. Proximity to historical patterns alone does not establish physical consistency. Although the authors acknowledge that set coverage does not imply calibration of arbitrary ensemble summaries, the practical calibration of ensemble-derived quantities remains unestablished. Temporal dependence and distribution shift further limit the applicability of the coverage guarantee.
Questions for authors
-
Does the velocity field use the distance in Equation (8), or the SSW distance between the candidate cloud and the locally matched reference cloud described in Section 3.3? If the latter, how is it related to the theoretical constraint, and what fraction of generated outputs satisfies the constraint when evaluated using Equation (8)?
-
Can the authors separately report coverage of the ambient SSW ball, the empirical manifold constraint, and their intersection, and explain how the additional coverage loss is accounted for within the target miscoverage budget?
-
Are coverage and predictive scores stable under rolling calibration using only historical data and evaluation on consecutive future periods? How are interannual dependence and long-term distribution shift addressed?
-
Can the authors provide geographic or scientific evaluation metrics independent of the empirical manifold constraint, together with numerical constraint residuals, failure rates, and step-size sensitivity?
-
Beyond proximity to historical spatial patterns, what evidence supports the claimed geophysical coherence? How does the constraint behave for genuine but rare or shifted spatial configurations?
-
Apart from the change in prediction target and spherical geometry, what technical developments go beyond existing OT-based conformal methods (e.g., Thurin et al., 2025; Klein et al., 2025) and the nearest-neighbor conformal argument of Feldman et al. (2025)? Can the authors distinguish these developments from the combination of established components?
3 comments
Response to Questions 4, 5, 6 from Reviewer LmYu
Question 4)
This is a great point and something the other reviewers have asked about. For each of the real data analysis examples we have included additional geographic validation based on independent data. We have included the full table of comparisons in the global response, which shows that the proposed CVF attains the independently derived geographic boundaries more frequently than VF.
We also agree with you in which diagnostics related to the flow should be reported. We will report the fraction of generated clouds satisfying each and both constraints in the final manuscript. For the earthquake example, only one sample generated was found to be outside of manifold tube. For tropical cyclone genesis locations, all samples were contained within the manifold tube.
Question 5)
"Beyond proximity to historical spatial patterns, what evidence supports the claimed geophysical coherence?"
For these two applications, geophysical coherence has a directly observable spatial component. Tropical cyclone genesis is geographically constrained by known genesis climatology, while earthquake occurrences are structurally tied to fault systems. We believe the additional tests provided in our official comment directly evaluate these aspects of geophysical coherence.
Question 6)
We apologize that we did not make the distinction between our work and prior work sufficiently clear. Our contributions beyond these existing approaches are: 1) constructing prediction sets that jointly combine forecast uncertainty with proximity to an empirical data manifold, and 2) developing a particle-flow representation of these sets, which would otherwise be intractable sets over spaces of measures.
Thurin et al. and Klein et al. use optimal transport to construct ranks from multivariate nonconformity scores and form prediction sets for multivariate data. In our setting, SSW distance measures discrepancy between a candidate distribution and the forecast distribution, producing a scalar nonconformity score. These approaches use OT to rank multivariate scores for multivariate responses, whereas we use an OT metric to define a scalar score between distribution responses.
We were not aware of Feldman et al. at the time of writing and have now added this work to the discussion. Their nearest neighbor construction is also distinct from our manifold restriction. We define
\in \arg\min_{\nu:\operatorname{supp}(\nu)\subseteq A} W_2(\mu,\nu),$$ followed by $$d_{\mathrm{pool}}(\mu;A) = SSW(\mu,\nu_A^*(\mu)),$$ which is minimized when the individual events comprising the candidate distribution are close to historically observed locations. Feldman et al. instead use $$d_F(\mu)=\min_j W_2(\mu,\widehat P_j),$$ which favors candidate distributions resembling a single observed training distribution. We initially considered this latter construction, but found through the particle flow that it produced underdispersed samples. Moreover, our prediction sets are centered around the forecast distribution and then restricted by empirical spatial support, whereas Feldman et al. construct balls around training observations. These therefore represent different notions of uncertainty. A further technical contribution is the representation of the resulting manifold-intersected prediction sets. We extend the flow-based representation of Harris (2026) to the intersection of a conformal ball and an empirical support restriction. This requires finding point clouds that simultaneously satisfy the chosen conformal level and the tolerance for proximity to pooled training locations. We derive a joint particle velocity enforcing both conditions. Repeating this construction across conformal levels produces a predictive ensemble of spatial distributions. This goes beyond geometric characterization or membership testing by providing sampled forecast scenarios that can be directly evaluated using distributional scores. The closest general framework to ours is Lugosi and Matabuena (2025), which we had not cited originally and have now included following reviewer QFR5. Their work develops conformal prediction for general metric spaces, and our ambient construction using spherical sliced Wasserstein distance can therefore be viewed as an instance of metric conformal prediction. Their framework already accommodates distribution-valued responses, which we now clarify in Section 3.1. Our additional contribution is to restrict this ambient prediction set using proximity to the pooled spatial support of the training data. Their kNN procedure selects observations with nearby covariates to estimate a local prediction radius. Our nearest neighbor operation instead matches individual candidate event locations to historical event locations, imposing an additional constraint on the spatial distributions admitted by the prediction set. We then provide the particle-flow construction needed to represent this intersection in practice.Thanks for your explanations and the additional results.
Response to Critical Weaknesses and Questions 1,2,3 from Reviewer LmYu
Critical Weakness 1)
Thank you for helping us identify this inconsistency in our notation. The correct definition should have been the one in Section 3.3. The definition in Eqn. ~8 was a holdover from a previous iteration of the paper. We have updated our definition and proposition 3.1 in response to this fix. Because question was raised by all reviewers, we have included a more detailed response in our global response at the top. We have updated the definition in Eqn ~8 and updated Proposition 3.1 to use this definition. Proposition 3.1 only changes in the 1/(n+1) term, which is now 1/(ntrain+1) instead of 1/(ncal+1).
Thank you for identifying that the terminology can imply a stronger geometric assumption than the method requires. We do not estimate a smooth differential manifold, and the coverage argument does not require differentiability, curvature, or a fixed intrinsic dimension. The statistical object is empirical proximity to a family/support of historically plausible distributions. We will make this explicit and use terms such as ''empirical support proximity'' or ''empirical plausibility tube'' where greater precision is needed.
Critical Weakness 2)
Yes, you are correct in that the theory holds when ϵ≥ϵ^ and not when ≤, however, we choose ϵ^=ϵ. This is a conservative finite sample lower bound rather than an expected empirical coverage.
Critical Weakness 3)
Yes, we shared the same concerns in the real data, however, our temporal diagnostics in the appendix (Table 8 and 9) show no strong evidence of substantial trend, serial dependence over time, or shifts between the calibration and test conformity scores. We interpret these analyses as empirical checks that we can not reject the assumption that the scores are exchangeable.
Question 1)
The constrained velocity field uses the manifold penalty described in 3.3, we have updated the notation that will replace Eq. 8. in the official comment.
We replaced Eq. 8. since it was a hold over from a previous version. For the correct Eq. 8. 20 out of 21 of the tropical cyclone genesis CVF samples satisfied the manifold tube constraint, while all 26 earthquake samples satisfied the manifold constraint.
Question 2)
Yes, we will provide the ambient ball coverage, the manifold coverage, and the intersection of the two in the updated manuscript as in the official comment. The manifold coverages for the real data examples had 13/13 coverage for tropical cyclone genesis and 15/15 for earthquakes meaning their intersection coverage is 11/13 and 14/15 respectively. The earlier 15/15 ambient coverage for earthquakes was updated after rechecking the ambient coverage. For the simulations Figure 2 shows that if we set ϵ too low then we incur a loss of coverage. However, if we set it to the calibrated number or higher we do not lose any statistically discernible coverage.
Question 3)
This is a great idea. Although our statistical checks (Tables 8 and 9) did not show evidence of serial correlation or distribution shift, it stands to reason that tropical cyclones and earthquakes, which may depend on slowly evolving processes, may not be exchangeable year to year. We have updated our results to include an additional adaptive conformal method (Xu and Xie, 2021, Conformal Prediction Interval for Dynamic Time-Series, ICML) to construct a rolling prediction set. The results show that, at α=0.10, ambient SSW coverage on tropical cyclones is 12/13=0.923. When we include the manifold constraint, the coverage is unchanged. The same 12/13=0.923. tropical cyclones were covered. For earthquakes at the same α coverage was 14/15=0.933 using the adaptive method. Again, all 15/15 held out yearly distributions satisfy the calibrated localized manifold condition, so manifold restricted coverage is still 14/15=0.933.