- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates the limitations of local uncertainty calibration for linear spatial queries. The authors derive a participation-coherence factorisation to explain how spatial dependence affects query-level uncertainty. They demonstrate on several experiments like sea-surface temperature prediction and stochastic PDE settings, and show that ignoring cross-region dependence can substantially distort uncertainty calibration. The authors further analyse coherent covariance modes and explore low-rank corrections to recover query-level uncertainty.
Critical strengths
- The problem is well motivated, and the paper is clearly written and easy to follow.
- Experiments are extensive, checked generative models and PDE numerical solvers to demonstrate the limitations they claim. The range of baselines is sufficient.
Critical weaknesses
- From my understanding the PatchPODiff already generates joint samples and preserves cross patch dependence. So it is a bit unclear how representative this case is practically, perhaps one more experiment on forecasting model actually lose the spatial dependence will be good. And the low-rank correction proposed relies on coherent modes estimated from historical joint samples, which may not be available for case that if the model being used does not generate joint samples. I would appreciate if authors can clarify this point as well.
- Others see questions.
Questions for authors
- How sensitive is R to the number of blocks? For example, would grouping the 300 patches into larger blocks change the SST results much?
- Could the coherent modes for the low-rank correction be estimated without joint samples?
- Section 4.3 evaluates 500 random spatial queries, but the low-rank recovery experiments in section 6.2 mainly focus on five selected linear queries. Could the authors also evaluate the rank-3 correction on these random queries to better understand how well the recovery generalises?
2 comments
I thank the authors for the detailed response and additional experiments. I will maintain my rating.
Response to Reviewer oFzU: Partition Sensitivity, Residual Modes and Random Queries
We appreciate the reviewer's constructive assessment and questions about practical relevance, partition sensitivity and mode estimation without historical joint samples. The revised manuscript includes additional results on all three points.
W1. Why the PatchPODiff intervention is informative. PatchPODiff generates joint posterior samples; it is not an independently tiled generator. This makes its ensemble a useful controlled reference. We remove only the correspondence of sample identities across patches, retaining predictive means, the trained model and every within-patch empirical distribution. The intervention therefore isolates dependence loss when local uncertainty is stored or sampled without global coupling. We now vary the retained block size and evaluate a compact correction rather than leaving it as future work.
Q1. Does the result depend on 300 patches? We repeat the intervention on finer and coarser partitions of the same held-out 2011 SST ensemble (Table 8, Appendix D.5):
Larger blocks preserve more of the original dependence, systematically reducing domain-mean distortion. Query geometry also changes its sign: for the N–S contrast, R falls from 8.73 with 300 patches to 0.48 with two blocks, where independence overestimates variance. Thus the effect is not an artifact of the native partition.
Q2. Can the modes be estimated without historical joint predictive samples? Yes. We form observed-minus-predictive-mean residual fields from 257 days in 2010, project them into the fixed patchwise POD coordinates and extract empirical orthogonal functions. We freeze this basis before the 2011 evaluation. Its leading three directions have absolute cosines 0.987/0.974/0.963 with modes estimated from the 2010 predictive ensemble, eigenvalue ratios 0.98–1.02 and mean squared principal-angle cosine 0.956. The maximum change in canonical-query coverage is 0.6 percentage points. The residual-derived correction has a 2.1 pp mean absolute coverage gap from the retained joint ensemble, compared with 2.3 pp for posterior-derived modes (Appendix F.7). This empirical agreement need not hold for every system, but shows that historical observations and predictive means can suffice here.
Q3. Does rank three recover the 500 random queries? We use the same 250 non-negative aggregates and 250 zero-mean contrasts from Section 4.3:
Rank one largely recovers positive averages but only 13.1% of contrast variance; adding Modes 2–3 restores the sign-changing structure. This demonstrates recovery beyond the five canonical queries. The results appear in Section 6.2 and Appendix D.3 of the revised manuscript; partition sensitivity is in D.5 and residual-based estimation in F.7.