- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors propose Neural Stochastic Processes (NSP), which extend a spatial Neural Process with stochastic latent transitions to correct satellite precipitation using sparse ground stations and topography. They also introduce QPEBench, a benchmark focused on the CONUS region with satellite, gauge, elevation, and radar data. NSP outperforms 17 baselines and enables latent extrapolation during gauge outages.
Critical strengths
- Promising stochastic temporal modeling. The latent SDE regularizer is an interesting idea, particularly for predicting during gauge outages. This could complement or replace temporal conditioning in existing spatio-temporal Neural Processes.
- Valuable benchmark contribution. QPEBench integrates relevant data sources, temporal splits, and evaluation procedures for precipitation estimation. The extensive supplementary experiments and planned code and dataset release are positive contributions.
Critical weaknesses
- Evaluation protocol and benchmark robustness. The main radar errors are restricted to radar-rainy pixels, ignoring false-positive rainfall, while gauge metrics include context stations rather than focusing on held-out locations. The benchmark also lacks the Critical Success Index (one of the main precipitation forecasting metrics), CRPS (for probabilistic assessment), and spatial generalization analysis (since these are not complete and do not compare all methods). The Gaussian likelihood is also poorly suited to zero-inflated, heavy-tailed precipitation, particularly for extremes, so baselines like ConvCNP are not properly adapted for this task. A unified evaluation using held-out stations, all-pixel errors, CSI/POD/FAR, CRPS, calibration, and appropriate predictive distributions is needed.
- Insufficiently competitive baselines and unclear SDE contribution. The paper overlaps substantially with “From Drops to Grid: Noise-Aware Spatio-Temporal Neural Process for Rainfall Estimation”. However, it does not compare against it or other recent spatio-temporal Neural Processes. Existing baselines are mostly older architectures, and learned baselines use different training objectives despite receiving comparable inputs. The latent SDE is a promising contribution, particularly for predicting during gauge outages, but its benefits are not sufficiently established and highlighted. The paper would benefit from focusing more on this contribution, with stronger comparisons against modern temporal models and deterministic alternatives, rather than emphasizing broad benchmark improvements.
Questions for authors
- How do the main results change when evaluating exclusively on held-out stations and all radar pixels, including false-positive rainfall? Could the authors provide a unified comparison using also CSI/POD/FAR and CRPS?
- Could the authors compare against DropsToGrid adapted to satellite inputs and other recent spatio-temporal Neural Processes, ensuring comparable inputs, training objectives, and evaluation protocols?
- What specific advantages do stochastic latent transitions provide over deterministic alternatives or temporal conditioning on historical station observations?