- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies precipitation nowcasting and proposes DySP, a spectral prior-guided framework that exploits the temporal coherence of spectral envelopes to improve future radar frame prediction. The method combines wavelet-based spectral representation, latent spectral prior modeling, future envelope prediction, and envelope-conditioned attention to guide content reconstruction. In addition, temporal-difference skip connections are introduced to preserve evolving spatial structures across forecast lead times. Experiments on three benchmarks demonstrate competitive forecasting performance compared with existing methods. However, some issues remain regarding the justification of the spectral envelope representation, the effectiveness of future prior prediction, the actual contribution of spectral envelopes, and the evaluation of computational efficiency. Further clarification and validation are needed to strengthen the paper's contribution.
Critical strengths
- The paper introduces a spectral envelope representation based on wavelet detail coefficients to characterize the temporal evolution of precipitation structures, providing an alternative perspective for modeling spectral dynamics in precipitation nowcasting.
- The method combines spectral guidance with temporal-difference skip connections to capture spectral dynamics while preserving evolving spatial structures during multi-step forecasting.
- The proposed method is evaluated on three precipitation nowcasting benchmarks, and the experimental results demonstrate competitive performance compared with existing methods.
Critical weaknesses
- Although spectral envelopes exhibit higher temporal correlations than signed wavelet detail coefficients, this does not necessarily demonstrate their effectiveness in improving precipitation forecasting. The authors should provide a more theoretical explanation of how spectral envelopes capture precipitation dynamics relevant to future prediction and clarify its advantages over existing frequency-domain methods.
- The future spectral prior is generated through linear temporal projection, and the future envelope is subsequently derived from the predicted prior. However, the suitability of linear projection for modeling complex precipitation dynamics remains insufficiently justified. The authors should compare it with more expressive temporal modeling methods and analyze how prior and envelope prediction errors affect final forecasting performance.
- Although spectral envelopes are presented as a central motivation in introduction section, their role in the proposed architecture is mainly limited to attention gating and auxiliary supervision. The authors should provide stronger evidence that spectral envelopes contribute meaningful information beyond latent priors and conventional attention modulation.
- Although the proposed method achieves competitive forecasting performance, its computational cost is not sufficiently evaluated. It would be helpful if the authors could provide the comparison of computational cost, such as model parameters and FLOPs.
- Although the Related Work section discusses several frequency-domain methods, the experimental comparison is limited to AlphaPre and SDIR. The authors are encouraged to include additional frequency-domain forecasting methods and provide a more comprehensive comparison to clarify the advantages of the proposed spectral envelope representation over existing methods.
Questions for authors
- The paper shows that spectral envelopes exhibit higher temporal correlations than signed wavelet detail coefficients. Can the authors clarify whether this property translates into improved forecasting performance, beyond the benefits of the latent spectral priors and attention modulation?
- The future spectral priors are generated through linear temporal projection. Can the authors clarify the rationale for this design and provide evidence that it can adequately capture the complex temporal evolution of precipitation systems?
- The paper emphasizes spectral envelopes as a key motivation, but their role in the architecture appears mainly limited to attention gating and auxiliary supervision. Can the authors clarify how the envelope representation contributes to the final forecasting results beyond these mechanisms?
2 comments
Dear Reviewer Nq9e, Thank you again for your time and detailed feedback. Do our additional experiments and clarifications address your concerns? We are more than happy to clarify any remaining questions.
Thank you for the comments on the spectral representation and temporal modelling.
W1 & Q1. Why envelopes help, and how they differ from other frequency-domain methods
Envelopes average Haar-detail magnitudes over local windows. A constant patch has zero detail response regardless of its mean intensity; boundaries and intensity changes produce responses at the relevant scales and orientations. Taking magnitudes avoids cancellation between opposite signs, while pooling reduces sensitivity to position within each window. Fourier amplitudes describe the whole field; envelopes preserve where detail activity occurs. DySP predicts this map to guide reconstruction, while SDIR uses spectrally filtered predictions for iterative refinement.
In Table 4, the backbone's mean CSI is 0.4283. Adding spectral guidance alone gives 0.4516, temporal differences alone give 0.4545, and both give 0.4613. In Table 5, mean CSI is 0.4516 with envelope supervision, 0.4468 without it, and 0.4457 with pooled-intensity guidance. Envelope guidance also has higher CSI at every threshold, higher SSIM, and lower MAE than pooled-intensity guidance.
W2 & Q2. Linear temporal projection
Spectral Dynamics applies nonlinear spatial and temporal attention before TP (Sec. 3.1). For each forecast lead, the projection learns to combine these historical features; it initially repeats the last state. Predicted envelopes have higher correlation with future targets than persistence: 0.560 vs. 0.478 on SEVIR, 0.569 vs. 0.532 on Shanghai, and 0.528 vs. 0.496 on CIKM (App. D.3).
Prior errors can change attention and feature updates through the Q/K offsets, gates, and shifts in PGSTBs (Eqs. 4–5). The predicted envelopes are auxiliary outputs. Both envelope and radar losses train the priors (Eq. 12). Replacing forecast guidance with last-frame guidance lowers mean CSI by 0.0165/0.0310/0.0161 on CIKM/Shanghai/SEVIR (Table 6).
W3 & Q3. Role of envelopes beyond gating and auxiliary supervision
The Wavelet Encoder takes detail magnitudes as input. Lprior supervises the historical and future priors, and Lwav compares pooled detail magnitudes of the final forecast. The priors control Q/K offsets, output gates, and additive shifts in all four PGSTBs of the second stack (Eqs. 4–5).
With envelope targets fixed, magnitude input gives mean CSI 0.4516, compared with 0.4350 for pixel input and 0.4308 for signed wavelets (Table 5). Using both conditioning routes gives 0.4516, versus 0.4418 for gate-and-shift alone and 0.4362 for Q/K alone. Removing the envelope loss leaves the magnitude input and both routes unchanged, but lowers mean CSI to 0.4468 and CSI at 40 dBZ from 0.3166 to 0.3060.
W4. Computational cost
Table 10 (App. F) reports SEVIR 5→20 costs at 256×256, batch 1, on one RTX 4090 D. FLOPs include sampling and VAE encode/decode. Measurements use FP32; DySP's training-memory measurement includes gradient checkpointing.
DySP has fewer parameters, uses fewer FLOPs and less training memory, and runs faster than DiffCast, AlphaPre, SDIR, and FlowCast. The spectral pathway and its injection layers add 5.0M parameters and 113 GFLOPs (4.8% of total FLOPs). FACL has lower cost than DySP on all four measures.
W5. Additional frequency-domain baselines
FACL (NeurIPS 2024) uses the official SimVP implementation and FACL loss, with the same training settings as DySP (Sec. 4.1; App. B). Tables 1–3 report scores from the final scheduled checkpoint. Best scores within each dataset are bold.
Among the baselines, FlowCast has the highest mean HSS/CSI on SEVIR, while SDIR leads on Shanghai and CIKM. DySP's SEVIR scores are 8.3%/9.7% higher than FlowCast's. FACL adds a baseline trained with Fourier losses.