- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The main goal of this paper is to improve the physical consistency of pretrained weather forecasting models without retraining or substantial additional inference cost. Authors proposes Intermediate Gradient Guidance (IGG), a training-free method for improving the physical consistency during sampling. To improve the constraint satisfaction of sampling, IGG calculate the normalized gradient for the correction based on the noisy state rather than the clean state. The authors verify the method on GenCast and Atlas with hydrostatic-balance and dry-air-mass objectives. The result show improvements in physical-residual agreement with low computational overhead.
Critical strengths
- The method demonstrates improvements across two forecasting backbones, GenCast and Atlas
- Authors provide abundant ablation study to empirically support the proposed method.
Critical weaknesses
1. Insufficient justification of the method.
While the experiments support the method’s empirical effectiveness, a logical gap remains between reducing constraint violations in a noisy state and improving constraint satisfaction in the final output. Since intermediate-state residuals may reflect sampling noise rather than the constraint violation in the clean output, the resulting guidance direction may be inaccurate for the final objective. The paper therefore needs a clearer conceptual or theoretical justification for this connection
2. Marginal novelty.
The proposed method is simple and closely follows MPGD, with the main modifications being the gradient evaluation point and correction scaling. These changes appear incremental, and their combination does not clearly establish a substantial methodological advance beyond the existing guidance framework. Moreover, insufficient justification on the proposed approach further limits the contribution of this work.
Questions for authors
1. Justification for the guidance based on noisy-state
The justification for evaluating physical residuals on noisy intermediate states is insufficient. These states are not yet clean forecasts, so their constraint violations may not be the correct update for the overall final output. To fully support the proposed approach, the paper needs a clearer theoretical or conceptual link demonstrating why noisy-state gradient corrections provide an effective direction for constraint satisfaction of final output, rather than relying solely on empirical performance
2. Comparison with clean-state based correction.
It is recommended to provide an analysis of the relationship between noisy-state and clean-estimate corrections, $g_{\text{noisy}} = \nabla_{z} L(z) $ and $g_{\text{clean}} = \nabla_{z} L(\hat x) $. Measuring their cosine similarity and norm ratio across sampling stages would clarify how their directions and magnitudes differ. Applying both directions with the same correction weight and compare their results would further help to demonstrate the noisy-state correction as a useful surrogate of the clean-state correction.
3. Empirical support in image generation
The proposed method is presented as a general guidance approach rather than a domain-specific weather forecasting technique. However, the experiments are limited to weather models and atmospheric constraints. An additional image-generation experiment comparing IGG with clean-estimate guidance would help to demonstrate the benefits of the proposed approach, correction using noisy-state.