- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper ask whether distinct AI weather models produce similar internal representations. The authors use five different similarity scores, representing five different metric families, and null calibrate each one to remove background variation. They then compare 6 AI weather models under these similarity scores and find moderate to strong similarity between the different models. This effect is most pronounced within model families, e.g. between graphcast variants, and within specific latitude bands such as the midlatitudes, and is consistent across the five metrics.
Critical strengths
- This is an important and timely topic due to the recent proliferation of AI weather models. It could be useful to understand whether the models are learning similar (unresolved) processes or whether they are learning something very different. In which case, we may need to combine their strengths to further improve performance. Moreover, if representational similarity implies prediction correlation then high similarity might cause multi-model ensembles to severely underestimate predictive variance. If these models are used to estimate risk, then poor calibration would invalidate their risk estimates.
Critical weaknesses
-
This work needs to more clearly motivate its problem and interpret its results in greater depth. In particular, Sections 1 or 2 need an clear explanation on why model similarity is important, what representation similarity captures that functional similarity does not, and why these metrics were chosen and what, specifically, they capture and how they differ. Moreover, it needs to establish if we should expect models to be similar or not and whether this indicates good or bad behavior across models. The figures in Sections 4 and 5 show that many AI weather models have similar internal representations, but the following analyses do not investigate why they are similar or what this implies. For example, could this mean all models share systematic biases? Could they all be under or over representing variability? Do they all lack certain parameterization or components such as ocean circulation dynamics or ice cap dynamics? More broadly, what do these similarities imply for forecasting performance, multi-model ensembles, and (potential?) limitations of current AI weather models? This topic warrants a much deeper investigation into the potential causes and implications of these similarities. The JJA dip in the midlatitudes in Figure 5 might be very telling here.
-
This paper does not introduce new methodology. Prior work on climate model validation and comparison has developed new methods and shown why they are capturing a relevant quantity of interest and how these methods would interest the broader ML community. While this application could itself be a valuable contribution, the paper does not sufficiently demonstrate what the analysis reveals about current AI weather models. Its not clear how modelers should use these results to improve their models or whether this has any implications on forecasting performance.
Questions for authors
-
Why does representation similarity matter and what insight does it provide about model behavior? Figure 2 validates representational similarity by showing its near 1-1 correspondence with functional similarity, so why not use one of the many functional similarity notions? Does representation similarity reveal something that functional does not?
-
What is the motivation for each of these metrics? Figure 4 seems to show that CKA, RSA, and distance correlation are highly correlated, and similarly 2nd order cosine and orthogonal procrustes are also highly correlated. Why were these metrics specifically chosen and do they show differing behavior that is not present in this figure?
-
Should we expect models to exhibit similarity because they are capturing the same physical processes or should we expect them to be dissimilar since they are independently generated? Which "way" are these tests being conducted? What might be driving these similarities?
-
Are the p-values distributed uniformly under the null? The data are highly correlated so its not obvious that a permutation null will be uniform without further correction.
-
Why should null calibration remove background variation, rather than just artificially lowering the statistic values? Couldn't background variations manifest in high similarity scores?
2 comments
(Part 2 of reply)
Q3: This is the fundamental question. We would like to know whether the models “exhibit similarity because they are capturing the same physical processes or should we expect them to be dissimilar since they are independently generated”, but the answer is not straight-forward because we don’t know how physical processes would be represented in the models. At least, there is no evidence that they are solving the same equations or making the same approximations as conventional NWP models. This motivation has been emphasised in the introduction and future work sections.
Q4: The structure-preserving calibration introduced in this paper accounts for much of the spatial and temporal correlation in the data, but satisfies exchangeability only approximately, for example because of static variables such as the land-sea distribution. The p-values are therefore only approximately uniform under the null, so we treat them as a supporting diagnostic and base conclusions primarily on the calibrated scores. This is clarified in Appendix A.4.
Q5: Background variations, such as the equator-pole temperature gradient and the seasonal cycle, do produce high raw scores even without correspondence in the weather state, which is why calibration is important. For example, two locations at the same latitude and time of year have broadly similar temperature profiles regardless of the weather systems present. The calibration doesn’t just artificially lower the raw score - for each model pair and metric, a similarity threshold τ is computed from that pair’s own null realisations (which retain the background structure). Large background similarity therefore increases τ along with the raw score, leaving a smaller calibrated score that measures similarity beyond the shared latitudinal and seasonal structure (see Figure 13 as an example of raw and calibrated scores). As a result, the calibrated ordering can differ from the raw ordering, this is seen in figure 9 where AIFS-Aurora and AIFS-GC Small have the same raw CKA (0.54), but calibrated values of 0.10 and 0.29.
References: Craig et al. 2026, The physics of AI weather models, https://arxiv.org/abs/2605.23778 Klabunde et al. 2025, Similarity of Neural Network Models: A Survey of Functional and Representational Measures, https://dl.acm.org/doi/10.1145/3728458 Cloos et al. 2024, Differentiable Optimization of Similarity Scores Between Models and Brains, https://arxiv.org/abs/2407.07059 Selz & Craig 2026, Can AI‐Based Weather Prediction Models Simulate the Butterfly Effect? The Role of Architecture and Implementation, https://publikationen.bibliothek.kit.edu/1000194866
(Part 1 of reply)
Thank you very much for taking the time to thoroughly go through our manuscript. Below we respond to the critical weaknesses (W) and questions (Q) raised.
W1 (motivation), (and Q1&3): Our study is motivated by the hypothesis that AI weather models converge towards a shared learned description of the atmosphere, as explored in Craig et al. 2026. Under this hypothesis, similarity would be expected between all model pairs. Functional similarity is not sufficient to test this, because the models produce skilful forecasts, especially at 6 h, they will likely have a close functional similarity independent of whether they share similar internal mechanisms. Figure 2 is included as an initial check that, within each model, functional changes correspond to changes in the representational similarity metrics, noting that this need not hold between different models. Interestingly, though monotonic, it is not exactly 1-1, and the relationship varies depending on the metric, indicating that different similarity metrics calculate similarity in slightly different ways. All tests are one-sided, whereby the null hypothesis is that similarity does not exceed that expected from the shared latitudinal and seasonal structure. We’ve updated the introduction to make our hypothesis clearer. Regarding what drives the similarity, we have additionally compared untrained versions of the models (Appendix A.12). Calibrated similarity between the untrained models is close to zero for nearly all pairs, indicating that the similarity between the trained models arises predominantly through training rather than from the architecture or input data alone, consistent with this hypothesis.
W1 (implications): Knowledge gained from calculating the similarity could have implications for understanding features of AI weather models as well as development. For instance, shared representations could imply that sources of weaknesses may be shared too. This is consistent with Selz & Craig 2026, who find that the failure of AI weather models to reproduce the rapid growth of small initial perturbations is largely independent of model architecture. As you have mentioned, shared representations could also lead to correlated errors and underdispersive multi-model ensembles. We have updated the discussion accordingly, together with concrete follow-up experiments which could include relating pairwise similarity to forecast-error correlation. A full investigation of the causes is unfortunately beyond the scope of this first study.
W2: While the similarity measures themselves are well-established, applying them to atmospheric data is not straightforward, as unrestricted permutation nulls are inappropriate due to destroying the latitudinal and seasonal structure. We therefore consider our key contribution to be the structure-preserving calibration, which retains this structure and provides an appropriate baseline from which to judge similarity. The importance of this calibration is shown in Figure 3, where one can see the raw CKA is far larger than the calibrated values. We have updated the contribution section of the introduction to make this clearer.
Q1: As noted in the reply to W1 regarding the motivation above, a high degree of functional similarity does not necessarily imply representational similarity, or that the models have learned a common internal understanding of the atmosphere. If this were true, as our results seem to indicate, it could form the basis of further research to identify what that understanding is, and how it relates to the current understanding, which is based mainly on the fluid equations. The discussion of this motivation in the future work section has been extended and made more specific.
Q2: A variety of metrics were chosen because it has been shown that there is no one single measure which best measures the representational similarity. Therefore, to test whether there was significant similarity, it is important to use a variety of measures. These specific metrics were chosen because they span the main families of Klabunde et al. 2025 and have a variety of different invariance properties (Table 2). CKA, RSA and distance correlation are RSM-based measures, second-order cosine is neighbourhood-based, and orthogonal Procrustes is alignment-based. Procrustes was in addition particularly chosen as it is less dominated by high-variance components than CKA (Cloos et al., 2024), consistent with its faster decrease in Figure 2. The high correlation within families in Figure 4 is therefore expected, along with differences appearing between families in the rankings (e.g. which model is most similar to GraphCast, Section 4.1). We have updated section 2.2 to make this clearer.