- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents a distance metric for comparing dynamical operators by constructing persistence-ordered invariant flags, or nested sequences of invariant subspaces ordered by decay time. By leveraging chordal distances and establishing an isometric Euclidean embedding, the proposed method provides a gauge-invariant metric capable of comparing operators with differing subspace dimensions. The overall idea and its theoretical foundation are highly elegant.
Critical strengths
-
Principled Geometric Framework: The proposed approach elegantly resolves the trade-off between eliminating gauge ambiguity and preserving timescale hierarchies (decay times) via persistence-ordered invariant flags (Propositions 1 and 2).
-
Clear Domain Motivation: Combining the method with DMDc effectively isolates external forcing from internal dynamics, providing a compelling motivation for climate data analysis.
-
Informative Visualization: Figure 1 offers an exceptionally clear and intuitive schematic overview of the proposed framework.
Critical weaknesses
-
Over-reliance on Indirect Clustering Metrics: The empirical validation relies heavily on the Silhouette Score, which measures cluster separability rather than whether the intrinsic global geometry or continuous distance relationships are faithfully preserved.
-
Sensitivity to Observation Noise: In the synthetic experiments (Figure 2, bottom), the Flag distance yields a lower Adjusted Rand Index (ARI) than the naive Raw A baseline under increasing observation noise, revealing potential algebraic sensitivity during Schur decomposition and eigenvalue sorting.
-
Insufficient Validation on Real Climate Data: In Section 3.2 (CMIP6), the evaluation remains limited to cluster separability via Silhouette Scores, leaving it unproven whether the proposed metric captures meaningful climate-physical similarities.
Questions for authors
-
Direct Metric Space Validation: Since Proposition 1 establishes an isometric Euclidean embedding, could you evaluate the global metric accuracy directly such as by examining the eigenvalue spectrum (explained variance ratio) of the Gram matrix derived via Young-Householder transformation (cMDS), rather than relying solely on Silhouette Scores?
-
Robustness Under Observation Noise: What explains the lower Adjusted Rand Index (ARI) of the Flag distance compared to Raw A under observation noise in Figure 2? Does this stem from algebraic sensitivities during Schur decomposition or eigenvalue sorting?
-
Inappropriateness of the Euclidean Baseline: Why does the naive Euclidean baseline yield a score close to zero across almost all panels in Figure 2? Given its consistently poor performance, is it a suitable baseline for evaluating dynamical operator comparisons?
-
Physical Grounding in Climate Data: Beyond cluster separability in Section 3.2, is there qualitative or quantitative evidence demonstrating that the Flag distance preserves meaningful climate-physical relationships across CMIP6 models and reanalysis data?
3 comments
I appreciate the authors’ sincere responses to my questions and the deeper analysis they carried out. While Silhouette score alone remains an indirect proxy for metric quality, the newly added PERMANOVA-style variance partitioning ( in App. J), ARI on CMIP6 (Fig. 4b), and physical interpretations (Sec. 3.2) effectively complement it and sufficiently address my concerns. Accordingly I have upgraded my score (2->3).
We are glad to see the positive assessment of the reviewer. We remain available as we enter the last hours of the discussion period for any additional remarks.
Thank you for calling the idea and its theory elegant, and for highlighting how flags reconcile gauge invariance with the timescale hierarchy, the DMDc motivation, and Figure 1.
W1 and Q1. We have added the suggested classical MDS analysis (App. J, Fig. 13). Because dFL is a Frobenius distance between tuples of projectors, cMDS on all positive eigenvalues reproduces every pairwise distance exactly. On CMIP6, the negative mass is zero to machine precision, which confirms the Euclidean embedding of Prop. 1 numerically. The spectrum also reflects cluster structure: four ESM centroids span at most three coordinates, and there the flag carries more variance than the Grassmannian on every variable (36% against about 30% on OSAT). This ratio only bounds the variance due to clusters from above, so we also report the exact between/within partition from the same Gram matrices. Model identity explains 35% of the flag variance on OSAT and SAT (Grassmannian: 29% and 28%), while the Euclidean baseline stays at the chance level of 1%. On synthetic data, cluster membership explains 99% of the flag variance. Beyond silhouette, we now also report ARI on CMIP6 (Fig. 4b).
W2 and Q2. We now run the observation-noise ablation at a shorter trajectory length T=50 (Fig. 2). This is a harder setting with operators less fit on the dataset. Yet, in this setting, Flag keeps the highest silhouette and matches or exceeds every baseline in ARI. We do not hide the fact that Flag is worse than Raw A for longer trajectories. New Fig. 5 (App. G) shows that the ARI gap depends on record length: the flag leads or ties for T≤50, and from T=70 and above, Raw A leads at intermediate noise. The Schur step is backward stable, so this gap comes from the fitted A itself. We hypothesize that attenuation pushes the less persistent modes toward the noise floor, so the deeper levels of the flag select different modes across trajectories. We have not yet been able to isolate the cause of the gap and report it as open in App. G.
W3 and Q4. Sec. 3.2 now interprets the distances physically. For OSAT and SAT, members of one ESM are closer to each other than to other models or to 20CRv3 (Fig. 8), so the persistent modes and their order are a structural property of each model. For SLP, the fast and weakly persistent atmospheric variability blurs these differences without erasing them. Where the distance behaves unexpectedly, the cause is dynamical, since on SAT the fast modes of CESM2 decay within about one fit step and change order across members (Fig. 12), which a single member cannot reveal. Members of one model also differ in their distance to 20CRv3 about as much as the models' medians do (Fig. 7), so no model is systematically closer to the reanalysis. Finally, the flags carry physical content. The 20CRv3 OSAT flag places two slow real modes, combining Atlantic and Pacific multidecadal variability, before an ENSO-like pair, whereas all ESM medoids and most members begin with that pair (Figs. 9 and 10). This is consistent with the underestimated multidecadal variability in models (Kravtsov et al., 2024) and with the single-member analysis of Mankovich et al. (2026), and a single subspace, which ignores the order of the modes, would miss it.
Q3. This near-zero score of the Euclidean baseline is expected. Because the clusters share eigenvalues, the only signal lies in the eigenvectors, and a coordinate-wise distance cannot align their arbitrary sign and phase. The variance analysis in App. J confirms this: cluster membership explains 3% of the Euclidean variance (the chance level), compared with 99% for the flag distance. We therefore keep the Euclidean baseline as a control for gauge dependence and have added SGOT as a stronger baseline. We are happy to move it to the appendix if the reviewer prefers.