- Rating
- 2
- Confidence
- 4(+2)
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes FORMA, a spatiotemporal forecasting architecture designed for 90-day prediction of evolving geophysical fields, specifically sea-surface temperature (SST) and Arctic sea-ice concentration (SIC). Its main contribution is Field Memory, a recurrent spatial state module that combines an RWKV-style temporal scan with factorized global and local spatial interactions, achieving linear complexity in history length and grid size. To adapt state evolution to nonstationary dynamics, the memory's retention, writing, and spatial propagation operators are regulated by three causal feedback signals: seasonal phase encodings, a date-level observation-reliability descriptor, and learned spatial interface features . The terminal memory state is combined with the latest observation and mapped to all future horizons via a static multi-horizon decoder trained with field, interface, regional-mean, and temporal-difference losses. The authors validate FORMA through a synthetic translating-front diagnostic, 90-day global SST forecasting on NOAA OISSTv2.1, and Arctic SIC forecasting on NSIDC CDR v6, supplemented by ablations on the feedback signals
Critical strengths
Explicitly regulating temporal retention, evidence writing, and local neighbor routing via seasonal phase and spatial gradient/threshold interfaces is a clean conceptual design. It directly addresses the coexistence of slow seasonal modes and sharp moving boundaries in geophysical fields while maintaining bounded state propagation ().
The same architecture transfers from global SST to Arctic SIC, achieving consistent improvements in both bulk field accuracy and front/ice-edge localization.
Critical weaknesses
Weaknesses
-
The novelty boundary needs sharper positioning. Observation-dependent propagation of spatial recurrent states has precedents such as TrajGRU (Shi et al., 2017). The normalized factorization in Eq. (9) also follows the aggregation form used in Efficient Attention (Shen et al., 2021). FORMA’s contribution appears to lie in integrating these mechanisms with seasonal, reliability, and interface conditioning. The paper should explain more clearly what this integration enables beyond existing adaptive recurrent architectures.
-
The comparisons do not sufficiently isolate the proposed memory mechanism. The matched RWKV control removes seasonal, reliability, and interface conditioning together with spatial propagation. Likewise, the no-interface variant also removes interface supervision. These comparisons establish the benefit of the complete system, but leave the architectural contribution entangled with additional information and training objectives. This matters because removing seasonal conditioning causes a particularly large degradation.
-
Given the strong effect of seasonal conditioning, the current results leave uncertainty about how much improvement comes from predicting anomalous evolution and interface displacement. A focused evaluation of forecast skill beyond the seasonal background would substantially strengthen the central claim.
Questions for authors
-
How much of the improvement remains when a strong recurrent baseline receives the same seasonal and reliability inputs and comparable training objectives? Can the interface supervision be retained while changing only the spatial update?
-
Does FORMA retain its advantage over seasonal climatology and anomaly persistence, particularly for anomalous conditions and fronts or ice edges displaced from their usual seasonal positions?
-
What is the exact construction of the reliability score , and which quality variations in the original observation products explain its substantial benefit on unperturbed histories?
11 comments
Response to Reviewer HdHV (Continued)
W3. Does the phase gain reflect skill beyond the seasonal background?
A3. We understand why the large phase effect raises this question. Phase regulates all three operations of Field Memory. Table 4(a) examines this coupled design: removing phase, reliability, or the interface components raises area RMSE from 93.9 to 153.9, 120.7, or 112.8, respectively. Each contributes to the performance of the full architecture; the no-interface ablation includes its associated supervision.
This ablation measures phase within FORMA; comparing the ablated model with another architecture cannot isolate the latter's benefit from phase. We therefore project and broadcast the same five phase features into each baseline, preserving its backbone, losses, and training protocol. Without/with phase, area RMSE is 102.0/101.8 (3D U-Net), 103.4/103.1 (Earthformer), 117.0/116.5 (STDMamba), and 153.9/93.9 (FORMA), in .
These controls highlight FORMA's effective use of seasonal context. Our extensive experiments and related studies [3,4] offer clues about architecture and conditioning, without fully explaining the gain's magnitude or when comparable gains arise. We report this observation and the controls faithfully.
We also appreciate your suggestion to evaluate departures from the seasonal background. After subtracting training-only seasonal means, the day-90 anomaly correlation is .390 for FORMA versus .345 for 3D U-Net. On displaced SST fronts, boundary distance is 98.6 versus 109.7 km. These measures directly assess anomalous evolution and interface location, complementing the evidence for the integrated design. This explanation and evaluation will be included in the revised manuscript.
Q1. What remains with matched inputs and losses? Can interface supervision be retained?
A1. Yes. Table R1 retains identical inputs and all five losses: the area-RMSE gains are 10.5% over conditioned ConvLSTM and 12.1% over self routes. The latter changes only memory propagation, preserving both interface heads, targets, and loss weights. Its transport coefficient remains 0.1 and route weights 1/2, with each operator's row sum preserved.
Q2. Does the advantage extend beyond climatology and anomaly persistence, especially for unusual interfaces?
A2. Our experiments prioritize modern forecasting architectures because our contribution is a new memory mechanism. This is a deliberate research choice. We take issue with the emphasis on these elementary references: it gives insufficient attention to the methodological work and comparisons already presented. We provide the requested comparisons below, while maintaining that they supplement the evaluation of our architectural contribution.
We subtract training-only (1982–2018) location-specific day-of-year means from predictions and observations. Anomaly correlation is the area-weighted normalized inner product of predicted and observed anomaly fields, averaged over test origins.
Table R2. Lead-day SST. RMSE: . Table 1's 93.9 covers the full 90-day window.
| Lead day | FORMA RMSE | FORMA anomaly correlation | 3D U-Net anomaly correlation |
|---|---|---|---|
| 30 | 87.5 | .694 | .670 |
| 60 | 99.1 | .572 | .529 |
| 90 | 111.6 | .390 | .345 |
With , the skill score against seasonal climatology is .429/.275/.092 at days 30/60/90; against anomaly persistence, −.030/.081/.095. Anomaly persistence performs slightly better at day 30, while FORMA achieves lower MSE at days 60 and 90. Dates, masks, and weights are identical.
References
[3] Zeng et al. Are Transformers Effective for Time Series Forecasting? AAAI 2023. https://arxiv.org/abs/2205.13504
[4] Wang et al. TimeXer. NeurIPS 2024. https://arxiv.org/abs/2402.19072
Response to Reviewer HdHV (Final Part)
A2 (continued). Event subsets.
Day-90 event subsets use training-period, season-specific 90th-percentile thresholds for area-weighted anomaly magnitude or displacement from the seasonal boundary. All models share cases; test observations define retrospective groups.
Table R3. Event subsets. Units: SST errors, ; IIEE, million km²; symmetric boundary distance, km. n counts forecast origins.
| Subset (n) | Metric(s) | Baseline model | Baseline value | FORMA |
|---|---|---|---|---|
| Strong SST anomalies (126) | Anomaly RMSE / correlation | 3D U-Net | 148.6 / .682 | 137.4 / .731 |
| Displaced SST fronts (112) | Interface RMSE / distance | 3D U-Net | 164.8 / 109.7 | 151.2 / 98.6 |
| Displaced SIC edges (118) | IIEE / distance | IceMamba | 143.8 / 79.1 | 137.9 / 74.6 |
Relative to the neural forecasting baselines in Table R3, FORMA reduces the first-listed error by 7.5%, 8.3%, and 4.1% on the strong-SST-anomaly, displaced-SST-front, and displaced-SIC-edge subsets, respectively. Symmetric boundary distance decreases by 10.1% on displaced SST fronts and 5.7% on displaced SIC edges.
We also compare against seasonal climatology and anomaly persistence on the same subsets. In the same subset order, the first-listed error decreases by 24.6%, 18.4%, and 14.0% relative to seasonal climatology, and by 7.8%, 6.7%, and 5.0% relative to anomaly persistence.
Q3. How is q constructed, and which original-data quality variations explain its benefit?
A3. Thank you for asking how the score explains the clean-history result. It is computed as where is the pre-imputation valid fraction within the supplied mask, or full grid if none is supplied. Coverage and finite-value weights combine into 0.55; 0.20 includes the default metadata contribution. is the mean absolute change over jointly valid cells in consecutive normalized fields. SST uses training-only 0.5/99.5 percentile bounds, clipped to [0,1]; SIC uses [0,1]. At the first dataset date or without valid pairs, .
“Clean history” means no artificial corruption was applied. With full valid coverage, : temporal consistency still varies. This signal summarizes the changing input evidence, including real dynamics. OISST also has interpolation uncertainty and evolving observational inputs [5], but those product properties are not separately identified by this scalar.
The no-trust variant fixes q at one throughout temporal decay, retention, writing, and global routing, and removes its write multiplier. Thus, 120.7 versus 93.9 tests conditioning on day-to-day consistency. The same q change can accompany real field evolution or an observation artifact; this ablation does not distinguish those causes. It supports using this summary of incoming evidence to regulate memory updates. This explanation will be included in Appendix B.3.
Thank you for your careful review and constructive suggestions. We will further clarify the contribution of Field Memory and detail the matched ablations, forecast-skill evaluation, and reliability-score construction in the revised manuscript and supplementary materials. We will also release the source code to facilitate reproduction of the results and further research.
References
[5] NOAA/NCEI. OISST. https://www.ncei.noaa.gov/products/optimum-interpolation-sst
Response to Reviewer HdHV
Dear Reviewer HdHV,
We sincerely appreciate your time and effort in reviewing our paper. Thank you for your positive assessment of FORMA’s conceptual design, particularly recognizing that explicitly regulating retention, evidence writing, and local routing through seasonal phase and interface features addresses the coexistence of slow seasonal modes and sharp moving boundaries. We also appreciate your recognition that this design maintains bounded state propagation. We are glad that you acknowledged the transfer of the same architecture from global SST to Arctic SIC, with consistent improvements in field accuracy and front/ice-edge localization. We hope our responses below address your concerns. We would greatly appreciate it if you would consider updating your score in light of these clarifications and results.
W1. The novelty and advantages of Field Memory.
A1. Our contribution is a field-valued predictive state whose retention, writing, and propagation jointly respond to seasonal phase, reliability, and interfaces. This coupling lets persistent context survive while new evidence updates moving boundaries, and lets stored evidence interact at both local and basin scales throughout the historical scan. This unified memory has linear cost in history length and grid size at fixed width and rank.
TrajGRU [1] adapts recurrent connections using the input and previous state. FORMA couples temporal evidence accumulation with explicit retention, writing, and complementary global/local transport, conditioned on the observed field and its context. Efficient Attention [2] aggregates values projected from current features; FORMA uses its factorization to transport accumulated memory under new observations.
Eq. (11) expresses how each dated write contributes through subsequent transitions; Appendix C bounds propagation with factors and writes fixed. Table 4(a) supports the conditioning components, and SST/SIC results show the design's forecasting value. This explanation will be included in the revised manuscript.
W2. Additional ablations to isolate the memory mechanism.
A2. Thank you for this question. We evaluate the complete coupled mechanism under matched inputs and supervision, then examine spatial exchange within it.
The original ablations examine components within this design. We additionally replace the complete Field Memory block with ConvLSTM. Both receive identical field/validity, phase, q, and interface features through the same input adapter, retaining the encoder, decoder, interface supervision, five losses and weights, data splits, and checkpoint-selection rule. Each model is trained separately.
The temporal-only control retains the encoder, temporal accumulators, input mixing, retention and write gates, and decoder. It removes only the memory-transport term while keeping the retention coefficient fixed.
Table R1. Matched information and supervision. Errors in 10−2∘C.
The 10.5% area-RMSE reduction over ConvLSTM evaluates the complete mechanism. The self-route variant separately replaces global/local operators by their row-sum diagonals, retaining retention, writing, input mixing, and supervision. Its 12.1% gap tests spatial exchange within Field Memory. Interface heads, targets, and losses remain active in both comparisons.
References
[1] Shi et al. TrajGRU. NeurIPS 2017. https://arxiv.org/abs/1706.03458
[2] Shen et al. Efficient Attention. WACV 2021. https://arxiv.org/abs/1812.01243