- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a seasonality-aware hybrid convolutional Transformer framework for monthly Antarctic sea ice concentration (SIC) forecasting. The framework combines UNet-based spatial feature extraction with factorized spatio-temporal self-attention to capture local spatial patterns and long-range temporal dependencies. To explicitly incorporate seasonal information, the authors introduce two components: Month-aware Positional Encoding (MonthPE), which uses Fourier-based embeddings to represent annual periodicity, and Seasonal Temporal Attention Bias (SeasonBias), which incorporates a learnable periodic bias into temporal attention scores. The model uses 12 months of historical SIC observations to autoregressively forecast up to 12 future months. Experiments on the NSIDC Antarctic SIC dataset compare the proposed approach against statistical, convolutional, recurrent, and dynamical forecasting baselines, using both regression and classification metrics. The reported results demonstrate competitive forecasting performance, while ablation studies and attention visualizations provide additional evidence for the effectiveness of the proposed seasonality-aware components.
Critical strengths
-
The proposed MonthPE and SeasonBias mechanisms explicitly incorporate seasonal periodicity into feature representations and temporal attention, respectively. These designs are well motivated by the pronounced annual variability of Antarctic sea ice and provide an interpretable way to introduce domain-specific prior knowledge into the forecasting framework.
-
The hybrid architecture combines convolutional encoding and decoding with factorized spatio-temporal self-attention at a compressed feature resolution. This design enables the model to capture both local spatial structures and long-range temporal dependencies while maintaining computational feasibility for high-resolution SIC forecasting.
-
The authors evaluate the proposed framework against statistical, dynamical, convolutional, and recurrent forecasting baselines using multiple regression and classification metrics. The experiments cover forecasting horizons of up to 12 months, while ablation studies across two backbone architectures and attention visualizations provide additional evidence supporting the effectiveness of the proposed seasonal components.
Critical weaknesses
-
The proposed framework primarily combines existing techniques, including CNN/UNet architectures, factorized spatio-temporal attention, Fourier-based positional encoding, and cosine-based attention bias. Although these components are reasonably integrated for Antarctic SIC forecasting, the methodological innovations appear incremental. The paper does not sufficiently distinguish MonthPE and SeasonBias from existing periodic encoding and relative positional bias mechanisms.
-
The effectiveness of the proposed seasonal priors is not fully substantiated. In particular, SeasonBias is formulated solely based on the relative temporal distance between input months, and the default 12-month input window does not explicitly enable comparisons between the same calendar months across different years.
-
The paper lacks comparisons with alternative seasonal encoding strategies or conventional relative positional biases, leaving it unclear whether the improvements arise from explicitly modeling seasonal periodicity or simply introducing additional temporal inductive biases.
-
The experimental evaluation mainly focuses on conventional convolutional and recurrent baselines, with limited comparisons against more recent spatio-temporal forecasting architectures.
-
The paper does not provide detailed computational complexity analysis, such as parameter counts and FLOPs.
-
The ablation results reveal inconsistent improvements: for example, MonthPE alone degrades the one-month prediction performance of the UNet-based model, while combining MonthPE and SeasonBias does not consistently outperform MonthPE alone at the 12-month horizon.
Questions for authors
Please responds to my concerns in the weaknesses.