- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes CoSTAR, a model-agnostic external module designed to improve multivariate time series forecasting without altering the underlying backbone architecture. CoSTAR operates in three stages: (1) Low-Rank State Factorization, which extracts a low-rank common component from the input and passes the residual to the backbone; (2) Statistical Context Encoding, which summarizes the latent common trajectory using four window-level statistics (mean, standard deviation, final state, and endpoint difference); and (3) Adaptive Residual Correction, which decodes this context into a gated residual forecast added to the backbone's prediction. Evaluated on 8 long-term and 4 short-term benchmarks, CoSTAR demonstrates consistent improvements, reducing horizon-averaged MSE in 29 out of 30 backbone-dataset pairs when integrated with 5 different forecasters.
Critical strengths
-
CoSTAR operates purely via the input/output interfaces of the backbone forecaster, completely avoiding the need to access or modify hidden representations. This ensures high modularity and ease of integration with diverse architectures
-
The module achieves broad and consistent accuracy gains. Across 30 backbone-dataset pairings, it improves horizon-averaged MSE in 29 cases, with reductions up to 72.4% for SparseTSF on PEMS04.
-
The added computational cost scales linearly, keeping the parameter and memory overhead remarkably low. Plug-in efficiency diagnostics prove that CoSTAR introduces minimal inference latency compared to baseline networks.
-
The framework elegantly supports scenarios where the pre-trained backbone is entirely frozen, enabling efficient task-specific adaptation. The frozen-backbone configuration successfully recovers a significant fraction of the joint-training performance improvements.
Critical weaknesses
-
The choice of the four specific window-level statistics (mean, standard deviation, final state, endpoint difference) is highly heuristic. There is no theoretical grounding explaining why higher-order moments (e.g., skewness) or frequency-domain statistics are ignored, which limits the mathematical rigor of the context encoding.
-
While interpreted as a "common state" extraction, the external module closely resembles an auxiliary linear residual forecaster. The ablation study does not completely dispel the possibility that the gains simply come from an ensembling effect, rather than actual cross-channel denoising.
-
The Low-Rank State Factorization relies on strictly linear channel projections independently applied at each time step. This linear bottleneck might be insufficient to disentangle highly non-linear, complex cross-channel dependencies in real-world multivariate series.
-
The paper promotes CoSTAR as an adapter module but only evaluates it through joint training or frozen-backbone training on the same target task. It lacks a zero-shot cross-dataset evaluation (training CoSTAR on dataset A and testing it frozen on dataset B), which is a standard benchmark for modern adaptive modules.
-
Some recent plug-and-play methods for multivariate time series forecasting are not discussed in the paper, such as: [1] Wang Z, Jin G. Don’t Just Extract, Regulate: Contextual Residual Exchange for Non-stationary Multivariate Stock Forecasting[C]//Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Cham: Springer Nature Switzerland, 2026: 253-270.
Questions for authors
-
Could the authors run an ablation comparing the chosen four statistics (mean, standard deviation, final state, endpoint difference) against alternatives (e.g., max/min pooling, median, or higher-order moments) to empirically justify this heuristic selection?
-
Provide further discussion or a specific experimental baseline to isolate the "common state" extraction from a naive residual linear ensemble. For instance, what happens if is replaced with purely uncoupled linear projections per channel without a low-rank bottleneck ?
-
Given the positioning as an adapter module, providing a zero-shot cross-dataset evaluation (e.g., training CoSTAR+Backbone on Weather and inferring on Solar) would strongly bolster the claims about the robustness of the learned common state representation.