- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes SFCATime, a spectral–semantic framework for multivariate time-series forecasting. It introduces soft spectral assignments for frequency-dependent representations and AdaptiveMask attention to regulate interactions between numerical and language-derived features. Experiments on eight benchmark datasets report competitive MSE and MAE results, supported by ablation studies and visualizations. The overall design is interesting, but I have serious concerns about the evaluation protocol and the reliability of some reported results.
Critical strengths
-
The paper addresses an interesting forecasting problem. Combining spectral representations with semantic information is a reasonable direction.
-
I appreciate the adaptive design of the spectral assignments and cross-modal attention. The two components have clear motivations and are relatively easy to understand.
-
The evaluation covers eight datasets, with encouraging forecasting results. The ablations and visualizations also provide some useful insights into the proposed modules.
Critical weaknesses
-
The evaluation protocol is a major concern. Appendix A.2 explicitly states that test MSE is used for hyperparameter optimization and checkpoint selection. This makes the reported test results unreliable as independent generalization evidence.
-
I noticed inconsistencies in Table 1. The ETTm2 UniTime averages do not match the reported values, and the ILI iTransformer MSE–MAE pair appears mathematically inconsistent.
-
Novelty is somewhat limited. The framework largely extends T3Time, while adaptive frequency modeling and cross-modal attention have already been explored. I am not fully convinced that the proposed modifications represent a substantial methodological advance.
-
The contribution of individual mechanisms is not sufficiently isolated. In particular, the AdaptiveMask ablation removes multiple operations together, making their separate effects difficult to judge.
Questions for authors
-
Why was test MSE used for checkpoint and hyperparameter selection? Could the authors rerun the experiments using validation-only selection and report the updated results?
-
Could the authors clarify the numerical inconsistencies in Table 1, particularly the ETTm2 averages and the ILI iTransformer MSE–MAE values?
-
What is the main methodological difference between SFCATime and T3Time? Could simpler frequency-adaptive projections achieve similar improvements?
-
Could the authors separately ablate the signed attention correction and residual modulation? I would also like to see whether the language representations provide meaningful improvements over simpler alternatives.