Major:
-
In lines 303 ~ 335 of scripts/train_baseline.py, the classification pipeline loads the official training/test splits but does not create a separate validation set, which is inconsistent with the Val/Test Split configuration reported in Table 5, although it is unclear whether this script was used for those experiments. In addition, test accuracy is evaluated after every epoch and used for early stopping and checkpoint selection, and this checkpoint is subsequently evaluated on the same test set. The authors are suggested to clarify which reported results were produced using this pipeline and how an independent held-out evaluation was ensured.
-
In lines 266–300 of scripts/train_baseline.py, the direct data loader fits a StandardScaler on the entire set before training/validation/test split, which introduces preprocessing leakage as the statistics of vaildation and test influence the transformation applied to the training data. The scaler should be fitted exclusively on the training set.
-
The configuration of the Regression Datasets in Table 6 in Appendix F.2 indicates that the model predicts only one numeric variable, while the script predicts only the first numeric variable one step ahead. Although this could be regarded as a single-step forecasting setting, this evaluation does not establish performance across multiple-step horizons or on multivariate-output forecasting tasks. Please clarify the scope of the forecasting claims.
-
Table 6 caption states that plain backbones are trained on truncated time series (T=2,000) while CR-enhanced variantes process the full sequences, which makes unfair and confounded comparison. Comparisons using matched input lengths would help isolate the contribution of the CRP module.
-
In Table 7, the highest mean classification accuracy of the presented model does not show consistent performance (the std values of its performance on SCP-2, Motor, and Heartbeat are relatively high) and does not establish consistent superiority across datasets. Therefore, the authors are encouraged to provide uncertainty estimates for the performance differences and discuss the conditions under which the method is beneficial or less effective, preferably in a separate Limitations or Discussion section.
-
The CRP module is presented as broadly applicable to time-series modeling in both Abstract and Introduction, but its empirical evaluation is limited to classification and one-step forecasting. Its applicability for temporal localization (such as anomaly detection) and pointwise reconstruction (such as imputation) remains underexplored. The authors could either provide supporting evidence for these broader applications or clarify the scope of their claims and discuss how signature compression might affect such tasks.
-
The following reference entries require correction:
- "The great multivariate time series classification bake off: a review and experimental evaluation of recent algorithmic advances": The journal name is lost.
- "Dynamic covariance models for multivariate financial time series": The third author should be listed as Zoubin Ghahramani rather than Ghahramani Zoubin.
Minor:
- The expanded classification comparison in Table 7 covers only four datasets. Evaluating a broader subset of the UEA archive would strengthen the evidence and facilitate comparison with prior MTSC studies, such as TVNet [1], TimesNet [2], and ConvTimeNet [4].
- The computational efficiency, cost, and memory comparisons in Appendices G.2 and G.3 primarily cover state-space- and attention-based models. Broader efficiency claims would benefit from comparisons with more diverse architectures, including convolution- and frequency-based models such as TVNet [1], TimesNet [2], TSLANet [3], and ConvTimeNet [4]. Otherwise, the claim should be limited to efficiency improvements over the evaluated state-space- and attention-based baselines.
- The citation for Mamba in line 77 is unresolved and appears as "Mamba (?)". Please correct the citation.
- Figure 9 contains an isolated “t” that appears unrelated to the surrounding content. Please check whether it is unintended and remove it if appropriate.
References for reviews:
[1] Li, Chenghan, Mingchen Li, and Ruisheng Diao. "TVNet: a novel time series analysis method based on dynamic convolution and 3D-variation." International Conference on Learning Representations. Vol. 2025. 2025.
[2] Wu, Haixu, et al. "Timesnet: Temporal 2d-variation modeling for general time series analysis." arXiv preprint arXiv:2210.02186 (2022).
[3] Eldele, Emadeldeen, et al. "Tslanet: Rethinking transformers for time series representation learning." AI for Time Series. CRC Press, 2024. 35-57.
[4] Cheng, Mingyue, et al. "Convtimenet: A deep hierarchical fully convolutional model for multivariate time series analysis." Companion Proceedings of the ACM on Web Conference 2025. 2025.