- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper address inconsistent evaluation protocols and the lock of comprehensive assessment in cross-city ST transfer learning. To solve these issues, a standardized benchmark with 23 models acorss 3 learning paradigms is introduced. Results show that transfer learning does not always outperform target-only training, with CrossST and D2MHyper demonstrating the strongest performance across the two core tasks but different robustness trade-offs.
Critical strengths
- This paper pointed out three legitimate challenges that the ST transfer learning is facing: inconsistent evaluation protocels, unclear benefits of transfer learning, and accuracy-only evaluations. A standardized benchmark was proposed to address the challenges above.
- The key findings will be beneficial to this area. 1) transfer learning is not always beneficial, 2) no universally superior method exists
Critical weaknesses
- The novelty of this paper is limited, although it is submitted as a benchmark and dataset paper. It does not introduce any new datasets but just a benchmark framework built on existing public spatio-temporal dataset such as PeMS03, PeMS08, PsME-BAY and METR-LA.
- As a benchmark paper, several important baselines are omitted for comparison such as AdaRNN[1], DSAT-Net[2], TPB[3], TransGTR[4], and TSJT[5]
[1] Du, Y., Wang, J., Feng, W., Pan, S., Qin, T., Xu, R., & Wang, C. (2021). AdaRNN: Adaptive Learning and Forecasting of Time Series. Proceedings of the 30th ACM International Conference on Information & Knowledge Management, 402–411. [2] Tang, Y., Qu, A., Chow, A. H. F., Lam, W. H. K., Wong, S. C., & Ma, W. (2022). Domain Adversarial Spatial-Temporal Network: A Transferable Framework for Short-term Traffic Forecasting across Cities. Proceedings of the 31st ACM International Conference on Information & Knowledge Management, 1905–1915. [3] Liu, Z., Zheng, G., & Yu, Y. (2023). Cross-city Few-Shot Traffic Forecasting via Traffic Pattern Bank. Proceedings of the 32nd ACM International Conference on Information & Knowledge Management, 1451–1460. [4] Jin, Y., Chen, K., & Yang, Q. (2023). Transferable Graph Structure Learning for Graph-based Traffic Forecasting Across Cities. Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 1032–1043. [5] Zhang, Y., Wang, X., Yu, X., Sun, Z., Wang, K., & Wang, Y. (2025). Drawing Informative Gradients from Sources: A One-stage Transfer Learning Framework for Cross-city Spatiotemporal Forecasting. Proceedings of the AAAI Conference on Artificial Intelligence, 39(1), 1147–1155.
Questions for authors
Refer to the weaknessess above
Rebuttal Follow-up
Dear Reviewer 3EhR,
As the Author-Reviewer Discussion period approaches its deadline, could you please take a moment to review the authors' rebuttal?
Thank you for your time and effort!