- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper introduces Traffic24, a San Diego traffic dataset spanning September 2001 to September 2025. It contains approximately 505.6 million station–time records from 261 traffic nodes at five-minute resolution, combining traffic measurements, data-quality indicators, and regional weather data aggregated from 25 weather stations. The authors provide a unified data schema and preprocessing pipeline and benchmark 29 models for one-step-ahead speed prediction using the preceding hour of speed observations. XGBoost achieves the lowest reported MAE and RMSE among the evaluated models.
Critical strengths
Traffic24 integrates 24 years of traffic observations with temporally aligned regional weather data, providing a resource for studying long-term changes in traffic patterns, cross-year generalization, and the impact of weather conditions on traffic prediction performance.
Critical weaknesses
1. More direct empirical evidence would help substantiate the dataset’s distinctive value. Traffic24 primarily curates and integrates two existing data sources—PeMS traffic records and MesoWest weather observations—through temporal alignment and regional weather aggregation. Its extended temporal coverage and inclusion of weather information are potentially useful. However, the reported benchmark focuses on five-minute-ahead speed prediction using only historical speed observations. It does not compare different historical training spans, evaluate the contribution of weather information, or explicitly examine temporal distribution shift. The current experiments therefore provide limited evidence of the benefits of the dataset’s distinguishing features. Focused comparisons addressing these aspects would help clarify its contribution relative to existing resources.
2. Some passages leave the completeness of the submission and the reproducibility of its analyses unclear. For example, Section 6.2 states:
“These plots are descriptive: the figure does not specify the station-grouping rule or the treatment of missing and flagged values, so the apparent between-group gradient should not be interpreted as a validated population-level finding.”
This caution is reasonable, but the grouping criteria and preprocessing procedures used to generate the plots should also be documented so that readers can assess the analysis. Similarly, the Reproducibility Statement reads:
“All benchmark models are run with the open-source TimeCopilot framework. The dataset, anonymous download link, and exact evaluation code/configuration are not included in the source package and must be supplied or described before submission.”
It is unclear whether this statement refers to the current submission or an earlier stage of preparation. There is also a discrepancy between the claim that the full evaluation protocol is provided and the acknowledgment in Section 6.1 that split boundaries and missing-window handling are unspecified. Clarifying these statements and providing the corresponding materials and methodological details would help readers assess the submission and reproduce its analyses.
Questions for authors
-
Could the dataset, along with the code used for its construction and evaluation, be made available as supplementary material or through an anonymous repository?
-
Which historical data configuration and station set were used in the reported experiments? What were the exact dates of the training, validation, and test periods, and how many valid samples were included in the evaluation?
-
Were the models trained independently for each station or jointly across stations? If the training setup differed across models, please specify the setting used for each.
-
Could you compare shorter and longer training histories while keeping the test period, station set, and sample-construction rules fixed to assess the value of the extended historical coverage? Similarly, a paired comparison of traffic-only and traffic-plus-weather inputs under the same evaluation conditions would help establish the contribution of weather information.