- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a spatio-temporal traffic foundation model named NeoST, which is pre-trained solely using synthetic data. The synthetic data engine simulates second-order stochastic latent dynamics on random graphs through Chebyshev filtering, re-samples generator parameters for each sample, and generates observations through random projection and masking methods. The encoder alternates between node-level temporal attention and node-to-node spatial attention. The reasoner generates multi-scale latent trajectories using multi-stride ChebConv-LSTMs, fuses them through dynamic convolution, and refines them with a Transformer. In the pre-training stage, the output after PCA projection is aligned with the generator’s latent states, plus an observation reconstruction term. In the inference stage, a ridge regression output layer is fitted on the encoder features.
Critical strengths
The pre-training stage uses procedurally generated, graph-coupled stochastic systems, with the generator’s future latent states as supervision information, which is not available in real data. The generator’s Markov structure, heteroscedasticity, spectral bounds, and moment bounds are formally described in Appendix B. This provides a controllable and scalable method to alleviate the data scarcity and bias in spatio-temporal foundation models.
Critical weaknesses
W1. According to Appendix C.4, the ridge regression readout is fitted based on the observations of the target dataset itself, while baselines such as TimesFM and FactoST receive no target-domain calibration. Moreover, it is unclear whether this fitting uses a single window or the entire dataset, and whether it includes the test period. Under LODO, the 96-step results at 137.25 for PEMS03, 221.97 for PEMS08, and 15.08 for PEMS-BAY are all worse than all the baselines in Table 1. Therefore, the long-horizon advantage mainly comes from in-domain calibration, which leaves the core claim that synthetic pre-training brings cross-domain generalization without support.
W2. In Equation 4, the PCA axes are arranged in the order of variance, and the signs are arbitrary, while the basis of comes from the random weights of each sample. Since identifies only up to an invertible transformation, the element-wise Frobenius distance is not identifiable. has rows per time step, but has only rows per patch, and there is no alignment relationship stated between them. The ChebConv-LSTM in the reasoner also rolls out step by step from the historical mean, which is still autoregressive. Therefore, the claimed latent objective and non-autoregressive inference mechanism are inconsistent with the implementation.
Questions for authors
Q1. Is the ridge regression readout based on historical data from each input window or on aggregated observations from the entire target dataset? If aggregated, in which time period is it conducted, and does it include the test period? Can the results be reported based on fitting to the input window alone, with the same linear calibration applied to the baselines?
Q2. In Equation 4, how are the per-time-step and the per-patch aligned? Is PCA recalculated per sample and back-propagated? How do you handle the ambiguity in the order and signs of each component, and the arbitrary basis of ?
S1. Please explain why TimesFM has the same results for METR-LA and PEMS-BAY data in Table 1.
S2. Pre-training NeoST on real data such as LargeST, or on a mixture of real and synthetic data, under the same compute budget and comparing the zero-shot results, would directly test the contribution of synthetic pre-training.
Summary for All Reviewers, Program Chairs, and Readers
We thank the three reviewers for their feedback. Key questions covered synthetic data realism versus real traffic and GANs, evaluation protocol fairness including baselines and test-time adaptation, MS/TR ablation roles, and latent alignment identifiability in Equation 4. We clarified the PEMS family effect with per-dataset stats, ran controlled synthetic versus real pretraining experiments, re-analyzed ablations at full budget with per-step errors, and acknowledged PCA alignment limits while showing practical gains via the alpha sweep. These points do not weaken the core claims.
Regarding this paper, we would like to share our own perspective, which we believe will contribute to the wider discussion. NeoST is the first spatio-temporal foundation model for traffic forecasting that is pretrained entirely on pure synthetic data. Prior to this work, no one had attempted to use purely synthetic data for pretraining in this context. Suitable generative mechanisms had not yet been identified, and few researchers believed that this approach would be successful. We consider this to be a valuable insight. Real-world traffic data is inherently limited in scale and biased towards particular sensor networks and cities. It is also contaminated by uncontrolled noise and missing values. By procedurally generating diverse graph dynamical systems with controllable spectral properties, nonlinearity, and noise regimes, NeoST demonstrates that transferable structural priors can be learned without the use of real data. This reduces reliance on scarce and distributionally skewed observations and opens up a new direction for foundation models in this field. We believe that this contribution alone is substantial. Additionally, we propose a latent alignment loss that differs from conventional pointwise estimation in observation space. Losses computed directly on raw values often cause models to fit local fluctuations and measurement artefacts while overlooking underlying dynamical structures, such as trends, periodicities, and multiscale evolution. By supervising the model towards the principal subspace of the synthetic latent dynamics, the objective encourages the internalisation of structural properties. This approach enables more robust transfer and inference-time correction under distribution shifts. Together with the synthetic pretraining strategy, these elements form the core of the paper. Our responses to the reviewers address the specific questions raised, and we do not believe that they undermine these contributions.
Finally, we would like to point out that, in the current AI era, papers are often examined by LLMs. This naturally results in detailed questions about many specific aspects of a submission. We find this helpful for improving quality, and we are grateful to the reviewers for helping us to strengthen the paper. However, as both authors of this work and reviewers of other ICLR submissions, we would also like to offer a human perspective on evaluating papers. When a submission contains no fundamental errors, such as fabricated data, internal contradictions, or unprofessional writing, and its core contribution remains intact, it is important to consider the inspiration the work can offer readers and the broader community. For example, NeoST demonstrates that a relatively simple generative mechanism can produce substantial spatio-temporal data, sufficient to pre-train a competitive foundation model. Readers may then wonder whether, for future spatio-temporal and even time series foundation models, real data is still necessary for pretraining. Why is this simple generative mechanism effective? Can we propose better mechanisms for synthetic data? Is it necessary to use GANs or diffusion models to synthesise and augment spatio-temporal or time series data? Similarly, regarding latent space alignment, some readers may ask whether, to avoid noise from value domain losses such as MAE or MSE, computing the loss in latent space is a better way to mitigate noise for spatio-temporal and time series data. Could such a training paradigm be used for the next generation of spatiotemporal or time series foundation models? Due to page limits, we could not explore or resolve all these questions ourselves. However, if the paper is accepted, we believe that more readers will have the opportunity to engage with these ideas, which could lead to further advances in the field.
Given our passion for this research and the broader field in which it is situated, we kindly encourage all reviewers, the Program Committee Chair, and all readers of this rebuttal to consider the paper's academic contributions from a human and judgemental perspective, in addition to taking the LLM's comments into account. We also hope that reviewers will reconsider their ratings accordingly. Once again, we would like to thank all the reviewers for their valuable feedback and for helping us to improve the quality of this paper.