- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
Learning Chaos Without Seeing Chaos investigates whether autoregressive transformers trained on short observations from restricted dynamical regimes can recover unseen long-term behaviour. It demonstrates period-doubling cascades, chaos and multistability using scalar maps, the three-variable Lorenz system and the two-variable generalized Hopf system. Its main contribution is structural extrapolation beyond the training regime, although scalability to spatially extended PDEs remains untested. The small models suggest modest training requirements, but computational simplicity does not show much effort to this paper. I would like to reject this paper accordingly.
Critical strengths
The evaluation examines long-term dynamical structure beyond one-step prediction accuracy. Numerical bifurcation verification and controlled interventions on parameter-conditioning pathways provide useful evidence about the learned models’ behaviour.
Critical weaknesses
-
Insufficiently established additional insight over simpler models. Appendix D shows that an MLP reproduces a period-doubling cascade of the same order, while Table 3 reports substantially lower distributional errors for polynomial NVAR. These results do not invalidate the transformer observations, but leave the significance of the transformer-focused contribution insufficiently established. The intervention analysis demonstrates that parameter information affects predictions, without fully explaining why extrapolation succeeds.
-
Restricted experimental scope and uneven quantitative fidelity. Validation is confined to small maps and low-dimensional ODEs, leaving applicability to spatially extended or higher-dimensional systems untested. Moreover, reproducing Feigenbaum scaling does not establish accurate bifurcation placement: the reported transition locations exhibit seed-dependent displacement. Although the paper acknowledges this distinction, stronger evidence is needed to establish the broader significance of its structural-extrapolation results.
I recommend rejection. The observations are interesting, but the additional insight beyond simpler predictors and the generality of the conclusions are not sufficiently established.
Questions for authors
- Contribution beyond simpler models: The MLP reproduces a cascade of the same order, while polynomial NVAR achieves lower distributional errors. What additional scientific insight does the transformer analysis establish beyond these baselines?
- Scope and limitations: With validation restricted to scalar maps and low-dimensional ODEs, which conclusions do you expect to extend to higher-dimensional, spatially extended systems? What factors would limit this extension?
We have decided to withdraw this submission from ICLR. We sincerely thank all the reviewers for their time and detailed feedback, and before closing the discussion, we would like to clarify several points about the focus of our paper and what our results establish.
We will take the time to revise and strengthen the work before submitting it elsewhere. We appreciate all the reviewers’ efforts, which have helped us identify substantial opportunities to clarify our contribution and further improve our work.