- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces rdSLDS, which uses Gumbel-Softmax gating over linear transitions, and rSNODE, which replaces these linear dynamics with regime-specific neural ODEs to increase capacity to model complex nonlinear dynamics. models generate trajectories autonomously after initialization from an observation window. The evaluation includes Lorenz dynamics, the piecewise-linear NASCAR system, a newly proposed switching-Lorenz benchmark, and task fMRI data.
Critical strengths
- Developing an end to end differentiable formulation of switching linear dynamical systems is well motivated.
- The switching Lorenz benchmark provides a valuable setting for evaluating models that must capture both nonlinear within regime dynamics and transitions between regimes.
- The emphasis on autonomous trajectory generation is meaningful.
Critical weaknesses
- The paper should more clearly distinguish the contribution of the Gumbel–Softmax relaxation from conventional discrete-state inference in rSLDS. The results visualize a single inferred regime at each time step, whereas the model equations describe a soft mixture of K regime-specific transitions. Are these visualizations obtained by taking the argmax of the mixture weights? During generation, does the model retain the soft mixture or use a hard regime assignment? Clarifying this distinction would help readers understand how relaxation affects the learned dynamics and the interpretation of the inferred states..
- Does the model use any initialization method for the switching dynamics? Or are the switching parameters randomly initialized? Since switching models can be sensitive to initialization, a discussion of its effect on convergence and regime recovery would be useful.
- The baseline comparisons are insufficient to establish the advantages over existing switching models. In particular, a direct comparison with Linderman et al.’s rSLDS is needed to assess the benefits of the proposed differentiable formulation..
- Because recovering meaningful discrete regimes is a central contribution, regime recovery should be evaluated quantitatively.
- The quantitative tables could be presented more clearly. Highlighting the best result for each metric, e.g., using bold, would make comparisons easier to interpret.
- In section B.7.1, the authors state ‘Since MMD operates on the full multivariate trajectory, it captures differences in both marginal distributions and temporal correlations between true and generated dynamics’. However, MMD measures two distribution instead of temporal correlation, the formulation in Equation 19 compares distributions of multivariate observations without explicitly incorporating temporal ordering.
Overall, I appreciate this paper’s idea on autonomous generation instead of only reconstruction. However, several weaknesses should be addressed to strengthen the paper.
Questions for authors
Please see weakness.
2 comments
I thank the authors for addressing my concerns. I now have no further questions and will discuss more with the AC and other reviewers before adjusting my score.
We thank the reviewer for the constructive review and address each point below. Please also see our general response.
Gumbel-Softmax and hard state generation
rSLDS keeps discrete states and infers them by approximate posterior inference (Laplace-EM in ssm). We relax the discrete state with Gumbel-Softmax so the whole model can be trained by backpropagation through rollouts. Training uses the soft mixture (temperature annealed from 1.0 to 0.1); generation uses hard one-hot selection, so the visualized regimes are the model’s own outputs, not a post-hoc argmax (Sections 3.1–3.3). Since soft mixtures can combine vector fields (Poli et al., 2021), we report regime occupancy, which shows whether free runs visit the regimes as often as the true system (Table 6).
Initialization of switching dynamics
Regime dynamics are randomly initialized (ODE weights scaled by 0.5; rdSLDS matrices near the identity; gate with default initialization), without pre-clustering. We report the effect across 15 seeds: failures per model and K (Table 5) and the spread of D_stsp and ARI (Tables 5, 6). rSNODE fails on at most one seed, whereas rdSLDS is sensitive to initialization on switching Lorenz (2, 9 and 11 failed seeds for K = 2, 4, 8).
Comparison to Linderman’s rSLDS
We added rSLDS, fitted and evaluated with the same pipeline (general response, point 4; Appendix C.2, D.5). On the Lorenz systems, rSLDS generally outperforms rdSLDS, which likely reflects its inference of a posterior over the full latent trajectory, compared with rdSLDS’s initial-state inference and rollout-based training; we therefore present rdSLDS as the linear-regime variant of our framework. Since nonlinear switching models trained end-to-end already exist (e.g. SNLDS), we do not attribute rSNODE’s gains to the relaxation itself, which mainly enables training on rollouts. rSNODE reaches a lower D_stsp than rSLDS on chaotic and noisy Lorenz; on switching Lorenz, rSLDS has a competitive D_stsp but diffuse, barely or not chaotic free runs with a higher D_H. On NASCAR, a piecewise-linear system, the linear switching models perform best: rdSLDS on D_stsp, rSLDS on D_H and regime recovery (Tables 5, 6).
Quantitative evaluation of regime recovery
We now quantify regime recovery with the ARI in three versions (gate, free run, and attractor as main measure), together with on-attractor share, coverage and occupancy (Appendix C.1.6, Table 6); details are in our response to Reviewer 8dqf. On switching Lorenz, rSNODE (K = 4) achieves the highest attractor ARI (0.37, vs. 0.21 for rSLDS and at most 0.16 for rdSLDS) and reproduces the true occupancy, but recovery is partial for all models, and we revised our claims accordingly. On NASCAR, rSLDS and rdSLDS identify the regimes best.
Table presentation
All tables now mark the best result per metric in bold and include ground-truth rows and failure counts. We would be happy to improve any other part that is hard to read.
MMD metric
Correct; we fixed the description: MMD on single states compares state distributions and ignores temporal order, as does D_stsp, while D_H captures temporal structure (Appendix C.1.4).
We hope these revisions address your concerns and welcome further questions.