- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper investigates semi-supervised learning for switching dynamical systems. It proposes a mode-dependent dynamical variational autoencoder (DVAE), which is essentially a sequential VAE with an additional discrete mode variable that modulates the latent state evolution. The semi-supervised learning algorithm is based on variational inference and aims to identify the dynamical modes. The method is validated on synthetic datasets.
Critical strengths
None
Critical weaknesses
Main weaknesses. The paper studies switching dynamical systems and presents its key contribution as a semi-supervised learning strategy that identifies discrete latent values.
- This is not a novel contribution, as related works [Blau+24, Teng+20, Fassmeyer+22] have already studied semi-supervised learning for switching dynamical systems (or a similar class of models: sequential generative models with discrete modes). The paper fails to cite these critical works and, therefore, fails to explain how its contribution differs from theirs.
- The experimental evaluation falls below the standards expected of an ICLR submission: it includes neither baselines from related works (e.g., Teng+20, Fassmeyer+22, Blau+24, Dong+20, Ansari+21) nor experiments on real-world data. Adding these baselines and experiments would require a major revision and another round of review.
Other issues
- The assumption of independent modes is not well justified.
- The paper characterizes switching state-space models as follows: "While switching state-space models define a joint distribution over states and modes, their unsupervised modes cannot be steered, so they cannot predict outputs under a chosen regime". This is incorrect. Since these models define a joint distribution over states and modes, one can simply fix the mode variable to a predefined value. What requires additional effort is matching mode values to their real-world interpretations, but the models can still make predictions under a chosen regime.
References
- [Teng+20]: Semi-supervised sequential generative models. Michael Teng, Tuan Anh Le, Adam Scibior, Frank Wood.
- [Fassmeyer+22]: Semi-Supervised Generative Models for Multi-Agent Trajectories. Dennis Fassmeyer, Pascal Fassmeyer, Ulf Brefeld.
- [Blau+24]: A study of animal action segmentation algorithms across supervised, unsupervised, and semi-supervised learning paradigms. Ari Blau, Evan S Schaffer, Neeli Mishra, Nathaniel J Miska, The International Brain Laboratory, Liam Paninski, Matthew R Whiteway.
Questions for authors
None
Dear Reviewers, The authors have now submitted their responses to the reviews. There is only a limited amount of time left for you to review their replies and provide any further comments.
Your feedback is crucial to ensure that the review process proceeds smoothly. We would greatly appreciate it if you could share your reactions before the discussion period closes.
Thank you very much for your work. Best regards.