- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
In this paper, the authors introduce an SSM-like architecture designed to perform sequence classification in an interpretable manner. To do so, they replace the standard nonlinearity in SSMs (the feedforward MLP) with a nonlinearity based on the phase of each complex coordinate. Using experiments across multiple datasets, they argue that their proposed model has better analytical tractable at no cost to empirical performance. Finally, they use perturbations to show that the model is amenable to interventions that result in switching classification predictions.
Critical strengths
- The proposed architecture is to my knowledge novel, and finds a way to replace the standard feedforward MLP nonlinearity in SSMs without appreciably damaging performance in sequence classification tasks.
Critical weaknesses
-
I think the central claim of this paper regarding the unique advantages in interpretability or "naturalness" of the proposed model is not sufficiently established. For instance, the phrase "grounded in first-principles" comes up repeatedly but is unjustified; why is the standard SSM nonlinearity any less "principled"? I think I somewhat grasp what the authors are trying to get at here, in that the nonlinearity they devise is somehow more recurrent-linear-flavored, but why is oscillator phase the canonical nonlinearity? Why is being able to visualize the phasors more informative/interpretable than being able to visualize MLP activation histograms in standard SSMs in PCA space? Regarding causal control of network predictions, as the paper states, the network output couples eigenmodes in a complicated way, so perturbations along one eigenmode do not cleanly decompose in a predictable fashion, much as is the case in standard SSMs. Maybe it is the case that these perturbations are "cleaner" and easier to find in this model compared to standard SSMs, but no comparative evidence is actually provided here.
-
The organization of the paper is quite confusing; section 2 introduces a bunch of objects and notation for which the shapes and interpretations are not defined, and only in section 3 do some of these things get clarified. It's as if the sections and subsections of 2 and 3 were written in reverse natural order?
Questions for authors
- Is there any reason why an average over time in particular is used in the output in Eq. 6, as opposed to something more generic like an arbitrary linear function?
- Why is fixing the connectivity to be circulant not a major restriction on expressivity?