- Rating
- 4
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper defines the exponentially weighted signature; a generalization of LSSMs by increasing the depth (not layers) of an iterated integral of paths. A thorough theoretical analysis is provided in which it is demonstrated that LSSMs are equivalent to a depth-one exponentially weighted signature (EWS). The authors support their arguments experimentally via multiple results on synthetic and real-world benchmarks where EWS consistently outperformed a wide, and appropriately selected set of related models. The paper is well-written, grammatically consistent; not requiring any revision. An excellent work that, if published, provides are substantial step forward in our understanding and construction of parallelizable models for time series.
Critical strengths
Well written; mathematically consistent and more-than adequately thorough; Appendix provides additional experiments that strengthen the claims made by the authors.
Critical weaknesses
The paper would not be accessible for readers who are not familiar with controlled differential equations, even with their inclusion of a "background" section in Appendix. A lighter introduction in the main text would improve readability; an unexplained anomaly in EthanolConcentration requires an additional ablation in Appendix (after EigenWorms) as EWS dramatically outperforms the other models.
Questions for authors
A solid contribution that should be accepted, even without addressing the reviewer's concerns under critical weaknesses section.
2 comments
The reviewer would like to thanks authors for the rebuttal and for having considered the highlighted weakness about EthanolConcentration.
Response to reviewer z8dy
Thank you for your review and for your positive assessment of the paper. We address the accessibility of the paper in the general comment above, which lists the changes we will make, including a guide at the start of the appendix separating what a machine-learning reader needs from what is there for mathematical rigour.
EthanolConcentration. We agree that the margin on EthanolConcentration needs clearer explaining. In Appendix F.4 we retrain S5, LRU and LinOSS-IM with the same preprocessing of the input as the EWS. They reach between 26% and 32%, against 71.9% for the EWS. The EWS at depth one, where it is an LTI SSM that a single S5 layer can represent, already reaches 66.3%. The margin therefore reflects the parametrisation and training of the EWS rather than its expressivity or its preprocessing. The dataset is also ablated over depth in Tables 14 and 15, and in the revision we will refer to these results from Section 5.1. Finally, the result itself is not anomalous for this dataset. While the deep models in our comparison score much lower than the EWS, several classical, shallow classifiers, such as shapelet-based and ensemble methods, reach accuracies in a similar range to the EWS.