- Rating
- 3(+2)
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The authors tackle the problem of multi-channel time-series prediction and introduce a latent representation model which uses both cross-channel and channel-local features to create a conditioning vector that enables superior performance.
They show that the learned features transfer to multiple prediction back-ends.
Critical strengths
-
The idea is sound: extracting latent features from windows with different views is intuitive and domain-agnostic.
-
The results are convincing: a 41% MSE reduction and transfer across back-ends suggest that relevant features are truly being learned during training.
Critical weaknesses
- The idea is not novel, and seems a simple application of representation learning:
The framing of this method with instruction following and conditioning seems primarily cosmetic; there is no natural language aspect to this work. The "language" that the authors refer to is essentially a hidden representation that is learned. This work then draws from a standard technique in deep learning, i.e. representation learning.
To my knowledge, none of the inductive biases implied by the chosen message passing structure is novel.
For example, SOFTS explores pools all channels into one shared "core" vector and feeds it back to each channel. Similar to the channel-averaged shared message in this work. Following SOFTS related work reveals other methods which have distributed structures across channels, which is also explored in this work.
The result showing transfer to back-ends is also not surprising, since when trained with general enough data, representations often learn useful features which can boost the performance of unseen back-ends.
Questions for authors
- Specifically what are the unique contributions of this work from an architectural point of view, and how do they interact with prior approaches which connect features in similar ways?