- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Key contribution is to add a Latent VAR component to a base (complex but sound) forecast. The VAR component involves contributions from other entities in the panel, and is aimed to provide (minor) forecasing improvements, but more importantly attempts to add some explanability in the form of contributions from other panel members ("entities).
Critical strengths
The Latent VAR/IRF may be novel, not sure. The base model pretty standard in deep learning approaches.
A wide variety of (DL based) existing approaches are compared against, and the contribution of the additional (VAR) component is identified in Table 3.
Critical weaknesses
I was put off by two main issues:
-
There seems to be much more use of AI than conveyed by the "AI USE STATEMENT", e.g. see remenants of AI output in Table 5 caption, last phrase of "Router scalability", pretty much all o the last para in the appendix, etc.
-
Though explainability is a major motivation, the nature of this is pretty basic: a single number (based on correlation, not causality) per other time series (the "entity). See fig 2. There is anecdotal support in form of deletion curves, fig. 3. I think this would be highly inadequate for any domain user; the relative importance of key entities as a whole is likely already known at this very coarse level (e.g. weather is geographically correlated, see first image of fig 2. Practitiioners are more interested in what specific part of another entitie's series caused a surprising read, causation, match with domain knowledge, but the authors do not even consider this and I infer that they did not work with domain experts to understand the value of their results.
There are other issues as well, but the two above are show-stoppers for me.
Questions for authors
should work with domain experts and understand what is already known about the application to have an impact.