- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper explores the universal approximation property (UAP) of Neural ODEs (NODEs). It demonstrates (with a series of theoretical proofs) that while a single autonomous model is limited in its ability to approximate time-varying vector fields or complex transformations (being "nowhere dense"), a finite composition of NODEs can satisfy the UAP.
Critical strengths
The universal approximation theorem (UAT) has long been a subject of extensive research. Although Neural ODEs may not be a particularly trending topic at the moment, establishing the UAT for a finite composition of autonomous Neural ODEs represents a solid and meaningful contribution.
Critical weaknesses
-
The fact that a single autonomous NODE is "nowhere dense" is perhaps an intuitive, expected result.
-
The proof that a composition of autonomous NODEs satisfies the UAP relies on a structure that (at least from a practical standpoint) appears entirely unfeasible.
In short, while the paper presents an interesting theoretical finding, it does not have novelty with practical utility at the same time.
Questions for authors
Are there any examples of using Composition of autonomous neural ODE in practice?