- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper aims to show that a relatively small number of parameters in the NN can be identified as the error-controlling parameter, while other parameters are identified as playing the role of defining the basis functions or fundamental features.
Critical strengths
This paper attempts to build a new understanding into an interesting problem.
Critical weaknesses
This paper is poorly organized and hard to grasp the core message. It does not even give a clear problem formulation in the beginning. Also, I wonder why Figure 3 and 4 look the same as they should be the results of different experiments. As suggested by captions, Figure 3 is the approximation error of Fourier basis functions, and Figure 4 is the approximation error of neural networks. If it is something beyond a simple error, I would strongly suspect the validity of those empirical results.
Moreover, this work does not provide any new insights into the problem it attempts to discuss. All of its theoretical results presented in Section 2 and Appendix are well-known for decades. For example, Theorem 1 proves the approximation bound for 1D periodic functions, which can be found in every graduate-level functional analysis textbook. The theory has almost nothing to do with neural networks, and the closest connection is probably the approximation guarantee for piecewise smooth functions, which is again, a standard result in functional analysis.
I would recommend the authors to revise their work thoroughly before submitting it to the next venue.
Questions for authors
I have no question.