- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper presents generalization bounds for parameterized group equivariant convolutional neural networks (PG-CNNs). They show both theoretically and empirically that increasing the number of basis functions or channel numbers worsens generalization. Additionally, they show that the generalization error of PG-CNNs matches the theory they provided. Also, they show that fourier basis perform better as in line with their predictions. Overall, they provide complete theoretical justification for the bounds on these networks and show that they are reflected in experiment.
Critical strengths
The biggest strength this paper has is that the empirical results fit quite well to the theoretical findings. This gives high confidence in anyone who reads these papers that the theoretical findings are proper and useful in the design of future convolutional networks. I can take the experimental and theoretical findings of this paper to further approach future networks with a better design to lower generalization error.
Critical weaknesses
The only critical error I see is that the experimental section is somewhat limited in experimenting with larger . I would be interested in seeing an experiment which shows how large can become before its performance no longer sees an improvement. I feel like this is a missing experiment and would be an interesting result to see tied to their theoretical results.
Questions for authors
- In section 5.2, table 5, you only experiment with sizes of 2, 4, and 8. Have you tried going much further with the size of to see how that effects generalization error, or does SVD show that the larger sizes really have too many redundancies and have no benefit?