- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies how neural networks achieve invariant recognition. Specially, it selects ViT-B/16 and ResNet-50 for test, and the two networks’ predictions for different views of the same object are evaluated. It arrives at some conclusions about relative collapse and directional collapse based on carefully designed experiments.
Critical strengths
Investigating the neural mechanism of invariant recognition is important and doing experiments by evaluating the networks’ predictions from different views is interesting.
Critical weaknesses
- In terms of writing, some paragraphs contain overly long sentences, which impair the clarity and readability of the argumentation.
- This paper reads more like an analytical report. It is suggested to briefly introduce in which downstream tasks the hypothesis raised in the work can be manifested? What are the potential applications of the conclusions presented herein.
- The paper mentions sampling object images at different azimuth angles over 360° while keeping the object upright. However, in real-world scenarios, only varying the azimuth angle without accounting for elevation angles and other variations in visual conditions raises the question of whether the conclusions of this paper could be adequately validated.
- This work mainly conducts analyses based on existing models and geometric statistics. Although the experiments reveal several valuable phenomena, what are the innovations of this paper compared with existing studies on Neural Collapse and Manifold Untangling, and can these findings guide subsequent representation learning or model design?
- The research is limited to 15 object instances, with analyses performed on ViT-B/16 and ResNet-50. Furthermore, key intervention experiments focus solely on Airplane 13. It is unclear to which extent the experimental conclusions are susceptible to data bias.
Questions for authors
To see weakness.