- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes DisCNNs, a biologically inspired distributed CNN architecture for single-category feature learning. The authors introduce the N2O loss, which encourages positive-class embeddings to form a compact region while pushing dissimilar negative features toward the origin, thereby disentangling target-class features from irrelevant ones. The paper shows that the learned representations selectively capture positive features.
Critical strengths
This paper makes an interesting attempt to CNN architecture, and the experimental results appear to be genuine and carefully conducted. I believe this work represents a promising starting point. However, the current study is still at a relatively early stage, and many aspects require further reconsideration and refinement. Please see the Weaknesses and Suggestions sections for detailed comments.
Critical weaknesses
-
The paper aims to learn category-specific feature maps for each class, but the benefits of this design seem limited. First, many object categories share common components, such as wheels in cars and bicycles, so learning a shared representation may be more efficient. Second, the biological motivation is not consistent with the proposed architecture: the human visual system shares low-level features across categories rather than building a totally separate recognition system for each category, for example, assigning one eye to each object category. In contrast, DisCNNs are category-specific throughout the entire network. Finally, building a separate model for each category raises an important scalability issue. More specifically, the performance ceiling is constrained by the capacity of an individual model, making it difficult to achieve further performance improvements.
-
The proposed model indeed has fewer parameters, but this comes at a significant cost. As the number of classes and samples in the dataset increases, the number of negative samples also grows. First, this leads to a severe class imbalance problem, making training difficult when negative samples vastly outnumber positive samples. Second, each model needs to be trained on the entire dataset, resulting in a very high overall training cost.
-
The proposed method is essentially a one-vs-all classifier. This type of classifier has been extensively studied since the last century and remains widely used in modern anomaly detection and out-of-distribution detection. Therefore, the core idea of the proposed approach is not particularly novel.
-
The authors incorrectly use the term “theoretical proof.” A theoretical proof refers to a mathematical derivation or proof, rather than empirical validation through experiments.
-
Evaluating the method on only a single dataset is insufficient for a pattern recognition study. The authors should validate the effectiveness of the proposed method on at least three benchmarks and provide comparisons with existing methods.
Questions for authors
-
Based on the proposed method, I suggest that the authors consider exploring its application to anomaly detection or out-of-distribution detection.
-
The authors should pay more attention to the writing and presentation of the paper. I suggest studying and emulating the overall structure and presentation style of well-written papers. In practice, reviewers often have limited time, saying, 20 minutes, and if readers cannot quickly find the information they are looking for in the expected places, they may lose interest in reading further. The abstract and introduction are relatively well written, but the writing and organization of the later sections are considerably less standard and could be substantially improved.
-
I encourage the authors to engage more actively with researchers in pattern recognition, rather than developing the work in isolation. Such interactions could help broaden their perspective and identify or correct potential biases in their current understanding, which are particularly important for developing into a top researcher.