- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents an auto-encoder based naïve Bayes algorithm, which leverages the reconstruction loss, the loss that maximizes the discriminant power and minimizes feature redundancy, and the loss that maximizes the feature similarity of samples in the same class while minimizes the feature similarity across all samples. A standard attribute weighting algorithm is then used to further weigh different attributes. While the authors claimed three contributions, but the core design is a so-called “multiple correlation encoder”, which is essentially an auto-encoder. The proposed MCENB is validated on 24 datasets and demonstrates superior performance.
Critical strengths
While there are critical flaws in the proposed method, at least the problem identified by the authors are valid and worth for investigation, though there are significant issues in the novelty and technical soundness of the proposed method.
Critical weaknesses
- The novelty is limited. The authors listed three main contributions, but these contributions are not accurately identified nor thoroughly justified. For example, the first claimed contribution is a well-known factor rather a novel design/finding. The second contribution claimed MCE as a new design, but without any justifications on what is exactly new in MCE. MCE is essentially a customized auto-encoder. The last contribution, MCENB, claimed the utilization of both generated attributes and original attributes as novel design, again lacking sufficient novelty.
- There are significant flaws in the proposed method. As shown in Fig. 2, the one-hot label encoding is appended at the end of embedding vector as the input. This may be fine for training but not applicable to inference, where no ground-truth labels are available! Neither the main manuscript nor the supplementary materials mentioned how to obtain the one-hot label encoding during inference. This would be potential label leakage.
- There are many unclear or unjustified design choices. a) Why choose MLP as encoder or decoder? Why three layers? Why use these numbers of neurons per layers? b) how to obtain in Eq. (3). c) Sign in Eq. (4) is important but the authors choose to discard it, why? Any ablation? d) In Eq. (5) and (6), the authors intentionally added a negative sign. But why not simply using the reciprocal of the ratio? Any ablation? e) In Eq. (7), there lacks a parameter to control the contribution of the two losses. Any ablation? f) There may be potential tensions among so many loss terms. Any mechanisms to resolves these tensions?
- The experimental validation is not sufficient. a) The datasets remain relatively small. The feature dimension is limited to 90; the number of classes is limited to 15, and the number of samples is limited to 19,000. The authors should validate the methods in more challenges scenarios with much higher feature dimensions, more number of classes and more samples. b) The compared methods are mostly old methods. There is only comparing method published in 2025. More recent and representative methods should be compared. c) With a close look at the comparison to the competitors in Tab. 2, the proposed method does not significantly outperform the compared methods. Most of the gain for the average accuracy comes from the movement libras dataset. If discarding this dataset, the gain over ICGNB is negligible. The W/T/L should be recalculated based on the statistical significance rather than simply comparing the average value.
- The writing of the manuscript needs significant improvement. a) Many statements are provided without references or justifications. b) Many sentences in the last paragraph on Page 1 are almost the same as in the abstract. c) The review is shallow and outdated. In most cases, the review only touches the definition of key categories, without highlighting the key technologies behind each method. d) Fig. 2 and Fig. 3 should be merged into Fig. 1, and the novel designs are not sufficiently highlighted in the block diagram, if there is any. e) There are many issues on symbols and definitions. For example, is used to represent both the decoder and the output of the decoder (in Eq. (3)). f) Fig. 8 presents an ablation, but the two parameters are never defined in the methodology section.
Questions for authors
- The authors should better articulate their novel contributions. In the current form, this paper lacks novelties.
- The authors should clarify how to obtain the one-hot label encoding during inference.
- There are many unclear or unjustified the design choices. Please justify them.
- The current experimental validation is not convincing. The authors should: a) at least show W/T/L in terms of statistical significance rather than simply comparing the average. b) Comparison with more recent methods. 3) On more challenging datasets (larger datasets with more attributes, classes and samples).