- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates multi-dimensional classification (MDC) with missing labels and proposes CSER, a competitive co-evolutionary framework for probabilistic label recovery. The method constructs feature-only and dependency-conditioned probability representations and learns confidence-aware fusion strategies through the co-evolution of recovery strategies and pseudo-missing challenges. The recovered label distributions are then used for multiple imputation and downstream MDC learning. Experiments on 17 benchmark datasets demonstrate consistent improvements over existing MDC methods under different missing-label rates.
Critical strengths
-
The paper addresses a meaningful and practically relevant problem. Most existing multi-dimensional classification (MDC) methods assume fully observed training labels, which may be difficult to obtain in real-world applications. Investigating MDC with incomplete labels is therefore valuable and extends the applicability of existing MDC research.
-
The proposed framework is intuitive and well motivated. The authors construct pseudo-missing challenges from observed labels to provide verifiable feedback for recovery-strategy learning. By jointly evolving recovery strategies and challenging missing-label configurations, the framework offers an interesting way to improve the robustness of label recovery.
Critical weaknesses
-
The recovery strategy involves only one fusion coefficient per class dimension, which could be optimized directly using observed labels and cross-fitted predictions. Comparisons with simpler approaches, such as direct Brier-loss minimization, would help establish the benefits of the proposed framework.
-
CSER employs multiple imputation and ensemble prediction, while the baselines use their original MDC classifiers after deterministic label completion. Comparisons using the same downstream classifier and direct evaluation of recovery accuracy on hidden labels would provide more convincing evidence.
-
The contribution of cross-dimensional dependency modeling remains unclear. The individual effectiveness of feature-only and dependency-conditioned probability representations is not sufficiently evaluated. Comparing these representations separately would help establish whether cross-dimensional predictions provide additional benefits and justify their fusion.
-
The evaluation is limited to randomly generated missing-label patterns. In practice, missingness may depend on class identity or sample difficulty. Since pseudo-missing challenges are constructed only from observed labels, their effectiveness under non-random missingness remains unclear. Experiments with more structured missing-label patterns would strengthen the evaluation.
Questions for authors
Please see the Weaknesses