- Rating
- 4
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
CARE addresses incomplete multi-view multi-label classification in two stages. It learns a consensus predictor, freezes its full state, and learns gated residual corrections. Model selection retains the original predictor as a candidate. The paper analyzes when corrections can improve prediction and reports results on six benchmarks, adaptations of four existing methods, and a chest radiograph application.
Critical strengths
- CARE preserves a complete consensus predictor while learning residual corrections and keeps it available during selection. This gives complementary learning a stable reference. Improvements when adapting four existing methods suggest that the framework has value beyond its own architecture.
- CARE achieves the highest reported AP and AUC on all six benchmarks. Paired-stage results show consistent gains from refinement, while component ablations and missingness studies provide further support.
Critical weaknesses
- The synthetic experiment shows that both freezing and continued agreement regularization preserve shared structure. It remains unclear whether freezing offers additional benefits on real datasets.
- The auxiliary losses and use of validation data need clearer explanations.
Questions for authors
- How does freezing compare with joint refinement that retains the agreement term on real datasets?
- Could you provide more details on the training and validation procedures?
We thank Reviewer waeH for recognizing the value of a stable consensus reference and CARE’s applicability to existing methods. We address the two concerns below.
W1&Q1: Freezing versus continued agreement on real datasets.
We conducted a matched comparison on Corel5k, OBJECT, and Pascal07 at PER=LMR=50%. For each dataset, all variants start from the same consensus checkpoint selected over 50 Stage-1 epochs and receive 25 refinement epochs. They share the data split, observation masks, residual initialization, random states, optimizer settings, and validation criterion.
Joint refinement updates the shared and residual streams together, including normalization statistics. Joint + agreement additionally retains the original cross-view agreement loss with its original weight. CARE freezes the parameters and normalization state defining the consensus predictor. All variants retain the Stage-1 predictor as a selection candidate.
The table reports single-run test scores after validation-based selection. CARE achieves higher AP and AUC on all three datasets. Its AP gains over Joint + agreement are 1.47, 0.25, and 1.87 percentage points on Corel5k, OBJECT, and Pascal07, respectively.
Validation-based selection retains the Stage-1 predictor for both joint variants on OBJECT and Pascal07. The table below reports the test performance of their best refinement checkpoints.
Continued agreement improves the refinement candidate’s AP over unregularized joint optimization on all three datasets. Freezing provides a further benefit in this matched comparison. Agreement encourages consistency among evolving view representations. Freezing additionally preserves the learned prediction function, providing a stable reference for residual correction throughout refinement.
W2&Q2: Auxiliary objectives and the training and validation protocol.
Stage 1 supervises the fused and per-view shared predictions using observed labels. Label-semantic alignment shapes the shared representation, cross-view agreement encourages consistency between available view posteriors and their fused posterior, and reconstruction preserves information from observed inputs.
Stage 2 supervises both the final gated prediction and the per-view corrected predictions. Each per-view auxiliary prediction adds its residual directly to the fixed consensus logit, supplying a learning signal even when its gate is small. Reconstruction and shared/private separation guide complementary representation learning. Gate regularization controls the strength of residual contributions. The Joint + agreement control adds the original agreement term to this Stage-2 objective.
The label mask excludes hidden annotations from classification and semantic alignment. Unavailable view inputs are zeroed before encoding, and view availability is incorporated into fusion, reconstruction, agreement, and separation. Per-view auxiliary classification uses the label mask in Stage 1 and both label and view masks in Stage 2. Feature normalization is fitted separately for each view using its observed training rows.
We use the supplied disjoint training, validation, and test indices. Both stages select checkpoints by validation AP+AUC. A refinement checkpoint replaces the Stage-1 predictor only when its validation score is strictly higher. Macro-F1 thresholds are calibrated on validation predictions. Test evaluation follows completion of training and model selection. All training hyperparameters remain fixed across these comparisons.