- Rating
- 4
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper addresses multi-view multi-label classification with both views and labels missing, and proposes CEE. A rectified flow model imputes the missing views, cross-view contrastive learning enforces semantic consistency, and a sample graph together with a label graph limits the spread of unreliable information. The framework is tested on five datasets against nine recent methods under a range of missing ratios.
Critical strengths
- Rather than stopping at imputing missing views, the paper also tackles error propagation through sample relationships and label dependencies, making it more complete than imputation-only or fusion-only approaches.
- The three modules have clear roles: MSDL recovers the view distribution, MSR enforces cross-view consistency, and CDSL handles the dual-graph learning, and they fit together naturally.
Critical weaknesses
- The number of neighbors, whether graphs are built within each batch or over the full training set, and the number of Euler integration steps are not stated.
- The classification loss is normalized by nc rather than the number of observed labels, so its relative strength varies with the label missing rate and the rationale should be explained.
- Pre-training updates only the velocity model and it is not stated whether the encoder is trained by then, while in joint training the encoder is updated with the generator frozen, so how latent drift is prevented needs clarification.
Questions for authors
- Is the encoder trained separately before rectified-flow pretraining, and how are latent space shifts handled during joint training?
- Please specify settings such as the number of neighbors, the scope of graph construction, and the number of ODE steps.
- Are the individual loss terms weighted, and why is the classification loss not normalized by the number of observed labels?
- How should MSDL's drops on some Pascal07 metrics be interpreted, and do the standard deviations in the tables come from the same data splits and missing masks?
Q1 and W3: Thank you for your professional comment. The encoder is randomly initialized without separate pretraining and remains frozen in evaluation mode during the generator pretraining stage, when only the velocity model is optimized using jointly observed source-target views from the same instance. During joint training, the encoder is updated while the generator remains frozen. For each ordered pair of views that are jointly observed for the same instance, the two view representations define a linear interpolation path and a target velocity, and the generator is trained to match this velocity while being conditioned on the interpolation time and on the source and target view identities. Because the model is trained on cross-view paired instances, it learns the mapping relationships between the distributions of two or more views rather than a mapping tied to one specific coordinate system, which allows the learned transport to cope with the drift in the latent space.
Q2 and W1: Thanks for your question. The neighborhood parameters for both the sample graph and the label graph are set to 5 on all datasets. The sample graph is constructed within each training mini-batch and each evaluation batch and is rebuilt at every forward pass using the current fused representations. In contrast, the label graph is constructed once per fold from the observed labels of the entire training split and remains fixed during training; validation and test labels are excluded. The generator uses explicit Euler integration with two steps. Additional implementation settings are as follows: the contrastive projection dimension is 128, and RF pretraining uses Adam with a learning rate of 0.0002.
Q3 and W2: Thank you for drawing our attention to this distinction. All five terms in the joint objective are explicitly weighted: L=αLrec+βLcl+γLgia+σLlg+ηLcls. The classification loss is normalized by nc, rather than by the number of observed labels. Each observed entry contributes with weight 1/(nc), while missing entries contribute zero and are not treated as negative labels. Our rationale is to retain a fixed per-entry weight instead of automatically increasing the weight of the remaining observations as more labels become missing. This is a valid normalization choice, although it has a different effect from observed-label normalization. Normalization by the number of observed labels is also a reasonable alternative, and we will consider it as part of future objective-design refinements.
Q4: Thanks for your comment. Pascal07 is a complex multi-view multi-label dataset, and adding MSDL to the base model does not improve every metric, reflecting the limitations of missing-view recovery alone in this setting. The components of our method are mutually reinforcing. As MSR and CDSL are subsequently incorporated, the model achieves substantially better performance, benefiting from the combined effects of missing-view recovery, cross-view consistency, and relational learning. The standard deviations in the tables come from the same data splits and missing masks.