- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
RPMF estimates subject-specific modality reliability from predictive entropy and progressively fuses modalities using reliability and prototype-level compatibility. Experiments on TADPOLE and ABIDE report improved classification performance, with ablations and analyses of reliability and modality selection.
Critical strengths
- The framework provides a clear mechanism for using both individual modality confidence and compatibility with the current fused representation.
- The TADPOLE results are strong. Evaluation across two disease datasets, together with component ablations and reliability analyses, provides useful evidence of the framework’s effectiveness.
Critical weaknesses
- The methodological novelty is limited. RPMF combines predictive entropy, multiple latent projections, set-based distance, cross-attention, and gated residual fusion, all of which are established techniques. Its main distinction is the reliability- and relation-guided fusion order, but this contribution is not isolated through fixed-order, random-order, or reliability-only comparisons under the same architecture. The work therefore appears closer to an engineering combination than a clearly established methodological advance.
- The proposed reliability score primarily measures predictive confidence rather than correctness. The historical-loss regularizer does not provide a theoretical guarantee of correct reliability ordering; in particular, Eq. (7) permits equal scores and some reversed rankings without penalty. The reported agreement and correlation results show only a moderate empirical association and do not establish calibration or robustness to high-confidence errors.
- The role and interpretation of the latent prototypes remain unclear. They are sample-specific projections generated from the same global feature, without diversity constraints, prototype supervision, or semantic analysis. The ablation shows that these additional latent vectors improve performance, but does not demonstrate that they capture distinct disease patterns or that the gain comes from prototype modeling rather than increased capacity and a different fusion representation.
- Changing the fusion order does not by itself resolve unreliable evidence. All modalities are eventually incorporated, and the method neither removes corrupted information nor identifies reliable components within a modality. A low-reliability modality can therefore still perturb the fused representation. Without controlled corruption or conflict experiments, the claim that RPMF suppresses noisy or conflicting evidence is insufficiently supported.
Questions for authors
- What is the main methodological advance beyond combining existing confidence estimation, set matching, and progressive cross-attention components? How does RPMF compare with fixed-order, random-order, and reliability-only ordering using the same fusion architecture?
- Why should predictive entropy be interpreted as reliability rather than confidence? Is Eq. (7) intended to allow equal or partially reversed reliability rankings? Please provide calibration results, high-confidence error analysis, and comparison with always selecting the strongest fixed modality.
- What do the latent prototypes represent, and are their roles consistent across subjects? Can the authors provide diversity or semantic analyses and a capacity-matched control to distinguish prototype learning from additional nonlinear projections?
- How does RPMF behave when one modality is corrupted or confidently conflicts with the others? Would explicitly dropping a low-reliability modality outperform merely changing its fusion order, and how do the predictions and gate values change at each fusion step?