- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
CGCP pretrains a 3D ResNet-18 on OASIS-2 using three objectives: MMSE regression, CDR-supervised contrastive loss and variance regularization, with loss weights selected through Bayesian optimization. Finally, CGCP is evaluated on OASIS-1 through finetuning and linear probing for AD/CN classification and MMSE regression.
Critical strengths
The paper presents CGCP both as a pretraining method and as an analytical framework for investigating clinical supervision.
Critical weaknesses
- The paper, in general, is not easy to follow, making it confusing and difficult to assess the main contribution in its current form. The paper alternates between presenting CGCP as a pretraining method and as an empirical investigation of clinical supervision. However, the supplied analysis does not sufficiently establish either a methodological advantage or general findings about when mixed clinical supervision helps. For example:
- “MMSE alone predicts CDR-based diagnosis at AUC= 0.875 (5-fold CV logistic regression), exceeding every imaging pipeline evaluated, including fine-tuned CGCP (0.780)... Removing Lmmse has no statistically distinguishable effect on any metric.” while the paper proposes Lmmse in the pretraining objective. Also, “The resulting evidence shows that clinically guided representations can support strong downstream classification, but their benefit is not uniform..”, “CGCP-BO is not statistically distinguishable from its strongest competitors. CGCP is thus a strong but not dominant classification method under rigorous evaluation“, so what exactly is the contribution here?
- If we look at a strict baseline comparison with matching variables: y-aware (with MMSE and no CDR, table 3) has 76.1% AUC and 65.2% BA whereas the same ablated CGCP (with MMSE and no CDR, table 4) shows 75.9% AUC and 65.6% BA, likewise, SupCon (with CDR and no MMSE, table 3) has 75% AUC whereas the ablated CGCP (with CDR and no MMSE, table 4) shows 74.5% AUC. These are currently in different tables, and show no clear advantage for CGCP’s single-signal variants. What if both the signals were supplied to these prior works? Would CGCP still outperform? This is not clear. Furthermore, Table 6 shows that SimCLR outperforms CGCP under frozen linear probing. The authors acknowledge it, but this limits any broad interpretation that CGCP learns better representations.
- The experimental setting is too limited for the broader conclusions. Evaluation on only one dataset,i.e., OASIS, two tasks, and tested with a single backbone. Currently, I am unable to evaluate the framework’s generalizability, given that this domain comes with inherent challenges of cohort shifts and confounders. “possible participant overlap between the anonymized OASIS releases”, if this could be a limitation, then isn’t it better to opt for a different dataset for evaluation? Also, there is no sufficiently strong technical or empirical contribution. The method combines existing components: y-Aware-style proxy supervision, a VICReg variance term, BO weight tuning, without new mechanism.
- Missing Interpretability analysis: In the clinical setting, evaluations are reliable with both performance and interpretability analysis (not just UMAPs). The study does not adequately assess whether the learned information truly reflects cognitive impairment rather than demographic or acquisition-related correlates or other factors.
- The paper lacks comparisons against several prior works, such as supervised models(Jang et al's M3T [CVPR 2022], Jiang et al's AAGN [MICCAI 2024]) and recent pre-training based frameworks (Rui et al's BrainMVP [CVPR 2025], Lin et al's ADLIP [Alzheimer’s Dement. 2025])
Questions for authors
Please address the points raised in weakness.
Other questions:
- MMSE and CDR scores are noisy in practice as they depend on the subject, clinical history, examiner, and many other factors. So the assumption that “these annotations encode exactly the pathological structure” is not entirely true. Was there any analysis performed for this? Say for samples with scores not consistent with the label? If all were correlated, then how is it different from directly using the diagnostic labels during pretraining?
- Fig 1 is confusing. What does passing info from one loss to another mean?
- What to infer from the UMAPs in fig 2? The inference is sec 4.6 is difficult to follow. It just states, w/o mmse there are distinct clusters, but is that an expected behaviour? Clustered by what? Or what is an expected behaviour? etc.. these are unclear.
- What does linear probing on supervised-only in table 6 mean? The supervised-only run is for the task-specific training right? What was probed?