- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes PMMG for jointly grading patellar and femoral cartilage defects in patellofemoral osteoarthritis. It integrates five MRI sequences, radiology reports, grading-criteria prompts, and clinical variables through two branches with slice attention, sequence attention, and modality-level attention. The design incorporates clinical assumptions about sparse lesions, a primary diagnostic sequence, and image-led multimodal fusion. Cartilage-focused diffusion augmentation and an entropy-dependent weighted focal loss address class imbalance. Although annotations use grades 0–4, the experiments merge grades 0 and 1, yielding two four-class tasks. The study includes 1,173 patients from two centers, with 90 internal-test and 269 external-test patients. Reported mean accuracy/AUC is 0.739/0.891 internally and 0.705/0.895 externally. Validation includes baseline comparisons, component ablations, radiologist comparisons, and an assistance study.
Critical strengths
-
A useful clinical task with a coherent modeling rationale. Separately grading patellar and femoral cartilage preserves information that a single joint-level prediction would obscure. The hierarchical design is motivated by sparse lesions and complementary MRI sequences, giving the framework a clear connection to the assessment task.
-
Validation extends beyond an internal model comparison. The independently collected 269-patient external cohort, acquired at another center with a different scanner, provides meaningful evidence about transfer. Radiologist comparisons and an assistance evaluation also make the study relevant to its intended clinical workflow, although their interpretation requires the clarifications below.
Critical weaknesses
-
The comparisons do not adequately isolate the proposed methodological contribution. Appendix A.3 restricts KGNet, a multi-view method and the strongest reported competitor, to sagittal images, while PMMG receives five MRI sequences plus reports and clinical variables. CoPAS also loses parts of its original fusion mechanism. The descriptions do not establish an equally informed multimodal competitor, so the reported gains conflate architecture with input availability and baseline adaptation. The ablations do not resolve this: all attention levels yield 70.6% mean accuracy in Table 3, whereas Table 9 ends at the full model’s 73.9%, without specifying how diffusion and loss weighting are controlled. Furthermore, diffusion raises accuracy by 1.6 percentage points while mean AUC decreases from 87.2 to 86.8, with no matched resampling comparison or explicit validation of synthetic grades. Consequently, the evidence for the distinct benefits of the proposed attention and augmentation remains incomplete.
-
The claims of robust clinical grading and radiologist-level performance exceed the current evidence. External femoral accuracy falls from 81.1% to 66.2%; the merged grade-0/1 class contains 193/269 external patients, giving an always-majority prediction 71.7% accuracy. High AUC is encouraging, but it does not establish reliable four-class grading at the reported operating point. Figure 6 also shows only 2/9 correct predictions for internal femoral grade 3. The reader comparison has unresolved discrepancies: the internal senior reader’s patellar/femoral accuracies are 74.4%/78.9% in Table 2, but exact agreement with the reference is 68.9%/72.2% in Table 6. Reader independence from the reference annotators and the ordering, blinding, and washout of assisted readings are not specified. These issues directly affect the interpretation of the claimed clinical equivalence and assistance benefit.
Questions for authors
-
Can the authors provide a comparison with a strong fusion baseline given the same MRI sequences, reports, clinical variables, preprocessing, and augmentation, with uncertainty for the paired performance difference? Please also specify which diffusion and loss components are active in each row of Tables 3 and 9.
-
Can the authors reconcile the senior-reader accuracy/exact-agreement discrepancies between Tables 2 and 6, and the apparent junior-reader identity swaps? Were the evaluated readers independent of the reference-standard annotators? For the assistance study, what were the reading order, blinding and washout arrangements, and the paired uncertainty or significance estimates?
-
How are the paired patellar/femoral grades assigned to the 184 synthetic subjects? Are grades inherited from source subjects or changed through conditioning, and how is consistency with cartilage defect depth, accompanying reports, and clinical variables checked? Does augmentation retain its benefit against resampling the same source subjects to an equivalent training-set size?
-
Can the authorsthe authors provide external confusion matrices, per-grade recall, and model ordinal agreement, and explain the femoral accuracy decline relative to the 71.7% majority-class reference? How was the final prediction rule selected on validation data? These results would help establish whether the system reliably distinguishes clinically important defect grades across centers.