- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper combines DBT image features and structured features for benign/malignant classification. A genetic algorithm searches feature-group subsets for validation AUC and group count. Selected MLP models use Monte Carlo dropout to estimate uncertainty and are fused using validation performance, feature count, and uncertainty.
Critical strengths
None
Critical weaknesses
The claimed reduction in feature acquisition cost is not established at the ensemble level. Although each Pareto submodel may use a small feature subset, the proposed prediction uses an ensemble of 7–30 submodels. Consequently, the actual set of features that must be acquired for a patient is the union of the feature groups required by all participating submodels, which may approach the full feature set. The paper reports per-model feature counts but does not report this union or a realistic acquisition cost. This issue directly undermines one of the central motivations and objectives of the method.
The empirical evaluation is too limited to support the reported gains. The dataset contains only 256 patients, with approximately 51 samples each in the validation and test sets. The validation set is repeatedly used for the 200-generation genetic search, Pareto selection, hyperparameter tuning, candidate filtering, model ranking, and fusion-weight estimation. This creates substantial risk of selection overfitting. No nested cross-validation, repeated splits, confidence intervals, or external validation is provided. Moreover, the proposed fusion does not consistently outperform simple mean fusion or logistic regression, and the claim that it achieves the highest AUPRC under all four pool sizes is contradicted by Table 2 at .
Questions for authors
-
For each ensemble size, what is the number and acquisition cost of the union of feature groups required by all participating submodels? Does the proposed fused model still reduce acquisition burden relative to the full-feature baseline?
-
Can the authors provide repeated nested cross-validation or external-cohort results in which the complete genetic search, hyperparameter selection, filtering, and fusion-weight estimation are performed inside each training fold?
-
Are Equations (14)–(19) derived from an existing evidential-reasoning rule? If so, what is methodologically new, and how is the combination rule justified when the submodels are strongly correlated through shared training data, mandatory image features, and overlapping clinical features?
-
What is the exact provenance of the ultrasound and clinical variables, how were the 256 patients selected and linked to the DBT data, and how did the authors ensure that BI-RADS and radiologist-derived descriptors do not introduce target or temporal leakage?