- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors proposed Region-Aware Hierarchical Multimodal Fusion (RA-HMF) model for estimation of post-operative recurrence from pre-operative data for lung cancer using computed tomography (CT), positron emission tomography (PET) and clinical infomation. Region-Aware module is built based on peritumoral region extracted from segmentation mask by expanding it using dilation (morphological operation) by 3, 6, 9 mm. then region-specific features can be extracted by multiplying mask with feature map. Those region-aware features are later aggregated with attention mechanism and further ‘enhanced’ patient-level PET and clinical information.
The contributions according to the authors are: region-aware pooling for different peritumoral regions; PET and clinical information aggregation mechanism, and mechanistic ablation.
Evaluation of the proposed method is done on 107 patients (25 positive cases, 82 negative cases) from publicly available data repository. The proposed method is compared against the baselines and the shown improvement seems to modest.
Critical strengths
The paper is relatively easy to understand.
Critical weaknesses
Some of the key concepts claimed in this submission as main contributions have been studies in the literature e.g. region-aware concept with distinguishing 3, 6, 9 mm peritumoral regions for features extraction was reported e.g. https://doi.org/10.1371/journal.pone.0206108 https://doi.org/10.3390/diagnostics12061313 (as cited for radiomics studies)
The other proposed concepts (masked pooling, PET&clinical information attention aggregation) while not proposed earlier in the context of the recurrence lung cancer prediction show rather modest improvement in the overall pipeline (as evidenced in Table 2).
See this work on tumor centric attention https://doi.org/10.1007/s40846-024-00884-6 See cross-modality attention mechanism for multimodal fusion used in this paper: https://doi.org/10.1117/12.3006036 The paper requires substantial revision of the background literature and adjustment of the conclusions accordingly.
Questions for authors
Evaluation of the proposed framework is done on 107 patients, while this is not a reason to reject the paper but the evaluation itself is limited to very few baselines and possibly missing relevant approaches.
The most important one is to show how classic radiomics approach (e.g. https://doi.org/10.3390/diagnostics12061313) could compare against the proposed method. Radiomics could be extracted from each peritumoral region (03, 36, 69) and fed into the logistic regression (similarly as it was done for Clinicar LR – see Table 1).
Evaluation also assume (implicitly though) that the given segmentation is perfect, this raises a question how stable is the presented method for feature extraction when the segmentation quality is perturbed – some studies performed such analysis for radiomics approaches (though for different tumor location): e.g https://doi.org/10.1109/ISBI56570.2024.10635413
For Evaluation – no std is provided.
Recent meta-analysis paper to better frame the presented work: https://doi.org/10.2196/84223