- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The proposed BU-HIM identifies a limitation of existing MIL methods for WSI classification, which select patches based on attention scores alone. Even patches with similar attention scores may differ in model confidence, but existing methods do not adequately account for this epistemic uncertainty. To address this limitation, BU-HIM introduces a plug-and-play framework based on Bayesian variational attention that jointly estimates attention importance and epistemic uncertainty. It constructs a hard instance set by selecting both highly important and highly uncertain patches, and improves diagnostic performance through teacher-student collaborative learning that combines local hard-instance learning with the preservation of slide-level context. Experiments across three MIL backbones and two benchmark datasets demonstrate the effectiveness of the proposed framework. The results further show that among patches with similar attention scores, those with higher uncertainty can have an important influence on slide-level classification.
Critical strengths
-
The motivation of the paper is well articulated, maintaining a consistent argument across the Introduction, Related Work, and the beginning of the Method section.
-
The proposed plug-in epistemic uncertainty methodology offers strong scalability. Furthermore, unlike prior work that remains limited to uncertainty quantification or interpretability, this approach directly addresses the mining process itself.
Critical weaknesses
-
I would like to comment on the claim made in Lines 46-52, which serves as a central motivation repeated throughout the paper. The statement following “However” appears to be an assertion, without supporting experimental evidence, mathematical justification, or citations to prior works. Is the intended argument that MIL, which involves a large number of instances, inherently suffers from uncertainty due to the use of deterministic gated attention? However, state-of-the-art MIL models have already achieved substantial performance improvements without explicitly accounting for this uncertainty [1-3]. As currently presented, the claim seems overly broad and ambiguous, potentially suggesting that deterministic attention mechanisms themselves are fundamentally problematic.
-
Dual-teacher methods that rely on Bayesian components, such as BU-HIM, are relatively common approaches [17-19]. It is difficult to identify contributions beyond applying an existing paradigm to MIL, making the proposed methodology appear incremental. Furthermore, top-k selection has already been used in score-based MIL methods [4,5]. While I understand that the method iteratively updates Bayesian mining through training, BU-HIM ultimately still performs deterministic inference.
-
I disagree with generalizing the attention mechanism presented in Equation (1) to all MIL methods. Equation (1) describes gated attention, which was first introduced in AB-MIL [6]. This was a significant contribution that incorporated gated attention into MIL and demonstrated strong performance and interpretability. However, following the introduction of self-attention, most modern MIL architectures have adopted Transformer-based structures [7-10]. These architectures have moved beyond the gated-attention paradigm, in which each instance is assigned a single attention score .
- Graph-based models employ more sophisticated message-passing mechanisms, such as GAT and Graph Transformers, while sequential approaches have also been explored [11-15]. Therefore, I find it difficult to agree with the generalization of the mechanism in Equation (1) to MIL as a whole, particularly when it is used to support the arguments presented in Lines 46–52.
-
The experimental results presented in Table 1 require a more thorough discussion. While I acknowledge that AUC is an important metric for diagnostic tasks, the ACC of AB-MIL+BU-HIM on CAMELYON16 is lower than that of the vanilla AB-MIL baseline. A decrease in ACC indicates an increase in the overall classification error rate. Notably, AB-MIL also exhibits a decline in diagnostic performance when combined with BU-HIM on PANDA. Furthermore, although RRT-MIL+BU-HIM achieves the highest recall on CAMELYON16, its F1 score is not comparably strong. This raises concerns about potential over-calling by the diagnostic model.
- These inconsistencies across the reported quantitative results make it difficult to establish the practical justification for BU-HIM and assess whether its benefits outweigh the potential drawbacks.
-
Experimental Design: Restricting the plug-in targets of BU-HIM to gated-attention-based MIL methods, which were proposed relatively early, rather than evaluating it on more recent MIL architectures weakens the validation of the proposed methodology. This experimental setting appears to demonstrate BU-HIM's effectiveness within a self-imposed scope rather than establish its broader applicability.
5-1. More importantly, this work primarily concerns instance mining and uncertainty-aware selection in MIL, rather than proposing a new MIL architecture. Accordingly, the methods discussed in Section 2.3 that address the relationship between uncertainty and MIL should have been included as baselines, where applicable. The experimental section should instead establish fixed MIL backbones and conduct a multifaceted analysis of their performance, interpretability, and hard-instance mining effectiveness with and without the proposed method.
5-2. In this regard, Table 2 provides only a limited evaluation. To my knowledge, several other studies have explored instance mining in MIL [20-22]. However, Random Selection and MCDO are overly naive baselines, and outperforming these methods alone is insufficient to establish the superiority of BU-HIM. Moreover, the reported improvements appear statistically inconclusive. BU-HIM yields only a 0.54 percentage-point performance gain over vanilla AB-MIL, and this improvement remains within the standard deviation of AB-MIL's performance.
-
RRT-MIL [16] appears to be mentioned for the first time in Line 294, but I could not find a corresponding citation. More generally, citations should be provided for the models referenced when describing the experimental setup.
References
[1] Chen, Richard J., et al. "Scaling vision transformers to gigapixel images via hierarchical self-supervised learning." 2022 IEEE/CVF conference on computer vision and pattern recognition (CVPR). IEEE, 2022.
[2] Shao, Zhuchen, et al. "Transmil: Transformer based correlated multiple instance learning for whole slide image classification." Advances in neural information processing systems 34 (2021): 2136-2147.
[3] Yang, Shu, Yihui Wang, and Hao Chen. "Mambamil: Enhancing long sequence modeling with sequence reordering in computational pathology." International conference on medical image computing and computer-assisted intervention. Cham: Springer Nature Switzerland, 2024.
[4] Javed, Syed Ashar, et al. "Additive mil: Intrinsically interpretable multiple instance learning for pathology." Advances in Neural Information Processing Systems 35 (2022): 20689-20702.
[5] Zhang, Yunlong, et al. "Attention-challenging multiple instance learning for whole slide image classification." European conference on computer vision. Cham: Springer Nature Switzerland, 2024.
[6] Ilse, Maximilian, Jakub Tomczak, and Max Welling. "Attention-based deep multiple instance learning." International conference on machine learning. Pmlr, 2018.
[7] Chen, Richard J., et al. "Whole slide images are 2d point clouds: Context-aware survival prediction using patch-based graph convolutional networks." International Conference on Medical Image Computing and Computer-Assisted Intervention. Cham: Springer International Publishing, 2021.
[8] Thandiackal, Kevin, et al. "Differentiable zooming for multiple instance learning on whole-slide images." European Conference on Computer Vision. Cham: Springer Nature Switzerland, 2022.
[9] Henry, Emerald U., Onyeka Emebob, and Conrad Asotie Omonhinmin. "Vision transformers in medical imaging: A review." arXiv preprint arXiv:2211.10043 (2022).
[10] Hong, Sungrae, et al. "Diagnose Like A REAL Pathologist: An Uncertainty-Focused Approach for Trustworthy Multi-Resolution Multiple Instance Learning." 2026 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). IEEE, 2026.
[11] Hou, Wentai, et al. "H^ 2-MIL: exploring hierarchical representation with heterogeneous multiple instance learning for whole slide image analysis." Proceedings of the AAAI conference on artificial intelligence. Vol. 36. No. 1. 2022.
[12] Chen, Zhen, et al. "Diagnose like a pathologist: Weakly-supervised pathologist-tree network for slide-level immunohistochemical scoring." Proceedings of the AAAI conference on artificial intelligence. Vol. 35. No. 1. 2021.
[13] Bontempo, Gianpaolo, et al. "Das-mil: Distilling across scales for mil classification of histological wsis." International conference on medical image computing and computer-assisted intervention. Cham: Springer Nature Switzerland, 2023.
[14] Shi, Jiangbo, et al. "Vila-mil: Dual-scale vision-language multiple instance learning for whole slide image classification." 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2024.
[15] Ye, Guo, et al. "Graph-based multi-instance learning: a survey." International Journal of Machine Learning and Cybernetics 17.6 (2026): 274.
[16] Tang, Wenhao, et al. "Feature re-embedding: Towards foundation model-level performance in computational pathology." 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2024.
[17] Yu, Lequan, et al. "Uncertainty-aware self-ensembling model for semi-supervised 3D left atrium segmentation." International conference on medical image computing and computer-assisted intervention. Cham: Springer International Publishing, 2019.
[18] Korattikara Balan, Anoop, et al. "Bayesian dark knowledge." Advances in neural information processing systems 28 (2015).
[19] Tang, Wenhao, et al. "Multiple instance learning framework with masked hard instance mining for whole slide image classification." 2023 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2023.
[20] Huang, Wentao, et al. "Hard negative sample mining for whole slide image classification." International Conference on Medical Image Computing and Computer-Assisted Intervention. Cham: Springer Nature Switzerland, 2024.
[21] Shao, Zhuchen, et al. "Lnpl-mil: Learning from noisy pseudo labels for promoting multiple instance learning in whole slide image." 2023 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2023.
[22] Zheng, Tingting, Kui Jiang, and Hongxun Yao. "Dynamic policy-driven adaptive multi-instance learning for whole slide image classification." 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2024.
Questions for authors
Please refer to the "Critical Weaknesses" section.