- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
To tackle Whole Slide Image (WSI) classification under weak slide-level annotations, the deep learning community has widely adopted Multiple Instance Learning (MIL) frameworks. Standard MIL pipelines crop a WSI into small tiles, extract representations using a pathology-pretrained Feature Extractor (FE), and aggregate these embeddings for final slide-level prediction. However, relying exclusively on the FE's [CLS] token causes oversmoothing of intra-tile context, introducing significant limitations in cytopathology where diagnostic evidence appears sparsely.To address this issue, the paper propose DI-MIL, a novel approach that preserves and utilizes the FE's patch token features rather than discarding them. DI-MIL clusters patch features within each tile to retain fine-grained spatial representations. Since the ViT-based FE inherently partitions tiles into sub-patches, DI-MIL requires no additional tile pre-processing. The newly enriched bag can be seamlessly integrated as a plug-and-play module into existing MIL backbones (evaluated with AB-MIL and ACMIL in this work). Experimental results demonstrate that DI-MIL effectively overcomes the limitations of naive [CLS]-only baselines, exhibiting superior performance in cytopathology tasks.
Critical strengths
-
The core idea of leveraging both the [CLS] token and patch tokens effectively tackles the common practice of discarding fine-grained intra-tile information. Furthermore, because the Vision Transformer (ViT) encoder inherently partitions tiles into sub-patches during its internal operations, the proposed method recovers detailed local representations without requiring any additional computational overhead or manual tile pre-processing.
-
The manuscript addresses cytopathology and whole-slide image (WSI) analysis, a domain that has received relatively less attention compared to histopathology. Given the distinct diagnostic challenges of cytopathology (such as sparsely distributed cellular features), this work addresses a crucial gap and holds strong potential for broader impact within the digital pathology community.
-
(Assuming my understanding is correct) The proposed DI-MIL framework operates as a plug-and-play module, demonstrating high adaptability and scalability. Since the vast majority of modern pathology feature extractors (FEs) rely on ViT-based architectures, the clustering approach can be seamlessly integrated across various pre-trained encoders without requiring retrained or specialized feature extraction pipelines.
Critical weaknesses
-
Merging WSI tiles to capture fine-grained representations is an established methodology in the literature, rendering the proposed method somewhat incremental. To the best of my knowledge, existing approaches in this direction fall into two primary paradigms.
1-A. Hierarchical approaches:
-
HIPT [1] progressively refines representations by aggregating features from fine-grained to coarse-grained tile levels, preventing uniform information loss. Contrary to the claim in the manuscript that only a single attention score is assigned to a patch, class tokens across resolutions receive complex, contextualized attention scores via self-attention.
-
Beyond this, numerous studies have leveraged multi-resolution strategies to mitigate the oversmoothing of information that occurs during single-patch feature extraction [2-7].
1-B. clustering
-
Multiple studies have already incorporated clustering for instance selection and aggregation within MIL [8-10].
-
Despite this prior work, the clear distinction between existing clustering-based approaches and the proposed method remains insufficiently articulated. Furthermore, such clustering-based approaches should be included as direct baselines to evaluate competitive performance.
-
While the baselines presented in Table 2 are valid, they stem from fundamentally different motivations. For instance, MambaMIL emphasizes sequential modeling, whereas DTFD-MIL focuses on feature expansion via pseudo-bag construction. Consequently, relying solely on these models is insufficient to thoroughly evaluate the specific motivation driving the proposed method.
-
-
Regarding the claimed limitation of existing aggregation methods:
-
It is acknowledged that early Multiple Instance Learning approaches relied on relatively naive aggregation schemes [11-12].
-
However, recent studies cannot be simplified as merely applying a single attention mechanism to collapse representations into a single vector. Hierarchical graph-based methods utilize complex message passing and multimodal fusion [13-15]. Furthermore, recent work on MIL in hyperbolic space expands representation capacity by projecting fine-grained information along geodesics [16].
-
A primary concern is that the argument presented in the manuscript appears to generalize the limitations of a narrow subset of MIL methods as if they apply to the entire paradigm.
-
Following the same line of logic, the fundamental mechanism of the proposed method remains unchanged: it still collapses a slightly more complex bag into a single vector using a single attention operation (of AB-MIL and ACMIL).
-
According to Table 8, the training seed is set strictly to 1024, indicating that the experiments were conducted deterministically in a single run. This setup introduces two primary concerns:
3-A. It is unclear how the reported standard deviations were calculated, as a single deterministic run cannot produce a standard deviation. Furthermore, clarification is needed on whether all baseline methods were trained under this exact single-seed configuration.
3-B. Demonstrating consistent performance improvements based on a single seed run is fundamentally limited and risks being perceived as seed curation rather than robust generalization. Evaluating performance across multiple random seeds is necessary to establish statistical reliability.
-
Out of the four datasets used in the evaluation, three are proprietary in-house datasets, which makes an objective verification of the reported contributions challenging. While the scarcity of public WSI datasets in cytopathology is acknowledged, releasing a subset or anonymized version of the private datasets should be considered to enable independent reproduction of the performance gains demonstrated by the proposed method.
-
Table 1 appears to be a functional subset of Table 2. While I acknowledge that two additional FEs are evaluated in Table 1, the same information could be conveyed much more densely. For instance, the manuscript could either merge the unique rows into Table 2 or present the additional FE exploration in a smaller, compact table. Reclaiming this space would allow the manuscript to include more essential analytical experiments to strengthen the propose method.
Citations
[1] Chen, Richard J., et al. "Scaling vision transformers to gigapixel images via hierarchical self-supervised learning." 2022 IEEE/CVF conference on computer vision and pattern recognition (CVPR). IEEE, 2022.
[2] Deng, Ruining, et al. "Cross-scale multi-instance learning for pathological image diagnosis." Medical image analysis 94 (2024): 103124.
[3] Shin, Yonghan, and Won-Ki Jeong. "LRMIL: Efficient Low-Resolution Multiple Instance Learning via High-Resolution Knowledge Distillation for Whole Slide Image Classification." arXiv preprint arXiv:2606.06864 (2026). (MICCAI 2026)
[4] Hou, Wentai, et al. "H^ 2-MIL: exploring hierarchical representation with heterogeneous multiple instance learning for whole slide image analysis." Proceedings of the AAAI conference on artificial intelligence. Vol. 36. No. 1. 2022.
[5] Hong, Sungrae, et al. "Diagnose Like A REAL Pathologist: An Uncertainty-Focused Approach for Trustworthy Multi-Resolution Multiple Instance Learning." 2026 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). IEEE, 2026.
[6] Xiong, Conghao, et al. "Diagnose like a pathologist: Transformer-enabled hierarchical attention-guided multiple instance learning for whole slide image classification." arXiv preprint arXiv:2301.08125 (2023).
[7] Li, Jiayun, et al. "A multi-resolution model for histopathology image classification and localization with multiple instance learning." Computers in biology and medicine 131 (2021): 104253.
[8] Pei Liu, Luping Ji, Xinyu Zhang, and Feng Ye. Pseudo-bag mixup augmentation for multiple instance learning-based whole slide image classification. IEEE Transactions on Medical Imaging, 43(5):1841–1852, 2024.
[9] Jiawei Yang, Hanbo Chen, Yu Zhao, Fan Yang, Yao Zhang, Lei He, and Jianhua Yao. Remix: A general and efficient framework for multiple instance learning based whole slide image classification. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 35–45. Springer, 2022
[10] Gou, Jiaxiang, et al. "Queryable prototype multiple instance learning with vision-language models for incremental whole slide image classification." Proceedings of the AAAI conference on artificial intelligence. Vol. 39. No. 3. 2025.
[11] Ilse, Maximilian, Jakub Tomczak, and Max Welling. "Attention-based deep multiple instance learning." International conference on machine learning. Pmlr, 2018.
[12] Li, Bin, Yin Li, and Kevin W. Eliceiri. "Dual-stream multiple instance learning network for whole slide image classification with self-supervised contrastive learning." 2021 IEEE/CVF conference on computer vision and pattern recognition (CVPR). IEEE, 2021.
[13] Wong, Bryan, et al. "Few-shot learning from gigapixel images via hierarchical vision-language alignment and modeling." Advances in Neural Information Processing Systems 38 (2026): 71313-71354.
[14] Shi, Jiangbo, et al. "Vila-mil: Dual-scale vision-language multiple instance learning for whole slide image classification." 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2024.
[15] Li, Jiawen, et al. "Dynamic graph representation with knowledge-aware attention for histopathology whole slide image analysis." 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2024.
[16] Huang, Peixiang, et al. "HyperPath: Knowledge-guided hyperbolic semantic hierarchy modeling for wsi analysis." International Conference on Medical Image Computing and Computer-Assisted Intervention. Cham: Springer Nature Switzerland, 2025.
Questions for authors
Please refer to the Critical Weaknesses section. I look forward to response addressing these points.
6 comments
Response to Reviewer NzUB - W1-A
W1-A. Hierarchical and multi-resolution approaches
"HIPT [1] progressively refines representations … class tokens across resolutions receive complex, contextualized attention scores via self-attention. … numerous studies have leveraged multi-resolution strategies to mitigate the oversmoothing of information [2-7]."
We agree that hierarchical and multi-resolution MIL are the closest related line of work and that the manuscript should position DI-MIL against it explicitly. We first clarify the conceptual relationship, then give a direct comparison.
Conceptual relationship. Multi-resolution methods [2–7] and DI-MIL both aim to expose evidence that a single tile embedding dilutes. They differ in where the additional granularity comes from:
- Multi-resolution methods add granularity before encoding. The WSI is re-tiled and re-encoded at several magnifications (or a high-resolution teacher is distilled into a low-resolution student [3]). Fine-scale evidence therefore requires additional image crops and encoder passes, and the fine-scale encoder sees a smaller field of view.
- DI-MIL adds granularity after encoding. Each tile is encoded once at its native size. Its dense tokens, each of which has already attended to the whole tile, are grouped into instances. Granularity increases without re-tiling, and every instance keeps the full tile context.
- The two are orthogonal. DI can be applied at any magnification of a multi-resolution pipeline: for example, by decomposing the dense tokens of each scale's tiles before cross-scale fusion.
Regarding HIPT [1] and single attention scores. We thank the reviewer for this point and agree that our statement should be made precise. The statement that each tile "can only receive a single weight" refers to the standard two-stage pipeline (one embedding per tile, then slide-level aggregation). In HIPT, the [CLS] tokens of 256-px patches are indeed contextualized by self-attention in the 4096-px region transformer. At each level of the hierarchy, however, a 256-px patch still enters the next level as a single [CLS] token, so its internal tokens are summarized before slide-level weighting. DI is complementary: it can decompose the 256-px ViT's dense tokens instead of forwarding only its [CLS] token. We did not include HIPT as a baseline. Its released weights come from hierarchical self-supervised pretraining on H&E 256/4096-px regions, and a faithful cytology counterpart would require re-pretraining both stages on cytology slides, which is beyond the scope of the rebuttal. We will make the scope of this statement explicit in Sections 1 and 3 and discuss HIPT in the related work.
Direct comparison with a multi-resolution MIL baseline. We implemented CS-MIL [2] with its official model and training recipe (cross-scale attention, cluster-stratified sub-bag sampling, gated-attention MIL). Its input uses Smart-CCS features at three concentric scales (300/600/1200 px, matching the official 2× ratio) on the same folds. We ran it on Respiratory and Oral2026, the two datasets on which our full tile-size ablation (Table 5) was already available:
| AUC (3 seeds) | Respiratory | Oral2026 | Extraction cost relative to DI |
|---|---|---|---|
| Tile-ACMIL (1200 / 2048 px) | 80.17 ± 0.70 | 87.45 ± 0.65 | 1× |
| CS-MIL [2] (300 + 600 + 1200 px) | 80.83 ± 0.77 | 84.51 ± 1.06 | ≈25× GPU-hours (Resp.) / ≈57× tiles (Oral) |
| DI-ACMIL (ours) | 88.39 ± 0.19 | 87.89 ± 1.12 | 1× (+4% for clustering) |
DI-ACMIL outperforms CS-MIL by +7.6 (Respiratory) and +3.4 (Oral2026) AUC points, and does so in every seed (6/6). CS-MIL needs features at all three scales. On Respiratory, extracting the 600-px and 300-px features costs 3.91× and 20.15× the GPU-hours of the native 1200-px features (Appendix A.9), so CS-MIL requires ≈25× the extraction compute of DI. On Oral2026 it requires ≈57× as many tile crops (Figure 2). This is consistent with Table 5, where single-scale finer tiling also stays below DI on both datasets while multiplying the extraction cost. We did not repeat multi-scale extraction on Cervical and Serous Fluid (≈1,900 and ≈1,600 tiles per slide), where the same 20–25× multiplier would apply. Avoiding exactly this cost is the practical motivation for DI.
Revision. We will add a dedicated related-work paragraph on hierarchical and multi-resolution MIL covering [1–7]. We will state the before-encoding versus after-encoding distinction and the complementarity above, and we will add CS-MIL to Table 2 and Table 5.
Response to Reviewer NzUB - W1-B
W1-B. Clustering-based MIL and motivation-matched baselines
"Multiple studies have already incorporated clustering for instance selection and aggregation within MIL [8-10]. … the clear distinction … remains insufficiently articulated. … such clustering-based approaches should be included as direct baselines."
We agree that the distinction must be stated precisely.
Distinction. In short, clustering-based MIL methods reorganize the bag, whereas DI-MIL redefines the instance.
| PseMix [8] | ReMix [9] | QPMIL-VL [10] | PTCMIL (Table 2) | DI-MIL | |
|---|---|---|---|---|---|
| What is clustered | tile embeddings across a slide | tile embeddings across a slide | tile embeddings vs. learned prototypes | tile embeddings across a slide | dense tokens within one tile |
| Purpose | pseudo-bag mixup augmentation | bag reduction and latent augmentation | prototype memory for incremental learning | prompt-guided slide prototypes | finer instances |
| Atomic unit seen by the aggregator | tile (or coarser) | prototype (coarser than tile) | prototype | prototype | sub-tile instance |
| Information mixed inside a tile embedding | not recoverable | not recoverable | not recoverable | not recoverable | separated before pooling |
All four methods operate on tile embeddings that have already been pooled. Once a sparse abnormal cell has been averaged with the surrounding background into one tile vector, no subsequent clustering across tiles can separate it again. DI-MIL operates one step earlier, inside the tile, on the dense tokens that the frozen encoder already computes. It therefore changes what enters the bag, while clustering methods change how the bag is organized or augmented. The two can be combined: ReMix, for example, can build its prototypes from DI instances.
Direct baselines. Table 2 of the submission already includes PTCMIL. We have now added ReMix [9] with its official code (per-slide K-means prototypes, covariance-based latent augmentation, official ABMIL head):
| AUC (3 seeds) | Cervical | Serous Fluid | Respiratory | Oral2026 |
|---|---|---|---|---|
| PTCMIL | 94.63 ± 0.02 | 84.43 ± 0.49 | 79.36 ± 0.49 | 86.10 ± 1.47 |
| ReMix [9] | 93.43 ± 0.32 | 83.67 ± 0.14 | 80.95 ± 0.60 | 84.23 ± 2.36 |
| DI-ACMIL | 95.52 ± 0.17 | 88.12 ± 0.15 | 88.39 ± 0.19 | 87.89 ± 1.12 |
DI-ACMIL outperforms both clustering-based methods on all four datasets and in every seed (12/12 dataset–seed pairs against each method). We did not run QPMIL-VL [10]: it requires a pathology vision-language encoder with class-level text prompts and targets class-incremental learning, which differs from the frozen-vision-encoder, fixed-label setting studied here. We will discuss it, together with PseMix [8], in the related work.
Motivation-matched baselines. We agree that DTFD-MIL and MambaMIL address different problems. Including the additions in this response, Table 2 now contains, for each family relevant to DI-MIL's motivation:
- multi-resolution: CS-MIL [2];
- clustering and prototypes: ReMix [9], PTCMIL;
- graph-based relational modeling: WiKG [15] (newly added, discussed in W2);
- the original attention, sequence and pseudo-bag baselines.
Revision. We will add ReMix, CS-MIL and WiKG to Table 2, insert the comparison table above into the related work, and state the "reorganize the bag versus redefine the instance" distinction explicitly in Sections 1 and 2.
Response to Reviewer NzUB
We sincerely thank the reviewer for the careful and knowledgeable review. We value the recognition that recovering intra-tile information from dense tokens adds no encoder cost, that cytopathology is an under-served domain, and that DI-MIL is a plug-and-play module across ViT-based encoders. The reviewer raised four substantive concerns: (1) positioning against hierarchical/multi-resolution and clustering-based MIL, together with motivation-matched baselines; (2) whether our critique of single-attention aggregation over-generalizes; (3) single-seed evaluation; and (4) reproducibility and presentation. We found each of them well-founded. We address them below with new experiments, and we commit to the corresponding revisions.
Protocol for all new results. Unless stated otherwise, every method uses the same Smart-CCS features, the same cross-validation folds (10-fold for Cervical, Serous Fluid and Respiratory; 5-fold for Oral2026), and the same training protocol as the paper. For each seed we average the test metric over folds. We then report the mean ± standard deviation across seeds. The comparisons against baselines (Table 2) use three seeds (1024, 2024, 3407), and every method has all three seeds. The Tile-versus-DI comparison (Table 1) uses five seeds (1024, 2024, 3407, 42, 7). All seeds that were run are reported; none were excluded.