- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper analyzes patch-order sensitivity by reordering feature indices. In terms of design, the paper presents K learnable projection directions and samples M empirical quantiles in each direction to achieve permutation-invariant learning for WSI classification. The proposed method outperforms SOTA methods on both binary and multi-class classification datasets.
Critical strengths
-
I appreciate that the authors highlight that order sensitivity is not inherent to contextual interactions at the WSI level.
-
The novelty of the paper lies in projecting patch features along K learnable directions and integrating them into gated attention pooling for classification.
-
At the decision level, the separation between attention-pooled local evidence and distributional information is sensible for heterogeneous WSIs.
Critical weaknesses
-
Equation (4) computes soft quantile coordinates using distances between projected scores and quantile values. However, these coordinates are sensitive to score scales, even when patches have the same quantile ranks. Why do the authors use this approach instead of exact ranks or normalized scores? A comparison with these alternatives would help justify the proposed design.
-
The distinctive patch-positioning mechanism has a limited isolated gain. Removing FiLM leads to a larger accuracy drop than removing quantile coordinates on both ablation datasets. This suggests that global bag conditioning may explain much of the improvement. The current ablation does not fully distinguish quantile-relative positioning from a simpler globally conditioned attention or FiLM model (Table 2).
-
Although QDMIL avoids quadratic attention, its N×K×M soft-assignment tensor introduces a memory bottleneck for large bags. For 10,000 patches, QDMIL uses 210 MiB of memory and 1.68M parameters, compared with 71 MiB and 0.33M parameters for ABMIL.
Questions for authors
See the weakness
3 comments
Responses to Authors
Thank you for the detailed response and the additional experiments. I appreciate that you also reported results that do not favor your method.
W3 (memory): The chunked implementation and the parameter-matched control resolve my concern.
W1 (coordinates): Thank you for the comparison. The three coordinate forms perform similarly, so please state in the revision that the specific form of Eq. (4) is not critical, and include the normalized soft variant as you proposed.
W2 (global conditioning): The new comparison is helpful. I have a few remaining questions:
On PANDA, Global FiLM with mean and standard deviation outperforms QDMIL (0.7772 vs. 0.7628, p = 0.0011). You explain this by the small bag size, but Appendix E.3.4 reports that QDMIL’s gains are largest in the smallest-bag quartile. Could you clarify how these fit together? The BRACS value for QDMIL in the new tables (0.8453) seems to be the M=65 setting rather than the shared configuration (0.8427). Which configuration was used for these comparisons?
I also suggest revising the abstract and conclusion so that the classification benefit of global conditioning and the benefit of quantile positioning are stated separately, as you already proposed. However, I remain positive about the paper.
We clarified the PANDA quartile results and BRACS configurations, and revised the manuscript to distinguish global conditioning from quantile positioning.
1. Main text revisions
Thank you for your positive assessment and for suggesting a clearer separation of the two contributions. We revised the abstract to state separately that global conditioning contributes strongly to classification and that quantile positioning improves attention alignment with annotated tumor tissue. The conclusion makes the same distinction and specifies that the annotation evidence comes from PANDA. Section 4.3 now introduces the controlled comparisons and guides readers to the appendix. Most new experimental results and configuration details appear in Appendices E.3.7, E.3.10, and E.3.11. These revisions are marked in blue.
2. PANDA quartiles
Thank you for pointing out the apparent tension in the PANDA quartile results. The quartile gains compare each model with DyHG. The 0.7772 versus 0.7628 result instead compares Global FiLM directly with QDMIL. In the smallest quartile, both methods have their largest gains over DyHG, with Global FiLM gaining more. Global FiLM also exceeds QDMIL in every quartile. The revised Appendix E.3.11 therefore treats the PANDA preference for the moment summary as a dataset specific result. It does not attribute that difference to bag size, since the quartiles may also differ in class composition.
| PANDA bag quartile | QDMIL over DyHG, ACC points | Global FiLM over DyHG, ACC points | Global FiLM over QDMIL, ACC points |
|---|---|---|---|
| Q1, smallest | +2.93 | +4.66 | +1.73 |
| Q2 | +1.66 | +3.25 | +1.59 |
| Q3 | +1.25 | +1.82 | +0.57 |
| Q4, largest | +0.38 | +2.26 | +1.88 |
3. BRACS configuration and matched comparisons
Thank you for noticing the differing BRACS values. The 0.8453 BRACS ACC comes from the additional matched comparison with , , and . The shared configuration in the main comparison uses , , and and gives 0.8427. Global FiLM with coordinates matches QDMIL's grid settings in each additional comparison. Global FiLM itself has no grid settings. For PANDA, the additional QDMIL run uses and gives 0.7628, while the shared configuration gives 0.7592. Appendices E.3.7 and E.3.10 and their captions now identify these runs explicitly.
The matched results below show QDMIL leading both moment controls on TCGA-KIRP, Brain-Mets, and BRACS. PANDA is the exception. There, Global FiLM reaches 0.7772 versus 0.7628 for QDMIL, with a Holm adjusted paired McNemar .
| Dataset | QDMIL | Global FiLM | Global FiLM with coordinates | QDMIL |
|---|---|---|---|---|
| TCGA-KIRP | 0.8878 | 0.8692 | 0.8654 | 64, 17, 0.2 |
| Brain-Mets | 0.9372 | 0.9198 | 0.9285 | 64, 17, 0.2 |
| BRACS | 0.8453 | 0.8275 | 0.8301 | 64, 65, 0.2 |
| PANDA | 0.7628 | 0.7772 | 0.7756 | 64, 17, 0.05 |
We added coordinate and global conditioning comparisons and a chunked implementation to clarify QDMIL’s benefits and memory cost.
Q1. Scale sensitivity of soft quantile coordinates
Thank you for noting the scale dependence. Scaling projected scores changes the effective temperature in Eq. (4). We compared the original coordinates with normalized soft coordinates and exact empirical ranks while keeping the rest of the model fixed. The original form leads both metrics on KIRP and PANDA in the table below. The pairwise differences are not significant. A direct standardized score control on KIRP also trails at 0.8729 ACC and 0.8127 F1-Score. We retain soft coordinates because they are differentiable and preserve distances to slide quantiles, whereas exact ranks discard those distances. The normalized soft form provides a scale invariant alternative, which we will include in the revision.
Q2. Quantile positioning and global conditioning
The component ablation shows a larger effect from FiLM than from quantile coordinates. To examine the role of global conditioning, we replaced the quantile grid with patch mean and standard deviation while retaining the FiLM, bag encoder, attention pooling, and classifier. We also tested this simpler model with quantile coordinates. QDMIL leads both variants on KIRP, Brain Mets, and BRACS, as the table below shows. The cohortwise differences are not significant, but the direction is consistent across these three large bag datasets. PANDA favors Global FiLM by 1.44 ACC points, with Holm corrected p=0.0011. The quantile design also improves pathology localization. On 1,000 randomly sampled PANDA slides with tumor annotations, QDMIL raises the tumor fraction among the top 10% attended patches from 0.547 to 0.566 relative to Global FiLM. Tumor patch AUROC rises from 0.856 to 0.871, with the coordinate variant between them on both measures. We will revise the contribution claim to distinguish the classification benefit of global conditioning from the localization benefit of quantile positioning.
Q3. Memory and parameter cost
Thank you for identifying the dense assignment tensor as a memory bottleneck. Each patch's assignment is independent, which lets us compute it in chunks with activation recomputation. This preserves the output without storing the full N×K×M tensor. At 100,000 patches, peak memory falls from 1,760 to 1,077 MiB for inference and from 3,822 to 2,182 MiB for training. With chunks of 4,096 patches, inference takes 12.9 ms rather than 14.2 ms for the dense version, while training takes 34.3 ms rather than 32.7 ms. Chunking leaves 1.68M parameters unchanged, mostly in the grid encoding networks, whose size does not depend on bag size. On KIRP, a 1.72M parameter gated attention control reaches 0.8614 ACC versus 0.8878 for QDMIL. We will use the chunked implementation in the revision. The table below reports peak memory in MiB under the same profiling setup.