- Rating
- 3(+1)
- Confidence
- 4(+1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SQA-MIL, an MIL based approach for WSI classification using a frozen pathology foundation model. Instead of employing a complex trainable MIL aggregator, the method introduces a single learnable query to adaptively aggregate frozen patch representations.
Critical strengths
The paper propose a component that never been studied in the literature before, namely the query token of the PFM when we use it to extract the features.
From my view of point, the paper is interesting and well-motivated. And the paper shows that the even with a simple ABMIL, a better query model can improve model's performance even when comparing with more complicated MIL models.
Further, the paper might have potential implications for future PFM development, currently, all downstream tasks apply task agnostic query, in order to encoder richer information, researchers scaling the model size and the training data, I thought, the current method could inspire more efficient PFM architectures and downstream adaptation strategies.
The submission evaluate the method across different pathology encoders, limited-data regimes, and external validation. The results suggest that a single learnable query can achieve competitive performance with significantly fewer trainable parameters.
Critical weaknesses
My main concern is the lack of intuitive visualization showing how learned queries changes the representation space. As the central contribution of this paper is to propose a method which can improve the feature quality without scaling the PFM, I though a 2D visualization of the feature space can be useful, the author can consider to use TNSE or UMAP for the visualization.
Minor Comments
The submission title is inconsistent with the manuscript title. Please fix it.
Questions for authors
See the weakness.
3 comments
Thank you for the detailed response and for adding both the t-SNE visualizations and the quantitative representation-space analysis. My concerns have been fully addressed.
Reviewer S4CU
Dear Reviewer S4CU,
We sincerely appreciate your encouraging assessment and supportive rating. We are especially grateful for your recognition of the significance of task-specific query adaptation, its potential implications for future pathology foundation models, and its ability to achieve competitive performance without increasing foundation-model complexity.
We are delighted that the additional t-SNE visualizations and quantitative representation-space analysis have fully addressed your concerns. Your insightful suggestions have substantially strengthened the presentation of our central contribution. Thank you again for your thoughtful feedback and valuable support.
Best regards,
The Authors
Respond to Reviewer S4CU
We thank the reviewer for suggesting an intuitive visualization of how the learned query adapts frozen pathology representations.
We have added t-SNE visualizations on EBRAINS and CAMELYON16 in Figure 1, comparing the original mean-pooled representations derived from frozen pathology features with the representations obtained after single-query adaptation. As shown in Figure 1, the learned-query representations exhibit substantially clearer class separation and more coherent class-wise clustering, whereas the original representations show considerable overlap between different classes. These observations provide an intuitive illustration of how a single learnable query changes the organization of slide-level representations to better support downstream classification.
Importantly, SQA-MIL does not modify the pretrained pathology foundation model or its tile embeddings. Instead, the learned query adaptively reweights the existing tile features to construct task-specific slide representations. We attribute the observed improvement to the rich discriminative information already encoded in the high-dimensional pretrained feature space: rather than learning new features, a single query learns how to selectively aggregate the existing information into a more discriminative slide-level representation.
This observation is further supported by quantitative measurements in the original high-dimensional representation space (Table B.9). On EBRAINS-fine, single-query adaptation improves linear-probe balanced accuracy from 0.620 to 0.716, increases the mean classification margin from 0.384 to 0.587, and raises the between-class/within-class scatter ratio from 0.041 to 0.058. These measurements confirm improved class discriminability in the original representation space, independently of the two-dimensional t-SNE projections.
Together, the visualizations and quantitative results reinforce our central finding: strong pretrained pathology features already contain substantial task-relevant information, and a single learnable query can effectively extract and aggregate this information to produce more discriminative slide representations without modifying or scaling the foundation model. The t-SNE visualizations provide an intuitive illustration of this mechanism, while the original-space measurements establish its quantitative effect.
We thank the reviewer for pointing out this inconsistency. This was a submission-stage oversight: we inadvertently used an earlier working title in the submission form before finalizing the manuscript title. We have corrected the submission title to match the manuscript.