- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes HiNorm, a hierarchical normality learning framework for unsupervised anomaly detection in whole-slide images (WSIs). The method uses pretrained patch-level and WSI-level pathology foundation models to extract complementary representations. A dual-branch reverse distillation framework with asymmetric cross-level reconstruction is introduced to learn normal tissue patterns at both levels. Anomaly scores are computed from reconstruction discrepancies for patch-level localization and WSI-level detection.
Critical strengths
The proposed framework combines local organizational morphology with global WSI representation, utilizing a unified reconstruction framework and pre-trained pathological foundational models to provide a practically valuable solution for unsupervised anomaly detection.
Critical weaknesses
-
The paper argues that existing patch-based approaches overlook spatial organization and global tissue structure because they aggregate patch-level anomaly scores for WSI-level prediction. However, graph-based methods and Transformer-based WSI models can capture spatial relationships and global context during representation learning, even when their final predictions rely on patch-level aggregation.
-
In the patch reconstruction branch, multiple patch tokens attend to a single WSI token. Under standard softmax attention, a single key/value token produces attention weights that are always one, effectively broadcasting the same WSI information to all patch tokens. This raises questions about the actual role of the proposed cross-attention mechanism.
-
TITAN already provides global tissue representations learned from large-scale pathology data. It is therefore unclear how much of the WSI-level improvement comes from the proposed normality learning framework rather than the strong pretrained representations.
-
The framework mainly combines existing techniques, including reverse distillation, pretrained foundation models, dual-branch reconstruction, and cross-attention. Although their integration is effective, the proposed asymmetric reconstruction does not introduce a clearly distinct learning objective or explicitly constrain the relationship between patch-level and WSI-level normality.
Questions for authors
See weakness. In particular, clarifications regarding the single-token cross-attention mechanism and comparisons against anomaly detectors using frozen TITAN representations would be helpful.