- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper presents ProtoZSAD, which combines CLIP visual features, normal and abnormal prototypes, balanced assignment, and gating mechanisms. The model is trained on industrial data and transferred to four medical datasets. Through prototype responses, branch removal, and interventions on brain images, the paper analyzes the model's anomalous responses to normal anatomical structures.
Critical strengths
The paper addresses a meaningful problem: false positives caused by normal anatomical structures in cross-domain anomaly segmentation. Prototype responses provide observable intermediate representations.
- Evaluation on four medical datasets, together with prototype removal and interventions on brain images with a control condition, provides evidence beyond heatmap visualization.
Critical weaknesses
-
The added explanatory value of the prototype analysis is unclear. The analysis mainly describes associations between prototype responses and segmentation errors. It does not sufficiently establish what deeper, testable insights into cross-domain failure mechanisms are gained beyond conventional feature-response analysis.
-
The rationale for key design choices and their individual contributions are insufficiently validated. In localized lesion segmentation, anomalous regions typically occupy only a small portion of the image. However, the paper uses balanced assignment that is independent of the lesion proportion, without sufficiently justifying its rationale or suitability. Moreover, optimal transport has already been used for balanced prototype assignment in PIRN (ICLR 2026) and prototype refinement in FastRef (CVPR 2026). The additional methodological contribution of the proposed combination remains unclear.
-
Comparisons with related segmentation methods and simple baselines are insufficient. The paper's prototype matching is similar to a regularized segmentation head, yet there is no comparison with AnomalyVFM (CVPR 2026), which uses a segmentation decoder. A segmentation-head baseline under the same backbone and training conditions is also missing. The evidence is therefore insufficient to establish the additional benefits of the prototype design.
-
Extensive equations are not accompanied by sufficient visual presentation and explanation. The method diagram provides limited detail, and the paper lacks illustrations that adequately explain the motivation, module mechanisms, and intervention effects. The main text devotes substantial space to equations and implementation details without corresponding intuitive analysis, making the overall method and analytical conclusions less clear.
Questions for authors
See above.
Response to Reviewer XPZA
Response 1. Answer to: Unclear added explanatory value of prototype analysis. Our analysis not only describe association between prototype response and segmentation errors but also indicates which characteristics of an abnormality are transferred from the industrial domain to the medical domain. For example, in Section 4.2.1, Figure 2, and Table 2, we use the same prototype as a reference unit for comparing visual patterns between the source and the target. Especially in the absence of characterization via prototypical analysis, it is difficult to draw profound conclusions regarding transfer errors associated with anatomical structures that exhibit high contrast.
Response 2. Answer to: Insufficient justification and validation of key design choices and balanced assignment.
Individual component contribution. The purpose and contribution of each component have been addressed in our Response 4. of reviewer ELKd.
Balaned Assignment. The role of balanced assignment is to distribute patch evidence across prototypes and prevent a small subset of prototypes from dominating the representation. Importantly, these balanced assignment scores are not used directly as the final abnormal prediction. DCAG subsequently filters abnormal prototype responses using two conditions: the response must be sufficiently strong (HA gate) and must exceed competing normal-prototype evidence (NR gate). Therefore, balanced prototype utilization does not imply balanced normal/abnormal pixel prediction. Consistently, the resulting abnormal false-positive-outside rates are 3.74%, 6.59%, 10.81%, and 8.46% on Retina, Breast, Brain, and Lung, respectively. We have clarified this distinction between prototype assignment and final anomaly localization in the revised manuscript.
We do not claim optimal transport or balanced assignment as our main contributions, as what we claim in lines 45–51. These are well-known building blocks employed in numerous papers, extending beyond just PIRN and FastRef. While both PIRN and FastRef focus on enhancing performance for few-shot learning, we instead approach the concept of prototypes through the lens of cross-domain knowledge transfer for zero-shot learning.
Response 3. Answer to: Insufficient comparisons with related segmentation methods and simple baselines. We do not compare with simple baselines. Our cited paper like MRAD-CLIP and VisualAD are two SOTA methods in ICLR-2026 and CVPR-2026. And our other cited prior works, which are also SOTA methods in 2024 and 2025, also use same backbone and are described in detail in Appendix Section: Experiment Setup.
Response 4. Answer to: Insufficient visual presentation and intuitive explanation of the method. We address a similar concern in our Response 2 to Reviewer ELKd. Please refer to that response for further details.