acceptodds
Under review as a conference paper at ICLR 2027

The Class Prior as a Domain-Dependent Bias: Layer-Wise Visual Prompt Synthesis for Frozen-CLIP Zero-Shot Anomaly Detection

Abstract

CLIP-based zero-shot anomaly detection treats the class-semantic prior as a resource the text branch must supply, whether through class names, handcrafted templates, or per-class descriptions. This paper argues that under cross-domain transfer the prior is instead a domain-dependent bias term. Replacing the class-name slot with a per-layer, image-conditioned prototype read-out stays within 0.5 points of the strongest conditional-prompt baseline, while the class-name prompt itself trails that read-out by 3.7 points, so the prior is not a requirement. Its removal yields 5.1/6.6 points at pixel level in the medical domain against 0.3/0.1 in the industrial domain, an order-of-magnitude difference between two domains evaluated under one protocol, which is the pattern predicted by a bias term and not by a method that is uniformly stronger. Within the prompt the learnable component is what carries the adaptation: discarding it costs 8.8/17.0 points, so what proves indispensable is the prompt's optimizable position in CLIP text space rather than what it says. Because each tapped visual layer synthesizes its own prompt, the construction is structurally distinct from prior methods, which match multi-layer evidence against a single prompt. On 14 industrial and medical benchmarks under a unified protocol, the method matches or exceeds the strongest baselines in accuracy while using 1284 GFLOPs against AdaCLIP's 5570, a factor of 4.3, and running at 12.0 FPS against 5.5, with neither a class name nor a handcrafted state word at inference.

Primary area:
applications to computer vision, audio, language, and other modalities
Keywords:
Anomaly detection, Zero-shot learning, Prompt tuning, Cross-modal alignment.

Reviews

Among:
Shape:
1234this paper, Bottom 1%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.00 over 3 reviews, above 0% of the others.
Reviewer_Rsp8OpenReview ↗
Rating
1
Confidence
4
Informativeness
1
Presentation
3
Soundness
2
Read review
Paper summary

This paper proposes EAD, a CLIP-based framework for zero-shot anomaly detection. It introduces Category-Agnostic Prompt Synthesis (CAP) to generate image-conditioned prompts from visual prototypes and a shared learnable anchor, together with Hierarchical Parallel Adaptation (HiP) to integrate multi-layer features without modifying the frozen CLIP backbone. The authors argue that class-semantic priors can introduce domain-dependent bias and report competitive performance and improved inference efficiency on 14 industrial and medical benchmarks.

Critical strengths
  1. The paper addresses the practical limitations of category-dependent prompts and computational overhead in CLIP-based anomaly detection.
  2. The parallel adaptation design provides meaningful efficiency improvements over AdaCLIP, reducing computational cost while improving inference speed under the reported evaluation setup.
Critical weaknesses

1. Limited methodological novelty. The proposed framework largely follows the existing paradigm of dynamic prompt learning for CLIP-based anomaly detection. Related methods such as AdaCLIP, FAPrompt, and MRAD-CLIP have already explored learnable prompts, visual-conditioned prompt generation, or dynamic prior integration. Although the proposed layer-wise construction differs in implementation, its fundamental novelty over these methods remains unclear.

2. Insufficient evidence for the necessity of the proposed modules. Table 8 shows that removing the visual prototype component causes relatively limited performance degradation, whereas removing the learnable anchor leads to much larger drops. This raises questions about whether the main improvements come from the proposed visual prompt synthesis or simply from learnable prompt tokens. A controlled comparison with a single shared prompt across layers would help clarify the actual contribution of the layer-wise design.

3. Inadequate comparisons with recent methods. The experimental comparisons omit several recent and highly relevant CLIP-based ZSAD methods, particularly FAPrompt and MRAD-CLIP. Moreover, the improvements over AdaCLIP on industrial anomaly localization are marginal (0.3 AUROC and 0.1 max-F1). Without comparisons against stronger and more recent baselines, the claimed performance advantages remain insufficiently established.

4. Insufficient justification for the domain-dependent bias claim. The paper argues that class-semantic priors introduce domain-dependent bias, but this conclusion is primarily supported by differences in performance gains across domains. AnomalyCLIP already employs static, object-agnostic learnable prompts without relying on category-specific semantics. How does the proposed method fundamentally differ from this approach? Could the observed improvements mainly result from learnable prompt optimization rather than removing category semantics? Controlled experiments using correct, generic, and corrupted class descriptions would help substantiate the central claim.

5. Limited evidence for the accuracy-efficiency trade-off and statistical reliability. Although the proposed framework achieves notable computational savings compared with AdaCLIP, the efficiency gains largely rely on an existing parallel adaptation strategy. It remains unclear whether the method offers a superior accuracy-efficiency trade-off compared with more recent approaches. Furthermore, given the marginal improvements on several benchmarks, results across multiple random seeds are needed to establish the statistical reliability of the reported gains.

Questions for authors

Please refer to the concerns and questions raised in the Critical Weaknesses section.

Reviewer_CTyqOpenReview ↗
Rating
1(−1)
Confidence
4
Informativeness
1
Presentation
3
Soundness
2
Read review
Paper summary

The paper proposes a new approach to zero-shot anomaly detection, called EAD. The main idea is that, unlike other CLIP-based methods, the text sequence should also include visual evidence (that is, visual tokens should be appended to the text tokens before passing them to the text encoder). To do so, the visual prototypes are constructed from the patch features. The model is then evaluated on standard datasets.

Critical strengths
  • The idea of adding visual information to the text stream makes sense.
  • The model is efficient for a CLIP-based method
Critical weaknesses

Major weaknesses:

  • The method is not compared to the current state of the art, but rather to methods from 2024 (AdaCLIP, the second-best method in the paper, was published at ECCV 2024). A comparison with the current SOTA (AnomalyVFM [1] and VisualAD [2]) is warranted, or at least a mention in the related work. AnomalyVFM, for instance, significantly outperforms the method across all industrial datasets.
  • Figure 8 holds too little information for the reader to understand. How is a reader supposed to know what a,b,c, and d on the horizontal axis for each graph mean? This significantly reduces the quality of the ablation study.

Minor Weaknesses:

  • Figure 6 also does not provide any new information beyond what we already had from the pixel-level results. This figure only tells us that EAD mostly correctly predicts the mask.
  • Figure 5 has the same problem, as it is not clear from the Figure alone what is depicted. What is depicted on each of the axes? Which are the text embeddings and which are the visual ones?
  • It is not possible to discern from Figure 8 which backbones were used. How is performance with SigLIP2 [3] or DINOv2.txt [4]?
  • The effect of empty tokens is nowhere explored.

Remarks:

  • Two different references cite the same work (Aota et al.).
  • The dataset used is KSDD2, not KSDD

[1] Fučka, M., et al. (2026). AnomalyVFM--Transforming Vision Foundation Models into Zero-Shot Anomaly Detectors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 35555-35566).

[2] Hou, Y., et al. (2026). VisualAD: Language-Free Zero-Shot Anomaly Detection via Vision Transformer. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 21346-21356).

[3] Tschannen, M., et al. (2025). Siglip 2: Multilingual vision-language encoders with improved semantic understanding, localization, and dense features. arXiv preprint arXiv:2502.14786.

[4] Jose, C., et al. (2025). Dinov2 meets text: A unified framework for image-and pixel-level vision-language alignment. In Proceedings of the Computer Vision and Pattern Recognition Conference (pp. 24905-24916).

Questions for authors
  • What are the things explored in Figure 8? Specifically, what are the a,b,c and d on the vertical axis of the final three graphs? This either reduces my questions or raises new ones. The current format is not suitable for a top-tier conference paper.
  • What is depicted in Figure 5? To me, it currently seems more random than showing any signal.
  • How does the method perform when empty tokens are discarded?
  • What is the performance when using SigLIP2 or DINOv3.txt?

After the rebuttal period, the authors did not post a rebuttal, so I am lowering my score to reject.

Reviewer_P7THOpenReview ↗
Rating
1
Confidence
3
Informativeness
1
Presentation
1
Soundness
1
Read review
Paper summary

The paper proposes a new method for the task of Zero-Shot Anomaly Detection (ZSAD), where information about the target class for anomaly detection is not available at training time. After an initial categorization of existing methods for ZSAD and evidence of related issues, consisting in category-specific prompt brittleness and sequential adaptation overhead, the paper proposes a new framework, called EAD aimed at addressing such shortcomings.

It consists of two designs, category-agnostic prompt synthesis (CAP) and hierarchical parallel adaptation (HiP), which target the two main identified issues. Specifically, CAP acts on prompts without reliance on manually specified text or classes, but only based on learnable prototypes and image features. HiP organizes multiple CAP modules in parallel, reducing overhead.
EAD is experimentally evaluated on multiple datasets of two real case domains: industrial and medical. The authors report image and pixel level AUROC and max-F1 at the optimal threshold. They further measure GFLOPs, Parameter count and FPS to test their method efficiency. The comparison is performed against 2 baselines per “method type” (prompt, partial, adaptive tuning).

The conclusion is that class-semantic prior on the text prompt is not always necessary. In some domains class information brings active knowledge and best results, in some others is much less informative and can be discarded.

Critical strengths

The task of Zero-Shot Anomaly Detection is relevant for the community and a relevant one to pursue.

Figure 1 clearly describes three types of tuning approaches for ZSAD, and that part of the introduction is the clearest part of all the paper.

Tables 1 and 2 consider a large set of datasets, which well cover both the medical and the industrial domain.

Critical weaknesses

Overall, the paper is very poorly written and hard to understand. Several sentences are unclear or confusing, and the paper does not take the relevant room to discuss what is important, wasting space in often unnecessary technicalities. Some examples include:

  • Abstract spends 1 sentence to introduce the task and 1 sentence in describing what the paper argues. The remaining is a listing of results, without any detail about what the paper proposes/the contributions should be. This makes the abstract very hard to follow without having the paper in mind.
  • The proposed framework is termed “EAD”, but nowhere it is specified if this is an acronym, and what this stands for.
  • Figure 2 and 4 are difficult to read and interpret, especially in relation to section 3. For instance, Equation 1 introduced the output of the vision encoder as class tokens and patch features. The notation does not find correspondences with the one in the figure, where class token do not appear and patch token appear In figure 2 B with different notation (“F” vs “f”). Figure 3 is cited as one line at the end of Section 3.2, but it likely belongs to appendix rather than methodology section.
  • The results section is built around short paragraphs, with almost no room to explain metrics, datasets, details and discussion. Instead, several tables and ablations are present, but most of them should likely belong to appendix (e.g. Figure 5 and Figure 7), as well as most ablative tables. Also, the discussion is integrated with hardly interpretable or apparently incomplete sentences, including lines 358-359: “Two readings survive, since the medical baselines may be weaker for reasons unrelated to prompt construction and category-semantic strength is never measured independently of the outcome.”, and line 377: “ACLIP and AdaCLIP, which suggests that prompt synthesis and layer aggregation sharpen the discriminative structure of the anomaly features.”

Apart from writing, other critical issues include the motivation and contributions of the paper, as presented in the Introduction. Specifically, the two main motivations paragraphs are presented without any supporting reference, making it hard to judge their relevance. Some relevant methods that do not use class priors already exist (like AnomalyCLIP) making it necessary at least a thorough discussion on what specifically current baselines are still missing, with opportune citation support. Moreover, it is difficult to distinguish the difference between the first two contributions listed, as they both seem to present the framework as the contribution, only with different levels of detail.

Experimentally, main tables 1,2 are missing relevant baselines, and the effectiveness of the method is unclear. In one text paragraph (lines 346-357) authors seem to suggest that their method is not clearly superior than the competitors. Therefore, the main contribution should not be read as a SOTA claim, but rather as a baseline of a method not using semantic priors. However, other methods that do the same are not cited in the paper, and should be included in the tables. Examples:

Qiyu Chen, Zhen Qu, Wei Luo, Haiming Yao, Yunkang Cao, Yuxin Jiang, Yinan Duan, Huiyuan Luo, Chengkan Lv, and Zhengtao Zhang. Cops: Conditional prompt synthesis for zero-shot anomaly detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 8554–8563, 2026b. Included in references, never cited in main text or compared in tables.

Hou, Yanning, et al. "VisualAD: Language-free zero-shot anomaly detection via Vision Transformer CVPR (2026). Missing Fučka, Matic, Vitjan Zavrtanik, and Danijel Skočaj. "AnomalyVFM--Transforming Vision Foundation Models into Zero-Shot Anomaly Detectors CVPR (2026). Missing

Regarding the efficiency comparison in table 3, only some methods from tables 1,2 are compared, without apparent reason. Moreover, from the table it results clear as the proposed method is not parameter-efficient. It is also unclear where the average “ACC” comes from, since it differs from the values in Tables 1,2.

Questions for authors

Minor Suggestions
The authors should check citations, as there are at least two duplicated papers reported:

Toshimichi Aota, Lloyd Teh Tzer Tong, and Takayuki Okatani. Zero-shot versus many-shot: Unsupervised texture anomaly detection. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 5564–5572, January 2023a. Reported twice and cited as two different citations in previous work.

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. In International conference on machine learning, pp. 8748–8763. PMLR, 2021a. Cited only once in the main paper, reported twice in citations.

Also, one citation at line 140 is reported with full list of authors, without apparent reason and inconsistent with the format of the remaining paper.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.