- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes AnomalyPrompt, an LLM-guided adaptive prompting framework for zero-shot anomaly detection. The method retrieves global and local visual cues from hierarchical concept banks, uses an LLM to generate image-conditioned candidate prompts, and further employs an LLM-based evaluator to select the final prompt for image-level anomaly detection and pixel-level localization. The framework is clearly organized and achieves strong overall performance across multiple industrial and medical anomaly detection benchmarks. However, I still have concerns regarding the methodological novelty, as several components are closely related to existing work on retrieval, dynamic prompting, and LLM-based anomaly reasoning. In addition, the contribution of fine-grained semantic descriptions is not sufficiently isolated, and more targeted ablation studies would help clarify how different semantic cues affect the final performance.
Critical strengths
(1) Well-motivated framework. The paper addresses the limitation of static/passively optimized prompts and introduces image-conditioned prompt generation through global and local visual cues. (2) Coherent and interpretable design. The perception–reasoning–decision–execution pipeline is intuitive, and the generated natural-language anchors provide better semantic interpretability than purely learnable prompt tokens. (3) Strong empirical results. The method achieves strong overall performance across seven industrial datasets and further demonstrates cross-domain generalization on four medical benchmarks. (4) Relatively comprehensive ablations. The paper analyzes visual retrieval, global/local cues, prompt evaluation, candidate number, and different LLM scales.
Critical weaknesses
(1)The novelty is relatively conventional. The overall framework largely combines several existing ideas, including dynamic prompting, fine-grained textual descriptions, retrieval mechanisms, and LLM-based reasoning. For example, MRAD already explores retrieval-based anomaly detection, while AnomalyGPT investigates the use of large language/vision-language models for anomaly reasoning. (2)The effectiveness of the LLM Prompt Evaluator is not sufficiently justified. The same LLM is used for both candidate prompt generation and evaluation, while the evaluation criteria mainly focus on linguistic quality and consistency with visual cues rather than directly measuring actual anomaly discrimination capability. In addition, the evaluator is only compared against random selection, which is a relatively weak baseline. (3)The statistical robustness is unclear. The method uses stochastic LLM decoding, but the paper does not report mean and standard deviation over multiple random seeds. Therefore, it is difficult to assess whether some of the reported performance improvements are statistically reliable. (4)The test-time computational overhead is relatively high. For each test image, the framework performs both LLM-based candidate prompt generation and prompt evaluation. However, the paper does not provide direct comparisons with existing methods in terms of inference speed, latency, or throughput. (5)The performance may depend heavily on the manually designed or LLM-generated Concept Bank. The current paper does not sufficiently analyze the effects of the Concept Bank size, semantic coverage, and bank quality on the final performance. More fine-grained ablation studies would be helpful to clarify this dependency. (6)The SOTA claim is not fully accurate. Although the proposed method achieves strong overall average performance, it does not obtain the best result on every dataset or metric. For example, on MVTec-AD, some competing methods outperform AnomalyPrompt on several image-level and pixel-level metrics.
Questions for authors
(1)Novelty: Could the authors clarify the key methodological novelty of AnomalyPrompt compared with prior work on retrieval-based anomaly detection (e.g., MRAD), dynamic/fine-grained prompting, and LLM-based anomaly reasoning (e.g., AnomalyGPT)? In particular, which part of the proposed framework provides a fundamentally new contribution beyond combining these existing components? (2)Prompt Evaluator: The same LLM is used for both candidate prompt generation and prompt evaluation. Could the authors provide additional justification or evidence that the evaluator score is well correlated with downstream anomaly detection performance? Comparisons with stronger selection strategies, such as CLIP-similarity-based selection, an independent evaluator, or oracle prompt selection, would help clarify the effectiveness of this module. (3)Fine-grained semantic cues / Concept Bank: How sensitive is the performance to the design and semantic coverage of the Concept Bank? In particular, could the authors provide more fine-grained ablations on different types of semantic cues, such as global vs. local descriptions, defect-related vs. neutral concepts, or different Concept Bank sizes? This would help determine whether the gains mainly come from fine-grained semantic descriptions or from the overall prompting pipeline. (4)Statistical robustness: Since the LLM generation process uses stochastic decoding, could the authors report results over multiple random seeds with mean and standard deviation? This is particularly important because some of the improvements over prior methods are relatively small. (5)Inference efficiency: Could the authors provide a direct comparison of test-time latency or throughput with representative competing methods? Since both prompt generation and prompt evaluation are performed for each test image, this information would be important for assessing the practical applicability of the method in industrial inspection settings.