- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper investigates reference‑guided multimodal industrial anomaly detection. The authors observe that existing multimodal large language models often fail to ground reasoning on real defect regions and underutilize normal reference images for cross‑image comparison. The proposed method has two stages: Comparative Attention Supervision for supervised fine‑tuning, followed by Comparative Evidence Policy Optimization for reinforcement learning.
Critical strengths
The problem setting of reference-guided multimodal industrial anomaly detection is meaningful; however, it is less compelling for supervised image anomaly detection.
Applying policy optimization to image anomaly detection is somewhat novel.
The proposed method is clearly described.
Critical weaknesses
I believe that reference-guided multimodal industrial anomaly detection is more suitable for training-free or few-shot image anomaly detection settings, rather than supervised image anomaly detection.
The proposed Comparative Attention Supervision (CAS) loss requires pixel‑level anomaly masks for the query image during supervised fine‑tuning. Since full pixel‑level defect annotations are expensive, the paper does not explore semi‑supervised or weak‑supervised settings.
CAS essentially adds multi‑term attention regularization loss on top of standard SFT. The idea of supervising decoder attention toward ground‑truth regions is not fundamentally new.
Comparative Evidence Policy Optimization (CEPO) builds directly upon GRPO, and the main difference lies in constructing an extra cross‑image comparative reward term. It is a incremental novelty.
There is no controlled study isolating the impact of inference‑time min‑p sampling. It is well‑known that min‑p strongly affects multimodal reasoning performance.
Computational overhead analysis is missing.
Equations (1)–(9) all end with a period, which is not standard formatting.
Some tables in the paper contain colored text or backgrounds.
Questions for authors
I believe that reference-guided multimodal industrial anomaly detection is more suitable for training-free or few-shot image anomaly detection settings, rather than supervised image anomaly detection.
I am not convinced that LLM-based approaches are particularly beneficial for image anomaly detection. Compared with conventional vision-based methods, they introduce additional language processing and cross-modal alignment components, yet the paper does not provide convincing evidence that these capabilities lead to substantial gains for image anomaly detection.
2 comments
Thank you for your discussions. My responses are as follows:
- Image anomaly detection, particularly industrial image anomaly detection, is a low-level vision task. I am skeptical that high-level LLMs can bring meaningful benefits to this task. In my view, the reported performance improvements are more likely attributable to overfitting. I am personally not enthusiastic about research on LLM-based image anomaly detection. In addition, sufficient work has already been published in this direction.
2-3. The title, “Comparative Evidence Policy Optimization for Multimodal Industrial Anomaly Detection,” and the statement that “reliable anomaly reasoning should be grounded in defect-relevant visual evidence and explicitly supported by comparison against the corresponding normal reference” do not provide me with any meaningful new insights.
The central keyword throughout the paper is evidence, yet it is used inconsistently, appearing as visual evidence in some places and comparative evidence in others. I believe the term evidence should not be used loosely, but should be clearly defined and consistently applied. Even setting aside the concerns about the novelty of the work, I find the writing of this paper insufficiently rigorous.
- “Introduce an attention-based design that enables more effective comparison between the query image and its normal reference” is indeed a incremental novelty.
Comment from Reviewer 6sEw: I believe Reviewer wUR8’s reasons for rejection are unjustified.
I'm Reviewer 6sEw. I believe Reviewer wUR8’s reasons for rejection are unjustified.
On what basis do you claim that reference-guided multimodal industrial anomaly detection is more suitable for training-free or few-shot settings than for supervised settings? Reference-guided anomaly detection is a modeling approach; it has no inherent restriction to training-free methods. A central research focus in MLLM-based anomaly detection is general anomaly detection: training a model that can subsequently detect anomalies in unseen categories without retraining. Relying solely on training-free approaches is insufficient to achieve this goal. An emerging direction is to post-train MLLMs on large-scale anomaly detection datasets to improve their generalization capabilities. MMR-AD was introduced precisely for this purpose, and its query–reference image pairs explicitly support reference-guided multimodal anomaly detection. The paper under discussion builds on this dataset. There is therefore no contradiction between using reference images and performing large-scale post-training before deployment.
Regarding the requirement for pixel-level annotations, MMR-AD already provides large-scale pixel-level supervision, and this paper investigates how to further improve MLLM-based anomaly detection using that dataset. Previous work primarily applied standard SFT and RL post-training without introducing designs specifically tailored to anomaly detection. This paper addresses a defining characteristic of the task—detecting anomalies through comparison with normal references—and proposes a valuable attention-based design to support that comparison. I consider this a meaningful contribution to MLLM-based anomaly detection. Dismissing the work simply because pixel-level annotations are expensive is not a convincing argument. The training paradigm studied here uses both normal and anomalous samples and differs fundamentally from traditional unsupervised anomaly detection. Rejecting a valuable contribution merely because it does not conform to your preferred problem setting is, in my view, highly irresponsible.
If you believe that the proposed method is “not fundamentally new,” please identify the existing work that already provides the relevant mechanisms and explain the specific overlap. Without concrete references and a substantive comparison, this assessment of novelty is difficult to find convincing.
As explained above, the authors specifically address the comparative nature of anomaly detection. Without changing the model architecture, and while retaining its pretrained knowledge, they introduce an attention-based design that enables more effective comparison between the query image and its normal reference, thereby improving anomaly detection. Your assessment appears to overlook this task-specific contribution and instead reduces the method to “adding an extra loss” or “constructing an extra reward term,” then uses “incremental novelty” as a reason for rejection. This does not adequately engage with what the method is designed to achieve or why that design matters for anomaly detection. I also consider this an irresponsible basis for rejecting the paper.