- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ADThinker, a framework for industrial anomaly understanding using Hierarchical Knowledge Preference Optimization (HKPO). The authors construct a knowledge base from Real-IAD and use it to generate preference pairs following three stages: object identification, defect knowledge, and answer prediction. HKPO combines adaptive branch-level weighting with segment-level preference optimization. Experiments on MMAD and SSGD show improvements over the backbone and several existing MLLMs.
Critical strengths
S1. ADThinker achieves strong results on MMAD, particularly in anomaly discrimination, where it substantially improves over its backbone and several existing anomaly-specific MLLMs. The improvement on SSGD is also encouraging.
S2. The paper provides useful comparisons against different post-training strategies and ablations on the proposed optimization components. The results suggest that both branch-level and segment-level optimization contribute to the overall performance.
Critical weaknesses
W1. Sec. 2 argues that existing methods insufficiently ground anomaly reasoning in visual evidence and anomaly semantics. However, JUDO [1] directly addresses both through segmentation-based visual reasoning, domain-knowledge SFT, and domain-oriented GRPO. Despite its close relevance to the paper's motivation, JUDO is completely omitted from both the related-work discussion and the experimental comparisons in Table 1, even though it also reports results on MMAD. This makes it difficult to assess the claimed research gap and how the proposed approach differs from existing work.
W2. The generalization claims seem stronger than what the experiments demonstrate. The authors explicitly claim generalization to unseen defects in Sec. 1, but Real-IAD and MMAD contain similar defect morphologies. The SSGD experiment evaluates unseen object categories, which does not necessarily demonstrate generalization to unseen defect types.
W3. The paper emphasizes learning a hierarchical diagnostic reasoning process, but the evaluation relies on multiple-choice accuracy. There is no direct evaluation of the correctness of the generated intermediate reasoning, making it difficult to determine whether the improvements reflect better diagnostic reasoning or primarily better answer selection.
References
[1] Kang et al., JUDO: A Juxtaposed Domain-Oriented Multimodal Reasoner for Industrial Anomaly QA. ICLR 2026.
Questions for authors
Q1. Does ADThinker generate the full <context>...</context><answer>...</answer> response during MMAD evaluation? It would be helpful to see actual generated reasoning on held-out samples, particularly logical anomalies, to better understand how the proposed reasoning process works in practice.
Q2. Could the authors clarify the overlap in defect categories between Real-IAD and MMAD/SSGD? In particular, are there evaluation defect types that are not represented in the constructed knowledge base?
Response to Authors
Thank you for the targeted revisions. The branch-label audit, full-response SFT+DPO control, and intermediate-diagnosis evaluation substantially address my main concerns. These results provide better evidence that the gains extend beyond richer supervision and final-answer selection alone. The incremental novelty remains modest, and improved diagnostic outputs do not fully establish the claimed reasoning hierarchy, but I find the additional evidence supportive of my current weak-accept recommendation.