- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ADClaw, an agentic workflow tailored for 2D and 3D industrial anomaly detection. To enable evidence-grounded detection, the authors design an iterative, tool-callable pipeline integrated with an anomaly knowledge base. Empirical evaluations show that ADClaw achieves strong performance across several benchmarks compared to standard non-agentic baselines.
Critical strengths
-
This paper provides a comprehensive and extensive empirical evaluation across a wide range of benchmarks, covering 2D, 3D, and multimodal industrial anomaly understanding scenarios.
-
The proposed inspection workbench effectively minimizes redundant visual computations through stateful evidence resue, demonstrating benefits in reducing inference latency and computational overhead during multi-step inspection.
Critical weaknesses
- Unclear problem formulation and motivation
-
The paper introduces several components, including structured normality priors, persistent evidence management, and hypothesis-guided evidence reasoning. However, it remains unclear what specific limitation(s) is(are) solved from this architecture, and why these components are required to address this(those) limitation(s).
-
Overall, the framework appears to be an ad-hoc integration of an agentic workflow evaluated on public benchmarks. Due to the lack of precise problem formulation, it is difficult to identify what fundamental challenge is solved or the key scientific insights gained from this study.
- Unfair comparison with baselines
- Table 1 and Table 2 compare ADClaw, which performs iterative, tool-augmented inspection, against baselines that operate in a single-pass setting without comparable tool-use capabilities. Consequently, the reported performance differences may reflect the effectiveness of whether tool usage is available or not.
- Insufficient Clarity
-
The number of normal samples used for inference is a crucial experimental factor in industrial anomaly detection. However, the evaluation protocol does not specify how many normal samples are utilized per inference. In other words, this missing detail makes the comparison with baselines ambiguous.
-
In Section 3.4, the authors describe Hypothesis-Guided Evidence Reasoning (HER). Although s̃ₑ is referred to as a calibrated score, the paper does not explain how this anomaly score is calibrated. Furthermore, key details regarding the predefined tool weight are missing, specifically, what values are used and how they vary across datasets. This is important because could critically affect performance. Lastly, the process of acquiring is left completely unspecified. Since the authors highlight HER as one of their core contributions, these omissions raise significant concerns regarding clarity and reproducibility.
-
Table 5 compares the performance achieved under varying tool-calling setups. However, details regarding these setups are missing, making it difficult to determine which specific components actually drive the performance gains.
- Unclear Methodological Novelty
- While the individual components are not strictly identical, both AnomalyClaw and ADClaw rely on heavily overlapping concepts that perform substantially similar functions—such as tool-based evidence usage, anomaly score calibration, candidate localization, iterative inspection loops, anomaly knowledge base (in case of AnomalyClaw, this uses RAG), and analytical capabilities. Because these core mechanisms serve equivalent roles, it remains difficult to discern what specific problem ADClaw aims to solve or what distinct advantages it offers over AnomalyClaw. Beyond minor technical variations, the underlying architectural philosophy appears virtually the same.
Questions for authors
- I noticed 3D dataset in the experiment while the main text mostly uses standard 2D illustrations. Is there anything special in how the agent handles 3D, or does the general reasoning pipeline work as-is ?