- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Problem Setting
- Structured inspection QA is required for intuitive use of the inspection system
- Vision-language foundation models are used to ground inspection results, but their deployment is limited in edge computing environments.
- As a lightweight alternative backbone, a frozen CLIP model can be considered. However, standard CLIP readouts are dominated by coarse object appearance and often fail to capture weak, localized defect evidence.
Method
- The proposed method extracts patch-level residuals between a query image and a matched normal reference using a frozen CLIP backbone. It then projects out empirical normal variations estimated from normal-normal pairs (normal-quotient projection), scores candidate text hypotheses by measuring how well they are explained by offline-fitted shared-private defect subspaces, and finally reuses the routed subspace energies at the patch level to achieve decision-aligned grounding.
Claim
-
Normal-referenced CLIP residuals reveal coherent, defect-family directional structures rather than simple scalar abnormality magnitudes.
-
Projecting out empirical normal variations via the normal-quotient operation effectively eliminates reference-dependent nuisance signals and stabilizes decision margins.
-
Shared-private defect subspaces capture intra-family defect variations without suffering from prototype collapse, enabling sensitive scoring of dynamic candidate hypotheses.
-
The routed subspace energies can be reused directly for patch-level localization, achieving decision-aligned grounding without requiring an auxiliary detection head or mask supervision.
-
A frozen 0.15B CLIP backbone equipped with the proposed readout achieves competitive structured inspection QA performance against 4B–8B MLLMs while requiring substantially lower latency (56.30 ms) and peak memory (1.62 GB).
Critical strengths
- This paper is generally easy to follow
- The authors conduct extensive experiments and analyze the proposed method from multiple perspectives
Critical weaknesses
-
Despite improvements over the vanilla CLIP baseline, the absolute performance on AnomalyCoT remains limited (41.19% accuracy and 0.1742 IoU). These results raise concerns about whether the proposed method can achieve the level of reliability required for practical industrial inspection. The authors should clarify the intended deployment scenarios and discuss whether the reported performance is sufficient for such applications.
-
The proposed method relies on the availability of abnormal samples for offline training. However, abnormal data are often scarce in industrial inspection settings, and the available samples may not adequately represent the diversity of defects encountered in practice. This reliance on abnormal support data may limit the applicability of the proposed method in real-world industrial environments
-
Table 1 compares methods evaluated under different adaptation and supervision settings. While several baselines are evaluated in zero-shot or non-adapted settings, the proposed method is trained offline using four defect samples per family. This discrepancy raises concerns about the fairness of the comparison. In my experience, even a small number of adaptation steps can substantially improve foundation models' performance on a target dataset, particularly when adaptation is limited to a lightweight projection layer, as in this paper. Therefore, evaluating the baselines under comparable adaptation and supervision settings would provide a fairer basis for comparison.
-
In Section 3.1, the operator Pool performs global average pooling over the patch-level residuals , yielding a single global representation (r). This operation collapses the local residuals into a single vector, making it conceptually similar to a global residual prototype. However, the authors distinguish their approach from prototype-based readouts without clearly explaining how the pooled representation differs from a prototype. This ambiguity may mislead readers regarding the actual distinction between the proposed method and prototype-based approaches. The authors should clarify this distinction, particularly given that (r) is used for option scoring.
-
The central contribution is claimed to be the identification of a “residual readout bottleneck” in structured inspection QA. However, this bottleneck is neither clearly defined nor convincingly established. If the claim concerns the representational capacity of CLIP, it is difficult to justify, given the authors' own premise that CLIP residuals already contain defect-family directions. If, instead, the bottleneck lies in how these representations are read out, the paper does not sufficiently establish why this constitutes a fundamental problem specific to structured inspection QA, rather than a limitation of the particular readout strategies considered.
This weakens the conceptual clarity and significance of the proposed contribution.
Questions for authors
- Why did authors choose CLIP as the backbone for the proposed method ? Have authors considered alternative vision-language encoders, such as SigLIP, SigLIP 2, or other recent VLMs ? It would be helpful to understand whether the proposed method is specific to CLIP or generalizes to other VLM representations.