- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes Res$^2$CLIP for few-shot generalist anomaly detection. It subtracts the response of matched normal visual references from query features and aligns this visual residual with a normal-to-anomalous text residual. A magnitude-plus-projection score supports training-free detection; with labeled auxiliary categories, two residual adapters perform spatial calibration and semantic refinement. Experiments on MVTec AD, VisA, BTAD, MPDD, and DTD-Synthetic report strong average pixel-level AP and PRO across 1-, 2-, and 4-shot settings, along with extensive ablations.
Critical strengths
- The residual formulation is simple and interpretable, and separates deviation magnitude from alignment with anomaly semantics.
- Evaluation spans five benchmarks and three shot counts, compares several CLIP-based methods, and includes training-free and fine-tuned variants with detailed component ablations.
Critical weaknesses
- The evaluation does not ensure the stated class-disjoint generalist setting. The problem formulation requires (Sec. 3), but the protocol trains on the MVTec AD test set for VisA and uses VisA for MVTec AD (Sec. 4.1; Table 5). Both datasets include the capsule(s) category, so the source training set contains labeled examples from a category also evaluated as unseen in the target dataset. This is a category-level overlap even though the images come from different datasets. It weakens the central claim of generalization to unseen classes; the split should exclude overlapping categories or report results separately. The category overlap is documented in the MVTec AD paper and VisA dataset paper.
- The shared text residual may be too narrow for the claimed open-set anomaly semantics. The method uses a fixed generic-object prompt with a single anomalous state word (“damaged”; Appendix C), and Stage II encourages anomalous residuals across categories to align with that same direction. Magnitude scoring partly mitigates this limitation, but the semantic-refinement claim is not validated across distinct anomaly semantics, and the paper itself notes that one fixed text residual may not capture anomaly diversity (Appendix I).
- The likelihood argument does not derive the score used by the method. Appendix B assumes isotropic Gaussian normal and anomalous residuals with a mean shift along the text direction. Under those assumptions, the log-likelihood ratio is proportional to plus a text projection (Eq. 28), whereas the proposed score uses plus a weighted positive projection (Eq. 5). The assumptions are not empirically checked, and the actual score is therefore not justified as the derived likelihood ratio. The paper should present this as heuristic motivation or validate the assumptions and score form.
Questions for authors
- Can you report the results after removing the overlapping capsule(s) category from the auxiliary source data, so that training and target classes satisfy the disjointness in Sec. 3?
- What evidence supports using one fixed “damaged object” text residual across the evaluated object and texture categories? Does it remain effective when the anomaly prompt or semantic direction changes?
- Is the likelihood derivation intended only as motivation? If it is intended as justification, how do the Gaussian assumptions and squared-magnitude likelihood ratio support the norm-based score in Eq. 5?