- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper explores how influential feature noise is on downstream zero-shot performance. To do so, they explore how much a decision direction influences the overall performance. To do so, they train a small detector that fixes this and evaluate it on MVTec AD.
Critical strengths
- Thinking about how to reduce noise in the CLS token and the patch features makes sense.
Critical weaknesses
Major Weaknesses:
- The method is tested only on one dataset (MVTec AD). This is far below the usual number of datasets used in zero-shot anomaly detection. Typically, we use ~7 industrial datasets and ~5 medical datasets. Due to testing on only one dataset, the conclusion cannot be conclusive.
- It is highly unlikely that the introduction does not contain a single reference. On top of this, the whole paper is poorly written and hard to understand.
- A lot of things are presumed without any introduction. For instance, the test on 48 defect classes is just described with the results, and simply stated that the explanation is in the supplementary. You have half a page left; use it to describe things more effectively.
Minor Weaknesses:
- Many mathematical symbols are not defined but are instead assumed to be known. This decreases the readability substantially.
Questions for authors
How does the proposed method work on other datasets? See VisualAD or AnomalyVFM for a list of datasets.
Overall, the biggest problem with this paper is the presentation. I do not see a way to improve this without a substantial rewrite. As a result, it is highly unlikely that I will change my mind.