- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
A reconstruction-based anomaly detection method is built on frozen DINOv3-S tokens. The authors vary two factors. They train the detector on raw tokens or on L2-normalized tokens. They then score each trained model with or without the L2 distance. One score sums the L2 distance and the cosine distance between each reconstructed token and its target. The other score only uses cosine distance. Under the first score (sum the L2 distance and the cosine distance), the anomaly detection model trained on normalized tokens has 12 to 39 points lower mAD than the raw-token model on five of six datasets. Under the cosine distance alone, the anomaly detection models trained on raw tokens or normalized tokens perform about the same. The normalized model therefore loses accuracy only when it is scored with the L2 distance. The authors conclude that normalization itself does not hurt the detector. They explain that the L2 distance depends on the scale of the tokens, which normalization changes, while the cosine distance is scale invariant. They also test Dinomaly, INP-Former and a published UniAD checkpoint. They recommend comparing reconstruction detectors under a scale-invariant score.
Critical strengths
- The rescoring design is clean. Each trained model is scored with and without the L2 distance, so training randomness does not affect the comparison between the two scores.
- The drop in Table 2 is large, is measured with paired seeds, The drop disappears on all six datasets only under the cosine distance.
- The paper openly reports that its first explanation was wrong and retracts a result that did not replicate. The proposed reporting rule is easy to adopt.
Critical weaknesses
- The contribution is limited. It is widely known that an L2 distance is sensitive to the scale of its target, while a cosine distance is not. The paper does not show that any published method or benchmark is impacted by this finding. The claim that detectors “usually” L2-normalize each token is also not supported by the references.
- The statistics and reporting need work. Seed counts also disagree. Section 3 gives two seeds for MVTec-AD and VisA, while Table 2 and Figure 2 give three for every dataset. Appendix B, which should hold the per-seed values behind Table 2, lists only seed 133 for four datasets and two seeds for wafer. Please give all per-seed values. Section 4.5 also mentions "pre-registered" bands without any registration record.
- The related work and references contain errors. Section 2 says HVQ-Trans and UniMMAD work "on a frozen DINOv2 backbone and score with cosine residuals". HVQ-Trans uses a frozen EfficientNet-b4 and an ℓ2 residual with an optimal-transport term, and UniMMAD uses a WideResNet50 prior. The medical benchmark is attributed to Huang et al. (2024), but that benchmark has no ultrasound data and no BUSI. Please state where the four sub-datasets come from. Several reference entries have wrong author lists, for example UniMMAD and Dinomaly2. Table 5 dates Dinomaly to CVPR 2024, while the reference list correctly gives CVPR 2025. The ADer benchmark (Zhang et al.) appears in Section 4.5, Table 4 and the Conclusion but is not cited, and the "few-shot work on DINOv3" in Section 2 has no citation.
Questions for authors
- Is there a published detector or benchmark comparison whose conclusion changes under your rescoring rule?
- How many seeds were run per dataset, and what are the per-seed values for every cell of Table 2?
- In each arm, how much of the ℓ2 residual comes from the norm of t̂ and how much from its direction?