- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
LACToS addresses local anomaly detection through the conditional typicality of superpixels. It uses an inlier diffusion model to generate shared denoising samples that approximate the otherwise expensive superpixel-specific inpainting posteriors. Per-superpixel histograms of pixel values and compressed features support anomaly scores based on deviations from the expected negative log-likelihood. The method is evaluated on medical imaging, human faces, and X-ray security screening together with toy experiments on inlier multimodality.
Critical strengths
The paper identifies a meaningful limitation of reconstruction-based anomaly detection. Collapsing plausible reconstructions into a point estimate can obscure multimodal inlier distributions. The proposed typicality score offers an interesting statistical perspective. Sharing denoising samples across superpixels makes its computation more tractable. The toy experiments directly examine the motivating problem of inlier multimodality. The evaluation also covers several application domains beyond industrial defect detection.
Critical weaknesses
-
My main concern is the evaluation protocol. Appendix E.3 states that all LACToS hyperparameters are selected by maximizing AUROC on 20 test images. The selected configuration is then evaluated on the whole test set. This reuses the ground-truth anomaly masks for parameter selection and can lead to optimistic results given the small test sets. Appendix E.4 states that SimpleNet, SuperSimpleNet, and GLASS use default parameters without tuning. SuperSimpleNet obtains 0.3786 AUROC on CHAOS. PatchCore, EfficientAD, and DDAD have only one or two tuned parameters. These choices make it difficult to assess whether the reported improvements reflect better generalization or more favorable parameter selection.
-
The experiments do not clearly establish the contribution of the proposed typicality score. Appendix G studies sample size, superpixel size, and feature weighting. It does not compare the typicality score in Eq. (5) with negative log-likelihood computed from the same estimated distributions. In Table 8 LACToS with M=1 already exceeds DDAD on FFHQ and DVXray although Appendix G states that it degenerates toward a reconstruction-error-like score. It is therefore unclear whether typicality itself provides an advantage over simpler distribution-aware scores or whether the gains mainly come from posterior sampling, feature augmentation, superpixels, and spatial smoothing.
3 Incorrect author information in the references. Line 548 incorrectly includes John Kieffer as the book's third author. The reference at lines 563 to 565 incorrectly includes the editor Peter Dayan as the second author.
Questions for authors
-
Could the authors repeat the main comparisons using disjoint validation and test sets with comparable tuning opportunities for all methods? Do the conclusions still hold particularly on DVXray where PatchCore has the higher AUROC and nearly equal AP and AUPRO?
-
How does the proposed typicality score compare with negative log-likelihood alone on the Multimodality Toy Experiment and the three main datasets with posterior samples, superpixels, features, histogram estimation, and spatial smoothing held fixed?
We would like to thank the reviewers for their constructive feedback. While we have decided to withdraw our paper and revise it, we respond to the main points raised. In particular: