- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper establishes theoretical foundations for detecting off-manifold anomalies and proposes an iterative reconstruction framework to replace anomalous pixels with normal pixel counterparts. Specifically, it shows that the Bayesian optimal reconstruction operator exactly recovers uncorrupted normal pixels and replaces anomalous pixels with the posterior mean of the corresponding normal pixels before corruption. Building upon on this observation, they introduce iterative reconstruction during inference to suppress anomalous information during entire reconsturction process. They evaluate proposed methodology on MVTecAD and VisA, demonstrating that their proposed PAE achieve competitive performance compared with previous reconsturction-based methods.
Critical strengths
S1: The paper is well-written and easy to follow.
S2: This paper revisits prevalent reconstruction-based AD approaches in terms of manifold projection. The established theoretical grounding helps readers to understand how reconstruction-based AD works and its benefits compared with other boundary-based methods.
S3: Experimental results show that the proposed methodology achieves better performance than boundary-based approaches and remains competitive compared with previous reconstruction-based methods.
Critical weaknesses
W1: It is unclear whether the statement in L291–292 follows from Theorem 1.
As f^*_{N(x_hat)}(x_hat) = x_hat_{N(x_hat)} in Eq. 7 only proves the forward implication of Eq. 5, it is necessary to show that
f^*_{A(x_hat)}(x_hat) = E_{p(x | x_hat)}[x_{A(x_hat)}] also proves the reverse implication of Eq. 5. This may require an additional assumption beyond the scope of Theorem 1.
W2: As they introduce an extra segmentation module to extract foreground regions, which is not widely used in the field of SAD, it is better to include results without such a segmentation module for a fair comparison.
W3: The current experimental evaluation lacks comparison between widely used methodologies. Because the proposed PAE relies on pseudo-anomalies generated using DTD texture datasets, it should be compared with other DTD-related AD methods: TransFusion [1], PRN [2], DeSTSeg [3]. Also, as this paper focuses on the "corruption-then-recover" paradigm of AD, it would be better to add more comparisons against diffusion-based methods, including DeCoDiff [4], DiffusionAD [5].
W4: While the proposed PAE achieves better performance on MVTecAD and VisA, it is still unclear whether this approach scales to more difficult and large-scale datasets, including MANTA [6], Real-IAD [7].
W5: The current experimental analysis does not seem to sufficiently support the claim in this paper. Specifically, there is no analysis of corruption strategies in the provided manuscript. Because weaker corruption may induce identical shortcuts and degrade detection performance, such a corruption strategy plays a key role for reconstruction-based AD. Also, more implementation details should be provided, including feature extractors, number of iterations during inference, and other details.
References
[1] Fučka+, "TransFusion – A Transparency-Based Diffusion Model for Anomaly Detection." ECCV'24, https://doi.org/10.1007/978-3-031-72761-0_6.
[2] Zhang+, "Prototypical Residual Networks for Anomaly Detection and Localization." CVPR'23, https://doi.org/10.1109/CVPR52729.2023.01562.
[3] Zhang+, "DeSTSeg: Segmentation Guided Denoising Student-Teacher for Anomaly Detection.", CVPR'23, https://doi.org/10.1109/CVPR52729.2023.00381.
[4] Beizaee+, "Correcting Deviations from Normality: A Reformulated Diffusion Model for Multi-Class Unsupervised Anomaly Detection", CVPR'25, https://doi.org/10.1109/CVPR52734.2025.01778.
[5] Zhang+, "DiffusionAD: Norm-Guided One-Step Denoising Diffusion for Anomaly Detection", TPAMI, https://doi.org/10.1109/TPAMI.2025.3570494.
[6] Fan+, "MANTA: A Large-Scale Multi-View and Visual-Text Anomaly Detection Dataset for Tiny Objects", CVPR'25, https://ieeexplore.ieee.org/xpl/conhome/11091818/proceeding.
[7] Wang+, "Real-IAD: A Real-World Multi-View Dataset for Benchmarking Versatile Industrial Anomaly Detection", CVPR'24, https://doi.org/10.1109/CVPR52733.2024.02159.
Questions for authors
All questions mostly correspond to the weakness section.
Q1: Could you clarify whether L291-L292 can be directly derived from Theorem 1 or still requires additional assumptions?
Q2: How about detection performance on VisA without an extra segmentation module?
Q3: Could you compare the proposed method with an additional 2 or 3 methods as listed in W3?
Q4: How about performance on large-scale datasets as mentioned in W4?
Q5: What kind of corruption strategy best suits reconstruction-based AD?
Q6: Could we extend the proposed framework without pseudo-anomalies? i.e., fully unsupervised AD.
Q7: Could you provide some efficiency numbers for the proposed PAE? It would be better to compare efficiency with other methods, as the proposed PAE introduces recurrent updates during inference.
In summary, this paper is well-written, and it provides a clear explanation of the success of the prevalent reconstruction-based AD methods. However, the proposed method, PAE, seems to be limited in some kind of corruption strategy and lacks broader empirical verification. If the authors have effectively addressed all of my concerns/questions, I would be willing to increase my score.