- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work presents HPMD-AD, a multi-view industrial anomaly detection framework that aggregates cross-view information through hierarchical dynamic prototype aggregation, performs anomaly detection and localization by coupling dual masking with prototype-conditioned diffusion-based reconstruction, and adaptively fuses view-specific anomaly scores. Without requiring explicit spatial alignment, it delivers competitive results on the Real-IAD and Real-IAD Variety datasets.
Critical strengths
This work adopts hierarchical dynamic prototypes to encode both view-specific information and cross-view shared structures. By obviating the need for explicit spatial alignment, the method is highly suitable for industrial inspection scenarios marked by significant viewpoint variations. Experiments conducted on two large-scale multi-view datasets yield competitive performance across object-level detection, single-view detection, and pixel-level localization tasks. Furthermore, ablation studies and contextual experiments — evaluating factors such as viewpoints and random noise — offer compelling evidence supporting the effectiveness of the key design elements and the successful exploitation of cross-view information.
Critical weaknesses
(1) Prototypes are generated directly from the features of the current input, and the training objective is limited exclusively to feature reconstruction loss. During inference, if the input contains defects, such defects may propagate into view-level prototypes and further affect sample-level prototypes. The paper does not include an explicit normal prototype bank, normality constraints, or mechanisms to suppress anomaly information. Furthermore, prototype masking is only applied at the sample-level aggregation stage; the original view-level prototypes remain intact and serve as reconstruction conditions for their respective views. Consequently, even if a local feature is masked, information from that region can still enter the reconstruction network via prototype conditioning. While dual masking may mitigate shortcut learning, no evidence is provided to confirm that it fully eliminates the anomaly reconstruction shortcut.
(2) PPAFS equates cross-view consistency with reliability, a strategy that carries the risk of diluting genuine defect signals originating from single views.
(3) The prototypes are essentially compressed representations derived from learnable queries via cross-attention. The paper fails to establish whether distinct prototypes assume stable functional roles, whether redundancy exists across prototypes, or whether sample-level prototypes genuinely capture structures shared across views. Moreover, the “remove prototype conditioning” experiment presented in Table 3 simultaneously reduces both information input and model capacity, which confounds the analysis and makes it impossible to isolate the specific contribution of the prototype structure itself.
(4) All key variants in Table 3 retain diffusion-based reconstruction; accordingly, these experiments only demonstrate the utility of prototypes and masking within a diffusion framework. They do not address whether comparable results can be obtained by pairing the same hierarchical prototype approach with a standard Transformer-based reconstructor. Existing methods such as Dinomaly have already achieved strong performance using simple Transformers, noise bottlenecks, and reconstruction-based designs. The authors should compare deterministic reconstruction, single-step denoising, and three-step diffusion under identical experimental conditions — reporting both performance and computational cost metrics — to clarify the specific benefits conferred by the diffusion module.
(5) Although the paper adopts only a three-step DDIM sampling scheme, the pipeline still requires processing five DINOv2 inputs and performing full reconstruction. Simply citing the use of an H100 (80 GB) GPU is insufficient to demonstrate deployment efficiency; additional metrics including object-level latency, VRAM consumption, parameter count, and inference throughput are also required.
Questions for authors
Clarification Questions:
(1) How does the method prevent anomalous features from contaminating the view-level and sample-level prototypes during inference? Since view-level prototypes remain unmasked and are used as reconstruction conditions, how does the dual-masking strategy prevent potential anomaly reconstruction shortcuts?
(2) How does PPAFS handle defects that appear in only one view? Could the cross-view consistency constraint suppress genuine view-specific anomalies, and is there evidence that the method preserves such defect signals?
(3) In Table 3, removing prototype conditioning also reduces the information available to the reconstructor and potentially changes its effective capacity. Is there a capacity-matched ablation that can isolate the contribution of the hierarchical prototype structure itself?
Suggestions for Further Evaluation:
(1) A comparison with deterministic Transformer reconstruction and single-step denoising under the same experimental settings would help clarify whether the diffusion module provides benefits beyond the hierarchical prototype design. Both detection performance and computational cost should be reported.
(2) Please report end-to-end inference latency, peak GPU memory usage, parameter count, and throughput to better assess the practical efficiency of the proposed method, particularly given its use of five DINOv2 inputs and diffusion-based reconstruction.
15 comments
Q1. Prototype Contamination and Reconstruction Shortcuts
Our design mitigates anomalous information leakage and reconstruction shortcuts through two complementary mechanisms. First, VPs are generated from view-specific features via learnable-query cross-attention, while SPs are further aggregated from VPs across all five views, rather than directly from potentially anomalous spatial features. Trained exclusively on normal samples, these learnable queries encourage the aggregation of representative normal patterns. Although VPs remain unmasked to preserve view-specific structural information, they are compact representations rather than spatially aligned patch features, reducing the risk of direct feature-copying shortcuts. Second, dual-masked diffusion reconstruction further reduces reliance on local information: prototype masking (PM) regularizes SP conditioning, while spatial masking (SM) removes partial noisy spatial features, encouraging context-aware reconstruction rather than direct reproduction of local anomalous patterns.
As shown in Figure 4 of the revised manuscript, the similarity maps averaged over eight VPs exhibit stronger responses in normal regions and weaker responses in annotated anomalous regions across representative Real-IAD categories. This suggests that VPs predominantly capture normal patterns even from anomalous inputs. Since SPs are further aggregated from VPs across all five views, rather than directly from the original spatial features, this hierarchical structure further reduces the risk of anomalous information propagation. Together, these mechanisms and observations support that our method mitigates anomalous information leakage and reconstruction shortcuts.
To further investigate how VPs and SPs contribute to reconstruction, we conduct cross-attention analysis and cross-view context evaluation.
Each view is reconstructed using eight view prototypes derived from its own features and four sample prototypes aggregated from the prototypes of all five views. We analyze attention across all 12 DiT blocks, dividing each group's total attention by its number of tokens to obtain the average attention per prototype. The analysis covers all 30 Real-IAD categories, with 20 normal and 20 anomalous objects per category, totaling 1,200 objects and 6,000 views.
The results are as follows.
| DiT blocks | Normal patches: VP (%) | Normal patches: SP (%) | Anomalous regions: VP (%) | Anomalous regions: SP (%) |
|---|---|---|---|---|
| 1–4 | 8.36 | 8.28 | 8.04 | 8.93 |
| 5–8 | 6.64 | 11.73 | 5.94 | 13.13 |
| 9–12 | 7.95 | 9.10 | 7.38 | 10.25 |
| Average | 7.65 | 9.70 | 7.11 | 10.78 |
The attention analysis reveals two key observations. First, anomalous regions consistently assign higher attention to sample prototypes (SPs) than normal regions, with average weights of 10.78% and 9.70%, respectively. This suggests that reconstruction of anomalous regions relies more heavily on cross-view contextual information. Second, attention shifts toward SPs in intermediate blocks. Specifically, in blocks 5–8, attention to SPs reaches 11.73% for normal patches and 13.13% for anomalous regions, compared with 6.64% and 5.94% for view prototypes (VPs), respectively. Although this difference narrows in later blocks, SPs continue to receive higher attention than VPs. These observations support the complementary roles of view-specific representations and cross-view contextual information during reconstruction.
The paired context experiment in Table 2 of the original manuscript further examines whether the aggregated cross-view information benefits reconstruction. With evaluated views and annotations held fixed, adding one, two, and three context views yields mAD gains of 0.46, 0.63, and 0.87 points, respectively. Together with the attention results, this supports the use of complementary information from other views through sample-prototype conditioning.
Q2. Preserving Single-View Anomaly Evidence in PPAFS
To investigate whether prototype-consistency weighting suppresses genuine view-specific anomalies, we construct an evaluation subset comprising normal samples and anomalous samples with defects visible in exactly one of the five views. The toy and zipper categories contain no such single-view anomalous samples and are therefore excluded, leaving 28 Real-IAD categories for evaluation. We compare PPAFS with mean and max fusion, reporting sample-level detection performance and the average fusion weight assigned to the anomalous view.
The results are as follows.
| Fusion | Sample AUROC (%) | Sample AP (%) | Sample F1-max (%) | Anomalous-view weight (%) |
|---|---|---|---|---|
| Max | 84.8 | 72.6 | 71.0 | 58.3 |
| Mean | 85.7 | 69.9 | 71.9 | 20.0 |
| PPAFS | 86.7 | 73.8 | 73.6 | 30.4 |
As shown above, PPAFS assigns an average weight of 30.4% to the anomalous view, exceeding the 20.0% under mean fusion, indicating that prototype-consistency weighting does not systematically suppress anomalous-view contributions. Unlike mean fusion with fixed uniform weights or max fusion that favors the strongest response, PPAFS dynamically adjusts view contributions based on prototype reliability and cross-view disagreement, balancing single-view anomaly evidence with information from other views. Consequently, PPAFS achieves the best sample-level AUROC/AP/F1-max of 86.7%/73.8%/73.6%, outperforming both mean and max fusion. Although max fusion assigns a higher average weight (58.3%) to the anomalous view, its inferior detection performance suggests that indiscriminately emphasizing the strongest response may also amplify spurious high responses in normal samples, potentially increasing false positives. These results demonstrate that PPAFS preserves single-view anomaly evidence on average while achieving more reliable anomaly detection.
We are grateful for your detailed review and the care with which you examined our work. Your questions encouraged us to look more closely at the reasoning behind our design choices. We have clarified these points in the revised manuscript. Summary of Revisions:
We clarify how hierarchical prototype modeling and dual-masked diffusion reconstruction mitigate anomalous information leakage and reconstruction shortcuts, supported by prototype–patch similarity visualizations. The corresponding analyses have been added to Appendix F (Figure 4).
We analyze the complementary functional roles of view-level and sample-level prototypes through per-prototype cross-attention statistics across DiT layers. The results and discussions have been added to Appendix G (Table 9).
We evaluate fusion reliability on a Real-IAD subset comprising normal samples and anomalous samples with defects visible in exactly one view. PPAFS outperforms both mean and max fusion in sample-level AUROC, AP, and F1-max. Among the anomalous samples, PPAFS assigns an average weight of 30.4% to the defective view, compared with 20.0% under mean fusion. We report these results in Appendix D (Table 7).
We conduct controlled comparisons of prototype configurations, showing that hierarchical prototype modeling improves sample-/image-level AUROC by 5.2/6.6 percentage points over flat cross-view prototypes. The results and analyses have been incorporated into Section 4.6 (Table 5).
We compare three reconstruction strategies under matched settings: deterministic Transformer reconstruction, one-step DDIM, and three-step DDIM. We report detection accuracy and inference costs in Appendix K.1 (Table 12).
We provide a comprehensive accuracy–efficiency trade-off analysis, reporting inference latency, throughput, peak GPU memory, and parameter counts for the full and lightweight configurations. These results are included in Section 4.5 (Table 3), with evaluation details in Appendices I and J.
All newly added and revised content is highlighted in blue in the revised PDF for ease of reference.
We provide detailed point-by-point responses and supporting experimental results below.