- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates multi-class anomaly detection and localization using RGB and depth information. UniMRE establishes separate RGB and joint RGBD normal feature libraries for each class, then processes the retrieval results through a two-stage expert network, and combines cross-branch conditional information and learnable pixel-level fusion to obtain the final prediction. During testing, the model first estimates the class of the input and then selects the corresponding feature library. Experiments on three datasets show that UniMRE outperforms UniMMAD in image-level detection, with a more significant advantage when there are fewer normal training samples, but the improvement in localization performance is not consistent.
Critical strengths
- Retaining a separate RGB retrieval branch while using a combined RGBD branch is a reasonable choice, balancing aesthetics and geometry. The ablation results in Table 3 also support this design: the I-AUROC of RGB+RGBD is 93.3%, higher than 92.2% for RGB+Depth and 88.1% for using only RGB.
- The improvement achieved with a small number of samples is significant. Table 2 shows that on the MVTec-3D dataset, the I-AUROC is 85.2% when using five normal samples per class, compared to 72.5% for the reproduced UniMMAD baseline. Appendix E.1 also shows that the I-AUROC is 84.1 ± 0.8% in three sample subsets, strongly demonstrating that the results are not dependent on a single favorable subset.
- This evaluation covers three datasets and tests an important practical assumption: selecting the correct category during inference. Appendix E.3 reports that routing accuracy reached 100% on the MVTec-3D and Eyecandies datasets, and 95.3% on the MulSen-AD dataset. This demonstrates that memory for selecting a specific category can be achieved without providing category labels at test time.
Critical weaknesses
- The comparisons do not sufficiently separate the effect of the feature encoders from that of the proposed architecture. UniMRE uses DINOv3-S and DUNE-S, while Appendix E.2 matches input resolution without establishing a comparison using the same encoders. This matters particularly for the relatively small full-shot I-AUROC gains on MVTec-3D and Eyecandies.
- I am unsure which version of the fusion module was used in the experiments. Equations (8) through (10) describe a convolutional gate with class bias that is trained using a focus loss, but the version in Figure 5 also includes class embedding, FiLM residual refinement, and image-level loss. The paper should clarify whether these additional components were used to obtain the reported results.
- The advantages of the two-stage expert architecture need to be demonstrated with stronger evidence. As shown in Table 4, the retrieval function alone achieves 92.2% I-AUROC and 95.0% I-F1, while the corresponding figures for the full model are 93.3% and 95.0%, respectively. Comparison with simpler learned predictive heads helps determine whether the increased complexity of expert routing and the two-stage structure is worthwhile.
- The efficiency comparison does not directly establish an advantage over the main unified baseline. Table 5 omits UniMMAD and takes the measurements for M3DM and MulSen-TripleAD from another paper, without establishing that the measurement conditions are comparable. Reporting UniMMAD under the same hardware and timing protocol would make the deployment comparison more convincing.
Questions for authors
- Which RGB and geometry encoders were used in the UniMMAD reproductions in Tables 2 and 19? Were they the same as those used by UniMRE?
- Which fusion components and losses were used for the reported results? Specifically, were the class embeddings, FiLM residual refinement, and image-level loss shown in Figure 5 included?
- What components are retained in the “Retrieval Only” setting in Table 4, particularly for fusion and image scoring? Are there any existing comparisons with a simpler prediction head that help establish the benefit of the two-stage expert architecture?
- Does the reported latency of 0.185 s include feature extraction, category assignment, retrieval, and fusion? Are UniMMAD measurements available under the same hardware and timing protocol?