- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes MambaX-AD for unsupervised multimodal anomaly detection, extending cross-modal feature mapping with a region-aware contrastive learning based on feature-level pseudo-anomalies and a reciprocal Mamba-CNN cross-modulation mechanism for 2D–3D feature alignment. The method is evaluated on MVTec 3D-AD and Eyecandies, where it reports good image-level anomaly detection performance and competitive localization results.
Critical strengths
The experimental evaluation is relatively comprehensive. The paper evaluates the proposed method on both MVTec 3D-AD and Eyecandies, and includes component-wise ablations, multi-seed experiments, hyperparameter sensitivity analysis, and qualitative comparisons, providing reasonably broad empirical validation of the method.
Critical weaknesses
- Pseudo anomalies are constructed only on the target features while the cross-modal mapper still receives clean source features, making RA-CL closer to output-space margin regularization. It remains unclear why such target-side pseudo-negative repulsion should improve sensitivity to real anomalous inputs at test time.
- A nonzero negative weight is still assigned to uncorrupted regions and is justified as mitigating receptive-field leakage, although the pseudo anomalies are generated after feature extraction. If at these locations, the same normal feature is simultaneously subject to the positive alignment term and the negative margin penalty, resulting in conflicting optimization objectives.
- The claimed benefits of region-aware learning and local-global cross-modulation are not well supported by the ablation results, since the improvements in anomaly localization remain very limited and can even degrade when RA-CL replaces standard contrastive learning.
Questions for authors
- In RA-CL, pseudo anomalies are constructed only on the target features, while the cross-modal mapper still receives clean source features. Why can such a target-side pseudo-negative constraint improve sensitivity to real anomalous inputs at test time? In addition, when at uncorrupted locations, why is the negative margin penalty weighted by still applied?
- Table C.3 reports a higher inference FPS for MambaX-AD than for CFM despite introducing additional Mamba-CNN branches, reciprocal modulation, and feature fusion. Were CFM and MambaX-AD evaluated under exactly the same preprocessing, backbone, feature resolution, numerical precision, and implementation environment, and what specifically leads to the higher throughput?
5 comments
Why retain the negative penalty at uncorrupted locations.
We acknowledge the reviewer's observation that the positive and negative targets are identical at uncorrupted locations. Consequently, the two terms introduce competing optimization effects: the positive term encourages alignment with the clean normal target, while the negative margin term prevents excessively tight point-wise alignment within the prescribed margin.
We intentionally retain this term as a background soft-margin regularization, rather than treating uncorrupted locations as actual anomalies. Its purpose is to balance normal feature alignment and discriminative separation.
To verify its practical effectiveness, we conducted a sensitivity experiment under the complete MambaX-AD architecture, fixing and , while varying only . All configurations use the same random seed and identical remaining settings.
| I-AUROC | AUPRO@1% | |
|---|---|---|
| 0 | 0.976 | 0.448 |
| 1 | 0.982 | 0.456 |
| 3 | 0.974 | 0.448 |
Removing the background negative term () degrades both detection and localization performance, while increasing its weight to 3 also leads to worse results. The default value of 1 achieves the best performance among the tested configurations.
These results demonstrate that a moderate background negative weight is beneficial in practice, whereas removing it or applying excessively strong repulsion is detrimental. We will clarify this optimization behavior in the revised manuscript.
Effectiveness of the proposed RA-CL mechanism.
We thank the reviewer for examining the effectiveness of our two proposed mechanisms and raising concerns about their ablation results.
Regarding RA-CL, under the same multi-scale Mamba-CNN configuration, replacing Standard CL with RA-CL changes I-AUROC from 0.977 to 0.978, while AUPRO@1% decreases from 0.455 to 0.449. However, this comparison is conducted under an intermediate M-CNN architecture without reciprocal cross-modulation and should not be interpreted as the primary evidence for the independent effectiveness of RA-CL or the performance of our complete architecture.
To independently evaluate RA-CL, we conducted a controlled comparison without our second contribution. Standard CL achieves 0.972/0.455, whereas RA-CL achieves 0.974/0.455 (I-AUROC/AUPRO@1%). This demonstrates that our region-aware formulation provides additional image-level discriminative benefits while maintaining low-FPR localization performance. More importantly, introducing contrastive learning into normal-only cross-modal prediction constitutes the core of our first contribution, while region awareness further enhances this objective. This is also reflected in our staged ablation, where incorporating RA-CL after MS improves both metrics from 0.962/0.448 to 0.974/0.455. Thus, our first contribution encompasses not only region-aware weighting, but also the introduction of discriminative contrastive supervision, further enhanced through mask-conditioned pseudo-anomaly construction and region-aware weighting. Together, these results support the effectiveness of our first contribution as a whole.
Why target-side pseudo-anomalies improve real anomaly detection.
We sincerely thank the reviewer for the constructive comments and insightful questions regarding the target-side pseudo-anomaly construction, background negative weighting, and the effectiveness of our proposed mechanisms. We address each concern below.
We would like to clarify that target-side pseudo-anomaly construction is directly motivated by our cross-modal prediction-based anomaly scoring mechanism.
For the 2D-to-3D mapping, the model takes a clean 2D feature as input and predicts its corresponding 3D feature. We construct the positive target using the original clean 3D feature and the negative target by perturbing this feature in the target space. The same procedure is applied symmetrically to the 3D-to-2D mapping.
The key reason for perturbing the target rather than the source is that our inference anomaly score is determined by the discrepancy between the predicted target feature and the observed target feature. By introducing pseudo-anomalous negatives directly in the target space, RA-CL explicitly encourages the cross-modal prediction to distinguish clean normal targets from perturbed target representations. Meanwhile, keeping the source feature clean preserves the normal cross-modal conditioning relationship and avoids introducing additional uncertainty from source-side corruption.
Importantly, these pseudo-anomalies are not intended to reproduce specific real-world defects. Instead, they provide controlled feature-space perturbations around normal target representations, encouraging the model to become more sensitive to deviations in the same feature space used for inference.