- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes MARS, a training-free method for 3D anomaly detection using a few normal point clouds. The method combines viewpoint-preserving multi-hypothesis alignment with normal-calibrated residual scoring. It first aligns queries with normal references, then evaluates multi-scale geometric residuals against normal-reference statistics. Experiments on Real3D-AD and Anomaly-ShapeNet achieve point-/object-level AUROC scores of 97.0%/91.2% and 98.2%/95.7%, respectively. Ablations and efficiency analyses further support the proposed design.
Comment
This paper presents a simple and effective training-free approach with strong results across two 3D anomaly detection benchmarks. The experimental analysis is generally convincing. While the independent benefit of normal calibration and the robustness to reference selection and missing structures require further clarification, the overall contribution is meaningful, and I lean toward acceptance.
Critical strengths
1. Simple and effective approach. MARS performs anomaly detection directly from geometric differences without pretrained models or training. The combination of multi-hypothesis alignment and normal-reference comparison is practical, particularly when only a few normal samples are available.
2. Strong experimental results. The method outperforms the reported baselines on average across both benchmarks. The alignment and residual-scoring ablations, robustness tests, and runtime comparisons provide useful evidence of its effectiveness.
Critical weaknesses
1. The benefit of normal calibration is not fully established.
Although normal-calibrated residual scoring is a central contribution, Appendix Table D.4 shows that uncalibrated aggregation already achieves comparable performance. On Anomaly-ShapeNet, the uncalibrated mean even slightly outperforms calibrated Fisher-style scoring in object-level AUROC (95.93% vs. 95.66%). A more controlled comparison would help clarify the actual contribution of normal calibration beyond multi-scale residual aggregation.
2. Limited validation of reference selection and missing-structure anomalies.
MARS relies on a small set of normal references, but the reference-count experiment uses only one deterministic two-reference subset. Performance variation across different reference selections remains unclear. Moreover, the directed query-to-reference residual cannot directly detect missing regions that contain no observed points. This may limit the method's applicability to certain industrial defects.
Questions for authors
Q1. Can the authors further isolate the contribution of normal calibration from multi-scale residual aggregation? Appendix Table D.4 suggests that calibration provides only modest improvements over uncalibrated scoring.
Q2. How sensitive is MARS to the selection of normal references? Could the authors report results across multiple randomly selected two-shot and four-shot reference sets?
Q3. How does MARS perform specifically on missing-part or missing-material defects? Can the authors provide a defect-type analysis to clarify the limitations of directed geometric residuals?
4 comments
Response to the Reviewer v4fE [2/3]
W2-1/Q2) Choice of normal references. MARS relies on a small set of normal references, but the reference-count experiment uses only one deterministic two-reference subset. Performance variation across different reference selections remains unclear. ... How sensitive is MARS to the selection of normal references? Could the authors report results across multiple randomly selected two-shot and four-shot reference sets?
Answer: MARS is robust to the choice of references: across all six two-reference pairs, the standard deviation of P/O-AUROC is at most 0.70 pp, and even the worst pair beats the strongest two-shot baseline. For each pair, we rebuilt the whole pipeline and evaluated all 2,518 queries.
Table R14. Reference-subset sensitivity (P / O-AUROC, %; two-shot mean ± SD and range over six subsets).
| Dataset | Two-shot P | Two-shot O | Four-shot P / O |
|---|---|---|---|
| Real3D-AD | 95.73 ± 0.70 (94.41–96.31) | 88.50 ± 0.70 (87.47–89.22) | 96.95 / 91.23 |
| Anomaly-ShapeNet | 98.03 ± 0.07 (97.91–98.10) | 94.98 ± 0.49 (94.10–95.53) | 98.19 / 95.66 |
- Partial scans are more sensitive to the choice: the ranges are 1.90/1.75 pp on Real3D-AD and 0.19/1.43 pp on Anomaly-ShapeNet.
- Only one four-reference set exists per category: both benchmarks provide exactly four normal training scans [G1, G2], so independent four-shot sets cannot be drawn; the six pairs cover every two-reference choice.
- Even the lowest P- and O-AUROC across the six MARS pairs exceed the two-shot Reg2Inv results reported in Table 1 (90.6/80.2 on Real3D-AD and 90.3/84.5 on Anomaly-ShapeNet). Reg2Inv was evaluated on one reference pair.
We thank the reviewer; this analysis shows that MARS works with fewer, differently chosen references. It is in Sec. 4.2.1 (Lines 371–375) and App. E.1 (Lines 1341–1345; Table E.1(c), Lines 1368–1373).
Response to the Reviewer v4fE [3/3]
W2-2/Q3) Missing-part and missing-material defects. Moreover, the directed query-to-reference residual cannot directly detect missing regions that contain no observed points. This may limit the method's applicability to certain industrial defects. ... How does MARS perform specifically on missing-part or missing-material defects? Can the authors provide a defect-type analysis to clarify the limitations of directed geometric residuals?
Answer1: MARS and the baselines generally score lower on broken, hole, and crack defects than on bulges and concavities. These queries have fewer labeled defect points, which more often form two closely spaced layers.
Table R15. Results by defect type (category-averaged AUROC, %); the baseline columns report the highest P- and O-AUROC among four rerun methods.
| Dataset | Defect type | Anomalous queries | MARS P / O | Best baseline P (method) | Best baseline O (method) |
|---|---|---|---|---|---|
| Anomaly-ShapeNet | Bulge | 280 | 99.57 / 100.00 | 95.41 (Reg2Inv) | 95.33 (PASDF) |
| Concavity | 280 | 99.68 / 99.76 | 95.66 (Reg2Inv) | 93.07 (PASDF) | |
| Broken | 36 | 68.32 / 60.93 | 71.94 (PointCore) | 61.30 (PointCore) | |
| Hole | 38 | 64.56 / 63.33 | 67.68 (Reg2Inv) | 57.54 (PASDF) | |
| Crack | 25 | 62.85 / 73.85 | 61.48 (PASDF) | 62.05 (PASDF) | |
| Real3D-AD | Bulge | 426 | 97.55 / 92.58 | 91.55 (Reg2Inv) | 82.54 (Reg2Inv) |
| Sink | 164 | 92.14 / 85.18 | 84.66 (Reg2Inv) | 77.48 (PASDF) | |
| Hybrid | 12 | 94.10 / 97.33 | 81.85 (Reg2Inv) | 91.43 (PointCore) |
- MARS trails the best baseline only on Broken and on Hole localization. PointCore is better on Broken in both metrics and Reg2Inv on Hole in P-AUROC; MARS leads in every other column.
- These defects leave few labeled points, often in two thin layers. Broken, Hole, and Crack queries have about one-seventh as many labeled defect points (36.72 vs. 257.62), and 81.8% of them form two closely spaced layers (vs 34.8%; Table R16). Defect points that stay close to the normal surface after alignment have small residuals, so few of them stand out among top-scoring points.
Table R16. Labeled defect point counts and spatial distribution on Anomaly-ShapeNet.
| Measure | Broken, Hole, Crack (99 queries) | Bulge, Concavity (560 queries) |
|---|---|---|
| Mean GT defect points per query | 36.72 | 257.62 |
| Queries with a two-layer pattern¹ | 81/99 (81.8%) | 195/560 (34.8%) |
| Mean layer gap (% of query diagonal) | 1.36 | 2.04 |
¹ The labeled defect points form two groups at different depths in the same local region.
Answer2: A region with no observed points cannot be scored directly, so MARS detects a missing part only through the surface around it. It flags the object when an exposed cut surface or broken edge deviates from the normal scans, and when removed material leaves a scanned floor, as for Real3D-AD sinks, MARS reaches 92.14/85.18 P/O-AUROC, above every baseline. Neither benchmark has a separate missing-part category; Anomaly-ShapeNet’s Hole and Broken types are the closest. Sec. 5 (Lines 521–526) states this limitation and a remedy, a visibility-aware comparison from the normal scans to the query.
We thank the reviewer; this analysis clarifies how MARS performs across defect types and why missing regions with no observed points are difficult to detect. The defect-type results are in App. E.4 (Tables E.3–E.4, Lines 1458–1469 and 1495–1520).
We hope our responses address your concerns. If any question remains, please let us know, and we will respond promptly.
I appreciate the author’s detailed rebuttal, which has largely addressed my concerns. I have decided to maintain my original score and recommend acceptance.
Response to the Reviewer v4fE [1/3]
Dear Reviewer
v4fE, the authors sincerely appreciate your thoughtful review and positive assessment. Your questions helped us isolate the contribution of normal calibration and state the limits of a directed residual precisely. We are also thankful for your acknowledgement of the strengths of this work: a simple and effective training-free approach that detects anomalies directly from geometric differences, supported by ablations, robustness tests and runtime comparisons. We address your concerns and questions below.Answer:The row “Uncalibrated mean” averages the seven raw statistics without normal-bank tail calibration; we renamed it “Mean” under “Anomaly scoring from raw residual statistics” (Table D.7(b), formerly Table D.4(b)). With the seven multi-scale statistics and Fisher-style fusion fixed, normal LOO calibration improves both P- and O-AUROC on both benchmarks (Table R13).Table R13. Four-shot comparison of per-query and normal leave-one-out (LOO) tails with Fisher-style fusion (P/O-AUROC, %). Chamfer refinement and median smoothing are disabled.
Table R13 disables post-processing because Chamfer refinement uses normal-scan thresholds. With post-processing enabled and Fisher-style fusion fixed, normal LOO improves four-shot P/O-AUROC over per-query tails by 1.01/2.99 pp on Real3D-AD and 0.45/1.06 pp on Anomaly-ShapeNet.
As you note, directly averaging the raw residual statistics already comes close to our final scorer on Anomaly-ShapeNet (98.16/95.93% vs. 98.19/95.66% P/O-AUROC, Table D.7(b–c)), which supports our main finding that aligned multi-scale residuals carry most of the signal. The plain average also drops Fisher-style fusion, so it cannot isolate calibration; Table R13 does. Against the plain average, the gain from calibration is small but consistent, and it is in localization: the full scorer localizes better in all 12 Real3D-AD and 31 of 40 Anomaly-ShapeNet categories (sign test, p < 0.001 on each benchmark), although the average gain is only 0.76 and 0.03 pp. Calibration puts the seven statistics, whose normal ranges differ, on one scale so that Fisher-style fusion can let the most unusual one dominate; averaging the calibrated scores instead falls below the plain average (94.73 vs. 96.19 P-AUROC on Real3D-AD, Table D.7(c)). For detection, raw aggregation does as well, so we claim no detection gain over it (Sec. 4.3.2, Lines 515–517).
We thank the reviewer; these comparisons clarify what normal calibration adds. With Fisher-style fusion fixed, its largest gain is in object-level detection on partial real scans (Table R13); against the plain average, its gain is small but consistent and in localization. They are in Sec. 4.3.2 (Table 6, Lines 495–502 and 513–517) and App. D.7 (Table D.7, Lines 1188–1213 and 1224–1236).