- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
PointSimAD detects anomalies in a single point cloud without target-category normal references or task-specific training. It uses handcrafted geometric statistics to select one of three grouping configurations, extracts patch features with a frozen ULIP-2 PointBERT encoder, and subtracts the feature-wise median across patches. Each patch is scored by its average cosine distance to its four nearest feature neighbors within the same object. Scores are interpolated to the original points for localization and aggregated for object-level detection. The paper evaluates the method on Real3D-AD, Anomaly-ShapeNet, and MulSen-AD.
Critical strengths
-
The training-free, reference-free setting is practically useful. The method avoids collecting normal examples from each target category and uses a relatively simple inference pipeline. Its reported memory footprint and throughput are encouraging, subject to the timing scope discussed below.
-
Point-level localization is promising. Table 1 reports P-AUROC values of 86.4, 88.5, and 81.5 on the three datasets, respectively, the highest among the compared methods. Figure 4 shows the resulting anomaly maps, and Table 3 provides quantitative evidence that median centering and adaptive grouping improve the reported baseline. These results give the approach practical value despite the concerns below.
Critical weaknesses
-
The adaptive grouping mechanism is not sufficiently justified, which limits the methodological contribution. The method combines geometric summary statistics, a frozen encoder, median centering, and nearest-neighbor scoring. Its adaptive component makes a hard minimum-cost choice among three presets. The paper does not establish why matching the proposed fingerprint should identify a configuration that is better for anomaly detection. Bounding-box ratios, PCA eigenvalue ratios, and radial dispersion describe global properties; their additional value for selecting a configuration suited to local surface variation remains unclear. My concern is their contribution beyond local distance statistics. Whole-module ablations in Table 3 do not answer this question, and the robustness of the fixed per-dimension weighting is not examined.
The sample-level evidence is also incomplete. Fixed-Fine is worse than both Fixed-Medium and Fixed-Coarse on all four metrics in Table 5. Figure 5 shows three examples but does not give their consistency costs or the actual SAPGM choices. Selection counts and proportions are missing. The configurations change the number of centers while keeping 64 points per patch, four feature neighbors for scoring, and eight spatial neighbors for interpolation. Fine's weaker performance could partly reflect the resulting changes in reference redundancy and interpolation support. The current experiments do not separate this interaction with the scorer from the choice of geometric scale. Before/after SCDM diagnostics or examples of the actual reference patches would also help establish the proposed explanation beyond its aggregate ablation gain.
-
The implementation and cost reporting leave the practical contribution difficult to assess and reproduce. Section 3.2 and Appendix A require FPS center selection and kNN grouping for each candidate, so all three configurations need candidate statistics before selection. This does not remove the initial FPS downsampling to 16,384 points. Algorithm 1 lists another FPS/grouping step after selection without explaining whether candidate results are reused. Caching or shared sampling could reduce this cost, but the implementation is not described. Table 2 and Figure 3 exclude preprocessing and do not isolate candidate preparation or clearly establish whether it is timed. Table 5 has no per-configuration latency or memory measurements.
This omission matters because adaptive grouping improves O-AUROC over Fixed-Coarse by only 0.6 and 0.7 percentage points; P-AUROC gains over the best fixed configuration are 0.6 and 2.2 points. The broader advantage is mainly in localization: object-level AUROC is 79.4 versus 84.1 for GS-CLIP on Anomaly-ShapeNet, and 72.4 versus 74.5 for BTP on MulSen-AD. These results need to be assessed alongside the cost of selection.
The most consequential reproducibility gap is the candidate fingerprint in Eq. (3). Table 7 lists the statistics, but “center-set and local-group statistics” does not define, dimension by dimension, which points are used or how measurements across groups are aggregated. Section 4.2 says five dimensions, whereas Section 3.2 and Appendix A say twelve. Other missing details include the coordinate normalization and 4,096-point subsampling rule, exact checkpoint and L2 feature extraction interface, Gaussian interpolation bandwidth and weights, any score normalization, and the within-category construction of P-AUROC before the stated category macro-average. The grouping used when SAPGM is disabled in Table 3 is also unidentified; its SCDM-only result of 75.0/83.8 on Real3D-AD matches none of the fixed configurations in Table 5.
I lean toward rejection in the current form. The localization results are useful, but the link between the selection criterion, the configuration chosen for an individual sample, and the resulting detection quality and cost is not established. Resolving these points would affect my assessment more than further aggregate benchmark results.
Questions for authors
-
Clarification of the selection rule: Please define every component of the candidate fingerprint in Eq. (3), including the point set, normalization, and aggregation across local groups. Which fingerprint dimension was used in the experiments, five or twelve?
-
Evidence for the fingerprint design: What do the shape and spatial-distribution features add beyond local statistics? A controlled comparison of local-only, local-plus-shape, local-plus-distribution, and the full fingerprint would directly address my main concern. Please report both performance and changes in the selected configurations, including sensitivity to the weighting choice.
-
Evidence for the configuration choices: For representative samples where Fine, Medium, and Coarse respectively work best, can you provide the three consistency costs, the actual SAPGM choice, and the localization results? How often is each configuration selected? Can the poorer Fine results be explained by sensitivity to the four-neighbor scorer or eight-center interpolation? A few controlled diagnostics, including SCDM before/after results or selected reference patches, would help distinguish these explanations.
-
Clarification and measurement of cost: Does the timing include initial downsampling, fingerprint extraction, and all three candidate FPS/kNN operations? Are candidate centers and groups cached or shared, and is the selected configuration recomputed as Algorithm 1 appears to indicate? Accuracy, latency, and peak memory for the three fixed configurations and SAPGM under the same conditions would establish whether selection provides a useful trade-off.
-
Clarification of reproducibility details: Please provide the exact checkpoint and feature extraction settings, coordinate normalization, fingerprint subsampling rule, Gaussian interpolation parameters, score normalization, and point-level evaluation procedure. How are point scores and labels combined within a category before computing P-AUROC?
-
Clarification of the ablation baseline: What fixed grouping and other settings are used for the baseline and SCDM-only rows of Table 3? Please explain their relationship to the fixed-configuration experiments in Table 5.