- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
SERVE combines full-scan appearance features with class-conditioned log-range densities predicted from target-excluded neighborhood context for open-world LiDAR segmentation and anomaly detection. On STU, it improves test anomaly AP from 15.09% to 61.74% over a matched appearance baseline, while increasing normal-class mIoU by 1.24 points.
Critical strengths
Target-excluded, class-conditioned range verification is physically motivated and supported by ablations. Making the target cell available reduces validation AP from 73.94% to 39.62%, while removing class conditioning also degrades performance, supporting the importance of both design choices.
Critical weaknesses
The comparability of anomaly scores across different context states remains unclear. Empty-context points receive zero measurement energy, whereas supported points receive nonnegative energy. The paper does not report stratified detection results, leaving the impact of this score shift on pooled anomaly ranking uncertain.
Questions for authors
It would be helpful if the authors could report anomaly detection performance separately for points with and without available context. This would clarify whether SERVE retains its advantage over the appearance baseline after controlling for context availability or calibrating scores across context states.
Response to Reviewer fKux
Thank you for suggesting the within-group evaluation. With neighborhood occupancy fixed, appearance alone and complete SERVE achieve 34.40% and 51.00% AP on identical returns with both scales occupied. With retrieval fixed, adding reference support increases full-validation AP from 46.57% to 50.81%. These experiments separate the within-group detection gain from changes in score ordering across context states.
During our review, we identified a systematic data-processing error affecting the submitted experiments. We take responsibility and withdraw the original results, including 73.94% validation AP, 61.74% hidden-test AP, the semantic accuracy gain, and the target-exclusion ablation you highlighted. The original predictions and checkpoints needed to locate the exact fault are unavailable. We rebuilt pointwise evaluation using public STU labels and original return indices. The anonymous supplement provides reproducibility checks and full-validation evaluation code.
1. Could context-dependent score scales explain the submitted gains?
In the submitted design, empty neighborhoods contributed zero range energy. An offset between supported and unsupported returns could change pooled AP without changing either group's internal ranking.
We reconstructed the angular neighborhood and target exclusion on 128 previously examined scans. Among supported returns (12,353,019 normals and 5,762 anomalies), frozen appearance alone achieved 0.621% AP and 30.45% FPR95. Adding a previously fitted range head with per-class calibration and weight 0.1 gave 0.898% AP and 25.22% FPR95.
Only 35 returns lacked neighbors, all normal. Their range energy was zero, their scores equaled appearance scores, and none crossed either readout's calibrated cutoff.
A separate matched range-head comparison yielded 0.236% AP because it used a reinitialized head selected at update zero, raw energy at weight 1, and all eligible returns. The submitted jointly trained checkpoint remains unverified.
2. Does the revised detector improve ranking within context states?
The revised model evaluates the probability assigned by neighboring semantic predictions to four retrieved normal references. When both neighborhood scales are empty, the reference distribution equals the range prior, making the reference discrepancy zero. Other anomaly signals remain available.
The table compares appearance → complete SERVE on identical native validation returns. AP and FPR95 are computed within each group; FPR and recall use each readout's fixed normal-sequence-201 cutoff.
The two-scale group contains 99.79% of anomalies. Its +16.60-point AP gain closely matches the pooled +16.26-point gain. A between-group offset cannot produce this within-group improvement. AP is nonlinear, however, so these comparisons do not quantify the exact contribution of cross-group ordering.
The fixed thresholds reveal a tradeoff: among returns with one occupied scale, SERVE detects 26 additional anomalies but flags 4,089 additional normal returns (Appendix D, Tables 9–10).
At native resolution, no anomalies have both scales empty. Thinning to 32 rows produces 108 such anomalies and 30,820 normal returns. At the unchanged cutoff, SERVE detects 83/108 anomalies (76.85%) and flags 10,599/30,820 normals (34.39%). This evaluates the complete detector under thinning (Appendix G).
3. Isolating reference verification
Table 2 fixes appearance, geometry, retrieved identities, distances, and spatial aggregation. Adding only reference support raises AP from 46.57% to 50.81% (+4.24 points; 95% paired sequence interval [2.91, 5.47]). With feature residual already included, the additional gain is +0.41 points [−0.24, 0.68].
Complete SERVE achieves 50.51% AP on full STU validation, above the previous published best we found for LiDAR-only methods fitted without real or synthetic anomaly examples (LIDO, 27.53%; Table 1). Final model selection used 320 of 1,960 scans across all 19 sequences. An official hidden-test result remains pending.