- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes MVT-Attack, a transfer-based black-box adversarial attack for 3D point cloud classifiers. It estimates local gradient discrepancies through normal-constrained neighborhood sampling, uses the normalized correction, and aggregates corrected gradients through normalized, exponentially weighted momentum over a finite window. It further projects point-wise perturbations onto their corresponding surface normals after each update and enforces the perturbation budget. Experiments on ModelNet40 and ScanObjectNN evaluate transferability against multiple architectures, robustness under four defenses, component ablations, hyperparameter sensitivity, runtime, and a multi-scale sampling variant. The reported results show substantial transferability improvements over the evaluated baselines, although the distinct contributions of the proposed components and the evidence supporting the claimed optimization mechanism require further clarification.
Critical strengths
1. Clear motivation and a coherent optimization-level approach. The paper identifies gradient optimization for transferability as a relatively underexplored direction in 3D point cloud attacks. Rather than introducing another transfer-aware loss regularizer, MVT-Attack combines neighborhood-based gradient correction with historical gradient aggregation. Its normal-constrained sampling and point-wise normal projection are geometry-specific design choices that distinguish the method from a direct application of conventional 2D gradient attacks.
2. Broad experimental coverage. The evaluation covers two complementary datasets, two perturbation budgets, multiple source and target architectures, and four defense mechanisms. The appendix extends the source-model evaluation and includes additional target architectures, while the ablation, hyperparameter, runtime, and multi-scale sampling experiments provide useful supplementary evidence.
3. Promising reported transferability and an explicit efficiency trade-off. On ModelNet40, MVT-Attack achieves a Transferability Score of 49.0%, compared with 41.4% for CFG. For PointNet-to-PointCNN transfer under the same setting, its attack success rate is 46.0%, compared with 32.7% for CFG . The paper also reports a runtime of 0.14 minutes per sample and explicitly discusses the limited performance gain relative to the additional computational cost of multi-scale sampling.
Critical weaknesses
1. The individual contributions of the proposed components are not fully isolated. Although Table 5 provides useful ablations of variance tuning (VT), momentum (Mom), and normal-constrained sampling (NC), it omits the NC-only and Mom+NC configurations. More importantly, Algorithm 1 (line 16) introduces an additional per-iteration projection of perturbations onto surface normals, whose independent contribution is not evaluated or clearly distinguished from normal-constrained sampling. The paper also does not sufficiently clarify whether the geometric constraints and perturbation update procedures are consistent across the proposed method and baselines. These factors make it difficult to fully attribute the observed improvements to the proposed gradient optimization mechanisms.
2. The claimed optimization mechanism lacks direct empirical validation. The paper suggests that MVT-Attack guides perturbations toward flatter regions and a "Shared Adversarial Space" rather than a "Model-Specific Space" (Fig. 1), resulting in smoother optimization trajectories. However, these claims are not directly evaluated through loss-landscape analysis, cross-model gradient agreement, or optimization trajectory measurements. Furthermore, the proposed "gradient variance" in Eq. 7 is actually the difference between the neighborhood mean gradient and the current gradient, rather than a conventional statistical variance. The motivation for the normalized correction in Eq. 8 could also be better explained, particularly how its magnitude relates to gradient instability. Additional analysis would help substantiate the proposed mechanism.
3. Some empirical results would benefit from further clarification. The paper could provide more details on the number of evaluated samples to better contextualize the reported ASRs, particularly for relatively small improvements (e.g., 73.5% vs. 72.6% in Table 1). Additionally, the defense evaluation is conducted using PointNet as the only source model. On ScanObjectNN, the ASRs under SRS, SOR, and DUP-Net are consistently high across all methods (96.4–98.9%), making it difficult to distinguish their relative effectiveness.
Questions for authors
Q1: Can the authors provide direct gradient-optimization baselines and more discriminative component ablations? Please evaluate point-cloud adaptations of MI-FGSM and VMI-FGSM under matched perturbation budgets and comparable optimization settings. For the component analysis, please add an NC-only configuration and separate the effects of normal-constrained neighborhood sampling and per-iteration normal projection. Together, these experiments would clarify the novelty of MVT-Attack and identify which components account for the observed improvements.