- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies the backdoor threat against diffusion models for 3D point cloud generation. The authors design a noise-driven backdoor attack, termed BadPVD, which injects structured triggers into the initial noise distribution to steer the generation process toward attacker-specified target shapes. Specifically, the method constructs a target-guided poisoned diffusion trajectory and jointly optimizes benign and backdoor noise prediction objectives during model fine-tuning. Experiments on PVD and SPVD models demonstrate high attack success rates under trigger-conditioned initialization while largely preserving normal generation quality.
Critical strengths
- The authors proposed the first backdoor attack for 3D point cloud generation diffusion models. Extending the study of backdoor vulnerabilities from 3D point cloud classification and 2D diffusion models to 3D generative models is a meaningful research direction.
- The authors evaluate the proposed attack across multiple point cloud diffusion models (PVD, SPVD, and SPVD-C), target categories, trigger configurations, and poisoning ratios. The experimental results demonstrate high attack success rates under the evaluated settings while largely preserving benign generation quality.
Critical weaknesses
- Limited methodological novelty. The proposed method largely follows existing noise-triggered backdoor attacks on diffusion models, particularly BadDiffusion [1]. The target-guided poisoned diffusion trajectory closely resembles the formulation in [1], while the paper introduces few designs specifically tailored to the geometric properties of 3D point clouds or the point-voxel architecture. Therefore, the technical novelty beyond adapting existing diffusion backdoor techniques to a new generation task remains unclear.
- Insufficient evaluation against existing methods. The paper only compares BadPVD with a naive noise-shift baseline, without evaluating existing backdoor attacks on diffusion models. Although this may be the first work targeting 3D point cloud diffusion models, several closely related methods have been proposed for 2D diffusion models [1, 2]. In particular, the proposed poisoned diffusion trajectory closely resembles that of BadDiffusion [1]. These methods could potentially be adapted to 3D point cloud generation, or the authors should at least explain why such comparisons are not feasible. Without these comparisons, it is difficult to assess the effectiveness and technical contributions of the proposed method relative to prior work.
- Unrealistic threat model. The proposed attack requires the attacker to control the initial noise during inference to activate the backdoor. However, in the considered model supply-chain scenario, the attacker only modifies and redistributes the pretrained model, while the downstream user independently performs inference. It remains unclear how the attacker could manipulate the initialization noise in this setting. Moreover, if the attacker already has control over the inference pipeline, the authors should clarify why backdoor injection is necessary compared with simpler ways of manipulating the generation process. This raises concerns about the practical feasibility of the assumed threat model.
- Limited discussion of real-world security implications. Although the authors briefly mention potential applications such as simulation environments and digital twins, the practical use cases of pretrained 3D point cloud diffusion models remain insufficiently discussed. More importantly, it is unclear how the attacker-controlled generation of specific object categories would lead to concrete security risks in downstream applications. Unlike backdoor attacks against discriminative models, where manipulated predictions can directly affect downstream decisions, the security consequences of altering generated point clouds are less straightforward and require further justification.
[1] Sheng-Yen Chou, Pin-Yu Chen, Tsung-Yi Ho. How to Backdoor Diffusion Models? Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, pp. 4015-4024
[2] Weixin Chen, Dawn Song, Bo Li. TrojDiff: Trojan Attacks on Diffusion Models With Diverse Targets. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, pp. 4035-4044
Questions for authors
-
See weaknesses above.
-
Other minor problems:
a. There is no section number in the paper.
b. The organization of tables and figures on page 8 is chaotic.
c. The related work section has been placed in appendix, which hinders readers that may not that be familiar with 3D generations and attacks.