- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work develops a theoretical analysis of backdoor attacks using a quadratic neuron trained on a poisoned Gaussian mixture. The authors examine how poisoning and trigger strength affect attack success and clean accuracy, comparing a linear regime with a feature-learning regime. They also conduct experiments on synthetic data, use fitted statistical distributions based on image-dataset statistics, and evaluate neural networks under different training regimes. The results suggest that feature learning can reduce the trigger strength required for a successful attack under the assumptions considered. How broadly this finding applies beyond the analyzed setting remains an open question.
Critical strengths
- The paper provides an analytical treatment of the relationship between poisoning and trigger strength in a tractable model. Comparing different learning regimes offers a concrete way to understand how the learning process can affect the cost of a backdoor attack. This analytical result is the main strength of the work.
- The paper also distinguishes between the trigger strength required to achieve a target attack success rate and the maximum success rate attainable under the model. This helps clarify what the theoretical analysis establishes and makes the conclusions more precise.
Critical weaknesses
- The analysis relies on a relatively specific modeling setup, which makes the theoretical results tractable but also raises questions about their applicability to more general settings. It would be helpful to clarify how strongly the conclusions depend on the quadratic model and the assumptions about the feature direction. Without a clearer understanding of these dependencies, the broader implications remain somewhat uncertain.
- Although the supplementary optimization experiments provide additional support for the proposed mechanism, the validation is limited to a particular setting. It remains unclear whether similar behavior would be observed under different data distributions or training conditions. More evidence across varied settings, or a clearer discussion of the relevant limitations, would make this part of the paper more convincing.
- Some experiments on image datasets use samples drawn from statistical distributions fitted to dataset statistics. Although this provides a controlled way to evaluate the theoretical predictions, it remains unclear whether the same behavior would be observed on the original datasets. The neural-network experiments provide additional evidence, but the link between their results and the proposed theoretical mechanism could be explained more clearly.
Questions for authors
- How sensitive are the main conclusions to the assumptions about the feature direction and the data distribution? In particular, which assumptions are essential to obtaining the reported behavior?
- How should the results from experiments using fitted statistical distributions be interpreted relative to the neural-network experiments? Could the authors clarify which experiments provide direct evidence for the proposed mechanism?
- Under what conditions do the authors expect the main conclusions to extend beyond the current model? A clearer discussion of the limitations of this extension would help readers assess the broader significance of the findings.
Thank you for correcting this discrepancy. My score remains.