- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes DefAttack, aiming to transfer backdoors from compromised teachers to students through clean-data distillation. It amplifies target-domain token preferences in the teacher and subsequently activates the inherited preferences using suffixes optimized on surrogate students. Experiments cover four model families, three tasks, and multiple distillation strategies.
Critical strengths
-
The paper investigates a meaningful model supply-chain risk that clean distillation inputs do not guarantee trustworthy teacher supervision.
-
The experiments are thorough, covering four model families, three tasks, and multiple distillation strategies.
Critical weaknesses
Under the claimed soft-target transfer mechanism, students trained without teacher-logit supervision should exhibit substantially weaker activation under a fixed suffix. However, Table 15 reports a triggered anchor probability of 0.98 at λ = 0, compared with 0.87 at λ = 0.5 and 0.85 at λ = 1. I therefore trace the suffix optimization and evaluation calls in the authors’ code. The supplied evaluation script optimizes a separate suffix for each test prompt using the evaluated student’s gradients, then tests it on the same student and prompt. If this procedure was also used for Table 15, the strong activation at λ = 0 could reflect direct white-box suffix optimization rather than inherited teacher preferences. Even if this procedure were applied consistently to all compared methods, tailoring suffixes to the evaluation model and individual test prompts could inflate ASRs relative to the claimed surrogate-to-victim transfer setting. Equal treatment across methods would not establish transfer without victim-model access or generalization to unseen prompts. The authors should clarify which models and prompts were used for suffix optimization, whether suffixes were re-optimized for each λ setting, and whether optimization involved access to the evaluated students.
Questions for authors
See weaknesses, i will raise my score if the authors could provide more evidences that the performance is mainly from the transfer from the teacher.
Thank you for the detailed rebuttal and additional experiments. However, two concerns remain:
W1: Amplifying existing defects vs. injecting preferences. The neutral/sensitive verb experiment demonstrates pre-existing lexical sensitivities but does not establish that DefAttack exploits these sensitivities rather than injecting attacker-specified preferences. The cross-transfer experiments confirm the contribution of teacher modification but do not distinguish these mechanisms. Moreover, the new evidence focuses on refusal without establishing analogous pre-existing defects for jailbreak and sentiment. Thus, the central claim of pre-existing defect amplification remains insufficiently supported.
Q1: Gemma-3's lower teacher ASRs. Since the baseline attacks achieve relatively low teacher ASRs on Gemma-3, these results provide limited evidence for assessing backdoor transferability when teacher-side implantation is successful.