- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
To decouple stealthiness and robustness, this paper introduces the concept of inter-pixel rules that explicitly model the statistical dependencies and distribution shifts induced by poisoning. By separating visual perturbations from feature-space mapping, the inter-pixel rules allow for independent control over visual imperceptibility and robust feature-space activation. Leveraging these rules, RuleWeaver meet specific stealthiness and robustness requirements.
Critical strengths
The authors propose a novel concept of robustness and related definitions.
Critical weaknesses
1.Unrealistic threat model and confused motivation. The paper states that “adversaries can tailor stealthiness and robustness to exploit blind spots in defenses and successfully bypass them.” However, the attacker is not assumed to know the defense mechanism, so it is unclear how the attacker can predict and customize an attack against it. Moreover, backdoor training is typically a one-shot process: if the trainer detects poisoned data, the dataset is usually discarded rather than used in an iterative attacker–defender loop. This weakness is decisive because the attack design and motivation rely on an adversarial capability that is neither realistic nor well specified.
2.Incomplete and outdated experimental evaluation. The attacks claimed as SOTA are all from before 2022. The evaluation omits feature-coupled attacks such as SIBA, Narcissus with an extremely low poisoning rate (0.05%), and recent defense-penetrating work such as Grond. Defenses are also not categorized, and all are from before 2024. This is decisive because the paper’s central claim is that the attack penetrates defenses; without representative, recent, and categorized baselines, the empirical evidence is insufficient to support that claim.
Questions for authors
I would appreciate clarification on the following points.
1.The manuscript posits an inherent coupling between stealthiness and robustness; however, the robustness defined therein lacks a clear application scenario. It is unclear why geometric transformations and Gaussian noise should be regarded as necessary defense steps. In addition, the authors do not explain how this notion differs from defense penetration, persistence, and detection evasion.
2.Could the authors clarify the application scenario for the statement “Given requirements on stealthiness and robustness, adversaries can construct inter-pixel rules with a specific number and scope to customize their backdoor attacks”? Under what circumstances would an attacker deliberately select high robustness but low stealthiness, or the reverse? In my understanding, these are two objectives to be improved jointly, rather than a trade-off requiring the sacrifice of one for the other.
3.How is the balance factor λ selected? Given that the attacker cannot access details of the training process, how can an appropriate λ be determined? Its impact on final performance also appears unpredictable.
4.The statement “This shows that adversaries can tailor stealthiness and robustness to exploit blind spots in defenses and successfully bypass them” is problematic. If the attacker does not know the defense mechanism, how can the attack be customized to predict and bypass it? The causal and temporal logic is unclear, and the motivation does not withstand scrutiny.
5.The authors claim three contributions, but the experimental description is counted as a full contribution. This makes the actual contribution difficult to assess and appears insufficient.
6.The “adversarial capabilities” scenario appears unlikely to arise in practice. Model training is typically a one-shot process; if the trainer detects poisoned data, they will generally discard it rather than engage in an iterative attacker–defender loop.
7.The experiments do not categorize attacks, and all attacks claimed as SOTA are from before 2022. For example, the evaluation does not cover feature-coupled attacks such as SIBA, Narcissus with an extremely low poisoning rate (0.05%), or recent defense-penetrating work such as Grond. The defenses are also not categorized, and all are from before 2024. Therefore, the paper cannot demonstrate penetration across different categories of defenses, making its claims unconvincing.