- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes DIFD, a pre-training poisoned-sample screening framework based on timestep-aware diffusion reconstruction residuals. By adaptively locating intermediate diffusion stages with high residual separability and jointly modeling spatial and spectral residual anomalies, DIFD enables unified detection of diverse backdoor trigger patterns.
Critical strengths
The datasets involved in experiments are comprehensive.
Critical weaknesses
The defense comparison is limited in scope: only four methods are included, all from before 2024. Since the proposed method primarily employs a diffusion model as the architecture of a detection model rather than being restricted to diffusion-model-based tasks, the evaluation should include mainstream detection methods beyond diffusion models. Suitable baselines may be sourced from BackdoorBench.
The empirical effectiveness and reporting require careful verification. In Table 1, two metrics fluctuate greatly, with ranges of 0.8135–1.0000 and 0.0400–1.0000, respectively. There are also data annotation errors: in the CelebA experiment, the authors marked 0.0400 as the best, whereas the corresponding value for the TERD method is 0.3700, much higher than DIFD. This phenomenon occurs in more than one place; the authors are expected to check carefully.
The manuscript lacks theoretical basis and theoretical analysis, which makes it difficult to construct a complete understanding of the backdoor mechanism.
Questions for authors
I would appreciate clarification on the following points, which are intended to strengthen the theoretical and empirical evaluation.
1.Could the authors clarify why the trigger causes “intermediate reconstruction residuals of poisoned samples and benign samples to exhibit time-step-dependent separability”? Is there a theoretical basis or causal relationship underlying this phenomenon? Moreover, does this observation contribute to understanding the backdoor mechanism?
2.Do benign samples from different categories also exhibit time-step-dependent separability?
3.The manuscript states that “DIFD first performs time-step calibration to locate an intermediate reconstruction window in which separability is maximized.” How is the window size determined? Is it consistent across different datasets? What is the impact of hyperparameter selection on the effectiveness of the method?
4.The manuscript states that “DIFD relies only on a fixed diffusion model pretrained on clean data.” To what extent does the method depend on clean samples (in terms of number and categories; this relates to its practicality)? Is the generality of the method limited to diffusion models? For tasks not suitable for diffusion models, is adaptation difficult (e.g., can it be transferred to Transformer architectures)?
5.Since the proposed method is built on spatial-spectral residuals, frequency-domain-related triggers should be indispensable test cases. Narcissus can complete an attack with only a 0.05% poisoning rate. Can this method establish separability of residuals in this setting? SIBA triggers are coupled with normal features. Can this method establish separability of residuals in that case? Does it work for backdoor attacks with multi-target settings?
6.The organization of the paper could be improved. In the introduction, the authors claim three contributions, but experimental results should not be presented as a separate contribution. The presentation of illustrations requires improvement. The authors use extremely low-resolution images, which appear blurry. I recommend high-resolution visualizations on Tiny-imagenet involved in the experiments. In addition, the titles do not explain the image content, making the figures difficult to understand.
- In addition, several important experiments are missing: (i) sensitivity to the detection threshold; (ii) sensitivity to the window-length hyperparameter; (iii) cross-model-architecture capability (different diffusion model architectures); and (iv) degree of dependence on clean samples.