Fast Preemptive Robustification: High-Frequency Response Anti-Aligns Shared Vulnerability
Abstract
Adversarial attacks can readily compromise deep neural networks (DNNs). In particular, transferable attacks (TAs) exploit the shared vulnerabilities among DNNs, enabling perturbations crafted on surrogates to transfer to unseen models. Training-time and post-attack defenses have been extensively studied for combating TAs. Orthogonal to these approaches, preemptive robustification (PR) has emerged as a pre-attack defense that enhances the robustness of benign samples by superimposing protective variations before attacks. Despite its promise, PR remains underexplored and faces several important limitations. First, dependence on well-trained surrogate classifiers limits applicability, as surrogates are task-specific and may even be unavailable in some practical settings. Moreover, the required iterative optimization or dedicated PR generator training incurs substantial costs. Third, the variations generated by existing methods lack human interpretability. To address these, we seek an efficient PR that is surrogate-free, optimization-free, training-free, and human-interpretable. Intriguingly, we discover a numerical correlation between the shared vulnerabilities of DNNs and Laplacian responses, with their cosine similarity being significantly negative. This indicates that negated high-frequency response constitutes an important component of shared vulnerabilities. Consequently, strengthening Laplacian responses counteracts this component, improving resistance to TAs. Building upon this insight, we propose **F**ast **P**reemptive **R**obustification (**FPR**), which runs efficiently on commodity CPUs, enabling real-time PR without dedicated GPUs. Despite its simplicity, FPR provides substantial robustness gains across diverse attack settings. Specifically, FPR reduces the attack success rate (ASR) of untargeted TAs by and that of targeted TAs from to . The code will be released.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.