- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work proposes DQ-PAD to address the limited generalization of defenses to adversarial patches with diverse appearances in pedestrian detection. DQ-PAD uses prototypes from a pretrained VQ-VAE2 codebook to represent benign visual patterns and measures regional anomalies through the distance between local features and their nearest prototypes. In addition, patch-aware projection learning maps local features and prototypes into a low-dimensional discriminative subspace. The evaluation includes INRIA, CCTVPerson, WiderPerson1000, and physical-world scenarios, with comparisons against seven defense methods using three object detectors and ten held-out adversarial patches.
Critical strengths
- Existing methods either rely on patch-specific training signals or introduce image distortions through generative reconstruction. This work detects anomalies through benign prototype matching, which may, in principle, facilitate generalization to unseen patches. The research problem has practical significance.
- By freezing the encoder and codebook, the method learns only a projection matrix. Its structure is simple, with low computational overhead.
- The work includes a range of evaluations and demonstrates competitive inference efficiency. The ablation study examines sensitivity to the hyperparameters.
- The manuscript is well structured and clearly organized.
Critical weaknesses
- In Section 5.4, the authors construct adversarial patches specifically targeting DQ-PAD to evaluate whether the system can still detect pedestrians when the attacker knows the defense. Figure 3 shows that these attacks have little effect on post-defense detection performance. However, the paper does not adequately specify the number of optimization iterations, whether different patch initializations were tested, or whether further optimization could strengthen the attacks. It is therefore difficult to determine whether the results reflect the effectiveness of the defense or insufficient optimization of the evaluated attacks. The authors should describe the patch generation and optimization procedures, test more initializations and larger optimization budgets, and examine whether the attacks can become more effective. They should then report detection performance under the strongest evaluated attack and provide examples of patches that are successfully defended against and those that cause missed detections, to clarify the conditions under which the method remains effective. In addition, the value reported in Table 3 is inconsistent with that in line 410 of the manuscript.
- What is “DQ-PAT”?
- The authors use the VQ-VAE2 codebook as a reference for benign visual patterns and learn a projection matrix to better distinguish benign regions from patch regions. However, the current experiments do not clearly establish the main source of the performance gains: the benign visual patterns represented by the codebook, dimensionality reduction, or a more discriminative representation learned using patch samples. The ablation results are insufficient to quantify the contribution of each design choice. Moreover, training involves three loss terms and hard-sample selection, but their individual contributions have not been evaluated.
- The paper uses one adversarial patch for training and ten held-out patches for testing to demonstrate generalization to unseen patches. However, generalization to an unseen patch pattern is not equivalent to generalization to a new attack method. For example, P1–P3 are generated by the same method, as are P4–P6; these patches may share similar features despite their different appearances. Furthermore, the paper does not specify which patch is used for training. It is also unclear whether comparable performance would be obtained with a different training patch. Thus, the current results demonstrate effectiveness against the evaluated patches, but do not yet provide sufficient evidence of consistent generalization to different types of unseen patches.
- The method identifies patch regions using a threshold: regions whose anomaly scores exceed the threshold are masked. The authors select a localization threshold of 0.1 and a projection dimension of 16, but do not clearly specify which data were used to select these hyperparameters.
- The authors observe a performance drop at higher projection dimensions and attribute it to retaining too much redundant information. However, changing the projection dimension may also change the scale of the anomaly scores. If the same localization threshold is used across dimensions, the performance drop may simply result from the threshold no longer being appropriate.
- The authors claim that the method localizes patches more accurately while reducing the removal of benign image content. However, this claim is primarily supported by pedestrian detection results and a small number of qualitative examples. Improved pedestrian detection performance does not directly establish more accurate patch localization. The paper also fails to adequately investigate whether normal content, including ordinary clothing patterns, complex backgrounds and non-adversarial stickers, may be misidentified as patches.
- The legends in Figure 6 are inconsistent with the plotted results.
Questions for authors
- For the adaptive attacks in Section 5.4, could the authors specify the number of optimization iterations, step size, and patch initialization procedure? Have they examined whether increasing the number of iterations or using different initial patch patterns can further strengthen the attacks? This information would help establish whether the results in Figure 3 are based on sufficiently optimized attacks. In addition, which value is correct, the one in Table 3 or the one in line 410?
- Which experiments establish the respective contributions of the VQ-VAE2 codebook, dimensionality reduction, and learning the projection matrix?
- Which specific patch is used for training, and which attack method generates it? Which test patches are generated by attack methods that are entirely excluded from training? Have the authors examined whether defense performance on other patches remains stable when a different training patch is used?
- Which data were used to select the localization threshold of 0.1 and the projection dimension of 16? In Figure 6, is the same threshold used for all projection dimensions? If so, what evidence rules out a mismatched threshold as a cause of the performance drop?
- Beyond pedestrian detection AP and qualitative results, are there direct measurements of patch coverage and the proportion of benign regions incorrectly masked to support the claim of more accurate localization and reduced removal of benign content? Have the authors observed substantial false positives on ordinary clothing patterns, complex backgrounds, or non-adversarial stickers?
- Do all occurrences of “DQ-PAT” refer to “DQ-PAD”? Please also clarify the correspondence between the legends and curves in Figure 6 so that the localization threshold and projection dimension results can be interpreted accurately.