Q1: [1] demonstrates robust accuracy estimation using the logit margin (the difference between the top two logits), while Li et al. (2024) [2] use the GREAT score (a label-dependent version of the logit margin using a generative model) to rank models in RobustBench according to their robust accuracy. Can you compare your normalized margin score with these approaches for both robustness estimation using Algorithm 1 in [1] and model ranking, at least using the logit margin as a baseline? Note that both scores are also gradient-free.
Q2: Lines 208-209. You seem to imply that approximation quality depends on model robustness. Can you quantify this correlation? In [1], Ding2020MMA and Xu2023Exploring_WRN-28-10 are the models with the lowest margin consistency, yet they differ by more than 20 percentage points in robust accuracy. How does your score relate to margin consistency? Consider computing Kendall's tau correlation between the input margins and your normalized margins and comparing it with margin consistency.
Q3: Your analysis in Appendix A.2.1 relies on the PGD attack under the ℓ∞ norm, which tends to find perturbations at the maximum specified epsilon budget. Can you provide more details about this estimation? Why don't you use the FAB attack?
Q4: In the final row of Table 1, why do you consider only the non-robust samples and ignore those that are robust with respect to ε = 8/255?
Q5: To evaluate the number of features necessary for an adversarial attack, you apply the mask during the attack (Eq. 18). How does this compare to simply applying the mask to the adversarial features after a standard attack? Is this what you investigate in Section 4.3? If so, please clearly explain the similarities between the two analyses, as well as the differences in the conclusions they support.
Q6: Isn't the number of features necessary for a successful attack related to the number of features needed for a prediction, which is likely bounded by the rank of the linear classifier matrix, itself bounded by the number of classes? Evaluation on CIFAR-100 and ImageNet-1k will be particularly relevant here. A low-dimensional analysis of the features (e.g., using PCA) could also help provide more clarity.
Q7: In Line 377, you introduce the Jaccard index without explicitly defining it. While Appendix A.2.6 provides further analysis, the computation of the "top-20% feature Jaccard index" is not clearly explained. Could you provide a formal definition and clarify how to interpret the reported values? You may consider adding this clarification to the manuscript.
Q8: Can you empirically evaluate the validity of Assumption 2 across the 71 models? In particular, how close is (m_b + m_t) to zero, and how much does the normalized Lipschitz quantity (\gamma) vary across models and class pairs? Appendix A.2.1 measures feature sensitivity using successful PGD attacks, but this does not directly establish the constancy of the quantity required by Proposition 2.
Q9: In Line 303, you mention that "the train set samples are used to calculate the mean representations in all cases." Figure 3 also shows these mean representations. Could you additionally plot the corresponding means computed from the validation/test set? Please rule out potential distribution shifts between the training-set means, the full validation/test-set means, and the means of the validation/test subset used in the analysis.
References
[1] Ngnawé et al. (2024). Detecting Brittle Decisions for Free: Leveraging Margin Consistency in Deep Robust Classifiers. NeurIPS 2024. https://arxiv.org/abs/2406.18451
[2] Li et al. (2024). GREAT Score: Global Robustness Evaluation of Adversarial Perturbation using Generative Models. NeurIPS 2024. https://arxiv.org/abs/2304.09875
We thank the reviewer for the positive feedback and for bringing relevant prior work to our attention.
Q1 / W1: Feature suppression and recalibration methods
These are good pointers, and we have added a discussion of CAS, CIFS and FSR in "Related work". Since models that use these methods are not currently on RobustBench they were not included in our analysis. That said, we expect that our observed concentration of vulnerability in class-separating features will occur for these methods, given the wide range of models in which we have seen such behavior. However, it is possible that their input-dependent channel gating may modify the class-separating features substantially, and we therefore propose the empirical investigation of this matter as future work.