- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors propose several ``fixes'' to existing adversarial training methods (RCE and GRoOD), aiming to achieve both good robustness against adversarial attacks and good (non-malicious) out-of-distribution detection. They identify that RCE is limited by there being no constraint on the absolute energy scale of the logits -- to correct this problem the authors introduce an energy-margin regularization (EMR) term. For GRoOD+EMR, they identify a variance-free vulnerability that is corrected by the use of label smoothing. The proposed fixes are supported both analytically and experimentally. There are some paper clarity concerns. There are also concerns about the overall approach (with a single model needing to simultaneously achieve good in-distribution classification accuracy, good out-of-distribution detection, and good adversarial robustness) -- the authors do not investigate alternatives to this approach (which include pairing the classifier with an auxiliary detector).
Critical strengths
The paper probes mechanistic sources of suboptimal adversarial robustness/outlier detection for two existing methods -- RCE and GroOD, and proposes sound corrections to these methods.
Experiments support that these fixes improve adversarial robustness.
Critical weaknesses
The authors claim(sec. 2.1) that adversarial training is "the leading defense against adversarial attacks" -- and to support this they cite very old papers (the latest being Papernot et al., 2017). The authors acknowledge that adversarial training "degrades standard accuracy", but despite that they do not, in their work, consider use of auxiliary detectors. Such detectors do not impair the "standard accuracy of the classifier". It would be instructive to see how standard classifier+auxiliary detector fares against their adversarial training methods, with respect to clean accuracy, clean OOD detection performance, and detection of adversarial attacks. There is also no discussion of clean accuracies (the ACC column) in the paper.
There are several hyperparameters of the authors' methods, which appear to be optimistically set (m, alpha) -- the appendix discusses hyperparameters, but this discussion still suggests optimistic tuning.
Questions for authors
Why do the authors focus only on detectors that are based on the model's outputs -- perhaps more informative detection signals can be extracted from internal model signals (with anomaly detection, based on a null (clean ID data) model for these signals) ?
Section 3: "both terms with the uniform target U = [1/K,...,1/K]" -- the first term uses the clean label y_i^in -- so why do the authors say both terms use U ?"
What conclusions would the authors draw from the Acc column in their tables ?
Why are AA results shown in table 2 and table 3? These are not discussed.
Section 5.2: "Empirically, this appears as a small unstable gap under RCE " -- gap between what and what ? This is not explained.
Section 8, Corollary 1: "P_IDp_j^ID" -- unclear what this is...
The gains of GRoOD+ over GRoOD in Table 3 appear to be marginal.