- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies active learning for adversarial training. It proposes ReAL, which represents each unlabeled example using its clean last-layer gradient together with the gradient change induced by an adversarial perturbation. ReAL applies multi-start k-means++ to select a representative batch and assigns cluster-size weights to the queried examples during adversarial training. The paper also derives a conditional connection between embedding-space coverage and approximation of the robust pool objective. Experiments on CIFAR-10, CIFAR-100, and Tiny-ImageNet show improved endpoint robust accuracy in several settings, but the gains are accompanied by inconsistent clean accuracy and substantial instability in some experiments.
Critical strengths
-
The paper addresses an important problem of improving adversarial robustness under a limited annotation budget, where both labeling and adversarial training are costly.
-
The proposed representation has a plausible robustness-related intuition, and the paper provides a sound conditional analysis connecting embedding coverage to robust-objective approximation.
-
The paper is generally clear and unusually transparent about its experimental protocol and limitations. It reports complete acquisition trajectories, multiple architectures and datasets, computational costs, seed variability, attack settings, and several negative or unstable results.
Critical weaknesses
-
The theoretical guarantee relies on a strong assumption that is neither derived from the proposed representation nor empirically validated. Specifically, Assumption 1 requires distances between embeddings constructed from current model pseudo-label gradients to uniformly control differences in true-label robust loss. This link is especially questionable when pseudo-labels are inaccurate, since such errors can propagate through acquisition-time attacks, gradient embeddings, cluster assignments, and cluster weights. The paper does not directly test the assumed representation–loss relationship. It also neither reports pseudo-label accuracy nor examines how pseudo-label quality affects acquisition behavior and downstream clean and robust performance.
-
The paper lacks the component ablations needed to identify the sources of ReAL's gains. It does not compare clean-gradient, attacked-gradient, direct-concatenation, and proposed secant embeddings, nor does it evaluate weighted versus unweighted training or single-start versus multi-start selection. Because ReAL changes both acquisition and training relative to the baselines, the current results cannot establish whether the improvements arise from the secant representation, multi-start selection, cluster weighting, or their combination.
-
The practical gains are limited and unstable in several settings. Although ReAL achieves stronger mean endpoint robust accuracy, it also yields substantially lower clean accuracy and high variance on CIFAR-100 and Tiny-ImageNet. On CIFAR-100 with ResNet-18, clean accuracy nearly collapses after the first acquisition round, while the PGD AUC improvement over Random is small relative to the observed variability. The results indicate an endpoint robustness trade-off rather than consistently improved label efficiency throughout the acquisition trajectory.
Questions for authors
-
Can the authors empirically validate Assumption 1 and report how pseudo-label accuracy affects acquisition and downstream performance?
-
Can the authors provide ablation studies comparing the proposed embedding, cluster weighting, and multi-start selection with their simpler alternatives?
-
How do the authors explain the early clean-accuracy collapse and high variance, and do additional results support stable gains across the acquisition trajectory?
2 comments
Thank you for the detailed response and additional experiments. The revision substantially addresses the missing component-ablation concern, clarifies the conditional scope of the theoretical analysis, and provides further diagnosis of the early CIFAR-100 degradation. However, several issues that affect the contribution remain:
- The ablation results do not establish a consistently dominant component or clear marginal gains for each module. Moreover, they do not include the post-hoc learning-rate reduction or other learning-rate choices.
- The CIFAR-100 ReAL endpoint uses a post-hoc learning-rate reduction to 0.01, whereas the baselines retain 0.1. Without a matched-schedule comparison, the reported endpoint gain cannot be attributed solely to ReAL.
- The reported gains are not consistently stable, with early clean-accuracy degradation, a clean–robust trade-off, and only modest AUC improvements relative to the observed variability.
These concerns limit the strength of the empirical evidence and the contribution of the proposed method. I therefore maintain my original rating.
Assumptions, Pseudo-labels, Ablations, and Acquisition Stability Copy title
Thank you very much for your questions and constructive comments. Any references in our responses refer to the revised version of the paper, not the original submission.
1. Assumptions and pseudo-label reliability
The representation alone does not guarantee true-label regularity. Original Assumption 1 required robust-loss Lipschitz control for every pool pair and every parameter in a region. Revised Assumption 1 concerns response differences Δtr at the actual two checkpoints on at least 1−α of assigned pairs, with bounded checkpoint losses (Sec. 5.2). Theorem 1 gives LtΨt(Bt)+2αCt transfer error, with Eq. (22) including old data. The proof separates regular and exceptional pairs in the cluster replacement identity, where no exact minimization is needed. Here α is response mismatch, not pseudo-label error. Both Secant blocks use one fixed pseudo-label. Sec. 5.1 preserves computed gradients even when it is wrong, without certifying true-label learning. Queried points use their acquired labels.
Appendix A.9 now examines 54 CIFAR-10/100 ResNet-18 transitions (3 seeds, 9 updates), with 2,048 uniform pre-query pool points and 500 representative loss lookups per case. True-label CE uses PGD-20$\times$1 (radius 8/255, step 2/255), maximizing over clean/start/all iterates. Geometry is original in 3 cases; 51 reconstruct pseudo-label PGD-5 geometry, fixing original assignments/masses. New95 is the 95th percentile of response discrepancy divided by RMS-normalized distance. It is below the analogous Old95 loss diagnostic in 27/27 and 21/27 cases, with median reductions of 28.0%/19.0%. Old95 is diagnostic, while OldMax is the constant required on sampled PGD-proxy pairs. These do not certify exact robust-loss regularity.
First-query CIFAR-100 pseudo-label accuracies are 10.21/10.94/10.25%. We record accuracy by round, correct/incorrect response groups, and checkpoint performance. Group differences are mixed. Co-occurring low accuracy and collapse do not identify causality. Direct PGD-CE transfer estimates span 0.299–2.919/0.376–4.897 CE units (CIFAR-10/100). Paired sample proxy/paired-error median ratios are 4.52/11.29, so this is not a tight certified bound. The fixed-query weighting intervention below isolates a separate training effect; pseudo-label quality was not causally manipulated.
2. Representation ablation
Secant preserves the clean gradient and exposes its attack-induced change, distinguishing candidates with similar clean signals by their adversarial response. It changes the metric despite retaining Concat's information (Sec. 4.2). Clean, Attack, Concat, and Secant share the paired CIFAR-10/ResNet-18 protocol. Only the embedding changes (Sec. 6.1, Table 1). Secant achieves the highest mean robust AUC, 19.96±0.84, and the smallest SD of that metric among embeddings. Clean's higher robust endpoint motivates reporting both metrics.
3. Weighting and multi-start selection
Embedding defines geometry, seeding finds representatives, and weighting preserves pool mass. Equal weights distort unequal cluster proportions even at zero coverage error (Sec. 4.4). The new one-factor comparisons address the original confounding concern. Cluster improves robust endpoint and AUC over Unit on CIFAR-10, while the restart study tests 1/2/4/8/16 independently of weighting. Restarts reuse attacks/embeddings. With eight restarts, robust AUC is near its best mean with the smallest observed SD. This balances coverage and cost without assuming monotonic accuracy gains.
4. Early collapse and variability
In the CIFAR-100 first-query intervention, queries and training randomness are identical. Changing only weights reproduces deterioration under Cluster (Sec. 6.2; Appendix A.8). This isolates a weighting effect without changing acquired samples. One representative receives 22–24% of total normalized training weight, showing that fixed total mass can still produce highly concentrated supervision. Later acquisition paths diverge, so this does not explain every fluctuation or rule out pseudo-label effects on the common geometry.
5. Label efficiency and clean–robust trade-off
On CIFAR-10, ReAL has the highest mean clean, PGD, APGD, and robust-AUC scores, supporting endpoint and measured trajectory gains (Sec. 6.2, Fig. 1, Table 2). CIFAR-100/RN18 shows later robust benefit after an early weighting penalty, with lower clean accuracy and modest AUC gain. Its endpoint and Tiny 9,000/10,000-label ReAL models include post-hoc LR0.01 reruns against LR0.1 baselines (Appendix A.5). These comparisons do not isolate acquisition effects. We distinguish endpoint robustness from uniform label efficiency. Full curves and three-seed SDs show gains and instability without a statistical-significance claim.
6. Summary of revisions
We updated the theoretical assumptions, ablations, and weighting-related analysis. We appreciate your careful review.