- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
ATLAS-AL addresses adversarial region estimation and sample collection under a limited query budget. It combines global and local Gaussian processes, residual correction, and complementary boundary and saturation sampling. Experiments on synthetic functions and image generators show promising results, particularly for synthetic region classification. However, the image evaluation leaves important questions about semantic validity, region estimation accuracy, and the interpretation of sample distribution metrics.
Critical strengths
- The joint objective is well motivated, and the ablations demonstrate a meaningful trade-off. Accurate region prediction and collecting many successful samples are distinct goals. In Table 2, saturation-only sampling on 100D Rastrigin achieves a 90.9% positive-query yield but an F1 of only 0.011. Mixed sampling improves F1 to 0.273, with a 50.0% yield. This provides empirical motivation for balancing boundary and interior sampling.
- The synthetic evaluation is systematic, with encouraging results under shared acquisition weights. The experiments cover three functions across three dimensions, using 30 seeds. In Table 3, ATLAS achieves the highest reported mean recall in 9/9 settings and F1 in 8/9 among the compared methods. With shared weights , Table 8 retains the highest mean recall in 8/9 settings and F1 in 7/9. Thus, these advantages do not depend entirely on adjusting these two weights separately for each benchmark.
Critical weaknesses
-
The semantic validity of generated attacks is insufficiently established. Section 6 uses the generator’s source-class condition and the classifier’s target-class score to identify successful attacks, but conditioning does not guarantee that generated images retain the source label. For example, if a generator conditioned on “cat” produces an actual dog, classifying it as “dog” would not constitute misclassification. This is an illustrative possibility, not a claim about a specific reported image. Appendix E provides qualitative examples, but no independent annotation of source-label retention or semantically verified attack success is reported. Such validation is needed to interpret the reported ASR as evidence of classifier errors.
-
The image experiments do not directly evaluate the learned region predictor. Unlike the synthetic experiments, Tables 4 and 9 report attack discovery and sample-set metrics without evaluating the final surrogate on an independent set of latent inputs. For example, a surrogate could correctly identify sampled attacks while incorrectly classifying an unqueried adversarial region. Statistics computed from discovered samples would not directly reveal this error. Held-out region classification and boundary-focused evaluation within the specified latent domain are needed to substantiate the region-estimation contribution in the image setting.
-
The evidence for reduced clustering does not control for sample count. Equation (11) defines Spacing as mean nearest-neighbor distance divided by mean pairwise distance, which is sensitive to the number of points. For example, adding more equally spaced points to the same line segment reduces this ratio despite preserving uniform spacing. In Table 9, on standard CIFAR-10, ATLAS reports 71.8 samples with Spacing 0.63, whereas SignHunter reports 256.6 samples with Spacing 0.27. Consequently, the difference could partly reflect sample density rather than greater clustering. Repeated subsampling to equal set sizes within each source–target pair would help isolate distribution quality while retaining the original query-budget comparison.
-
The proposed auditing interpretations lack controlled validation. Appendices E and F provide qualitative interpretations and discuss auditing applications, but do not independently test the proposed explanations. For example, Appendix E suggests that ocean backgrounds may explain why generated stingray images are classified as great white sharks. The examples alone do not establish whether the background, animal appearance, or other features drive these predictions. Controlled interventions, such as varying the background while preserving the subject, would help validate this hypothesis. Such evidence would strengthen the claimed diagnostic value beyond producing illustrative failure cases.
Minor Issue: Inconsistent calibration range (Table 6, p. 13). The caption identifies (8–15%) as a favorable range, but subsequently describes (17%) as “inside of this range.” Please correct this statement.
Figure and table placement. Table 4 and Figure 3 appear after the Conclusion, although they are discussed in Section 6. Placing them closer to the corresponding discussion would improve readability and the flow of the experimental presentation.
Questions for authors
See weaknesses.
3 comments
Response to Reviewer 3 (2/2): spacing metric, auditing, and minor points
W3 — The clustering evidence does not control for sample count.
"Equation (11) defines Spacing as mean nearest-neighbor distance divided by mean pairwise distance, which is sensitive to the number of points... Repeated subsampling to equal set sizes within each source-target pair would help isolate distribution quality."
This is correct, and we have adopted the reviewer's suggested fix. The metric (now called Unclustered) is computed by subsampling 20 times and averaging, using a sample size equal to the smallest adversarial set produced by any method on that source–target pair, capped at 400. This isolates distribution quality while retaining the original query-budget comparison.
[Revised paper] Eqs. (11)–(12) and Table 8 updated to the subsampled metric.
W4 — The auditing interpretations lack controlled validation.
We agree — the auditing interpretations are hypotheses, and a controlled study would be needed to validate them. We have softened the language in the auditing appendix to reflect this, and added edits clarifying that the audit observations are not the main takeaway. The main emphasis of the paper is the ability to generate synthetic adversarial datasets for target models, and how well the proposed setup produces such a set.
[Revised paper, Appendix E, "MEASURE"] "To validate such findings, we recommend conducting a follow up analysis, where controlled experiments (such as preserving scene context and cues while varying the subject or vice versa) validate whether or not the observations hold or if there is some point at which it breaks."
Minor 1 — Inconsistent calibration range (Table 6, p. 13).
Fixed in the revised PDF.
Minor 2 — Figure and table placement: Table 4 and Figure 3 appear after the Conclusion.
Fixed. We moved the table and the qualitative figures to the appendix and added representative plots next to the corresponding discussion in Section 6.
Thank you for the revisions. The equal-size subsampling addresses my concern about spacing, and the held-out evaluation is a useful addition. I also appreciate the more cautious wording of the auditing observations. I have two remaining questions: what fraction of the retained images are in the ambiguous group, and do the ASR and main comparisons remain similar when these images are excluded? Also, was the threshold in Figure 5(b) selected on data separate from those used to measure the gain?
Response to Reviewer 3 (1/2): semantic validity and region predictor
We thank the reviewer for an unusually precise review — each point identified something actionable, and all four led to changes in the paper. Our response spans two comments (1/2–2/2).
W1 — Semantic validity of generated attacks is insufficiently established.
We agree, and this was the most common concern across reviews. We added a section defining what counts as a successful generation and new analysis providing validation for the generated adversarial examples and also did analysis on ATLAS's ability to generate realistic images. For validation, we use held-out classification models and a realism metric to filter out examples with no valid semantic structure. With this filter applied, the reported ASR measures only successes on which the majority of held-out judges disagree with the target's misclassification and whose realism scores clear the threshold. For the additional analysis, we measure the distribution of realism scores in ATLAS's adversarial set compared to that of the images the generator is able to generate. Figure 7 shows us that the realism of ATLAS's images is capped by the quality generator it chooses to use. However, for both experiments we observe that ATLAS matches the cap. For instance, ATLAS matches the median realism for the BigGAN-256 generator.
W2 — The image experiments do not directly evaluate the learned region predictor.
We agree this was missing. We moved the full tables to the appendix and added a result evaluating the surrogate in the image setting. Using ROC curves on held-out latents, we show the model learns to separate adversarial from non-adversarial regions for samples whose spread exceeds that of its originally collected set — i.e. the surrogate identifies adversarial examples far from its own adversarial set.