- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies adversarial robustness from the perspective of feature-space semantic organization. It defines a class-specific semantic region according to the nearest class centroid and measures whether samples preserve their semantic-region membership after adversarial perturbation. The paper further derives a sufficient condition relating the semantic margin to adversarial feature displacement and approximates the displacement using feature-space PGD. Experiments on CIFAR-10 and CIFAR-100 with multiple robust models suggest that robust models preserve semantic-region membership substantially better than a standard model, and that some misclassified adversarial examples can still remain in their true-class semantic regions.
Critical strengths
The paper provides a coherent feature-space analysis of adversarial robustness and evaluates the proposed measurements across a relatively large collection of existing robust models. The observation that prediction failure does not always coincide with loss of true-class centroid membership is also potentially useful for understanding the distinction between representation robustness and final classifier decisions.
Critical weaknesses
The main conceptual contribution is limited. The proposed semantic region is essentially the Voronoi region induced by class centroids in the learned feature space, while centroid-based representations, nearest-centroid classification, and class geometry have been extensively studied. The paper mainly reinterprets this established geometric construction as a semantic region, and it is not sufficiently demonstrated that the resulting analysis provides fundamentally new understanding beyond existing feature-geometry and neural-collapse studies.
The theoretical and empirical evidence is also not strong enough to support the broader claims. The sufficient condition follows directly from the triangle inequality and is quite conservative; in many evaluated models only a small fraction of samples satisfy it despite much higher actual region-survival rates. Moreover, experiments are restricted to CIFAR-10/100 and norm-bounded image attacks, leaving unclear whether the observations generalize to larger datasets, architectures, or other adversarial settings.
Questions for authors
See weakness.
3 comments
Response to Reviewer kALS (W1–W2)
W1. Conceptual novelty
As discussed in our response to Reviewer Fw25 (W2), we acknowledge that centroid-based representations and Voronoi regions are established geometric concepts. Our contribution is not the geometric construction itself, but the new understanding of adversarial robustness obtained through the proposed membership-based analysis.
Existing neural collapse studies (Papyan et al., 2020; Su et al., 2024) primarily characterise the global geometric organisation of features and class centroids. However, preserving global class geometry does not necessarily imply preserving individual semantic-region membership under perturbation. Our analysis reveals two important distinctions. First, stronger semantic organisation of clean representations does not necessarily mean stronger robustness. Instead, robustness is more closely associated with membership preservation under perturbation. Second, adversarial prediction failure does not necessarily mean the loss of true-class membership. These findings distinguish clean representation organisation, representation robustness, and prediction robustness as related but distinct properties.
Furthermore, our additional ImageNet experiments (Fw25 W3) reproduce these phenomena. We will update the manuscript to emphasize that our novelty lies in the membership-based characterisation of robustness and the resulting scientific insights, rather than the introduction of a new geometric construction.
W2. Theoretical and empirical evidence
We acknowledge that the sufficient condition follows from the triangle inequality. The purpose of deriving it is not to introduce a new mathematical inequality, but to explicitly establish the relationship between membership preservation, the clean semantic margin, and adversarial feature displacement.
Conservativeness. The condition is sufficient rather than necessary. Failure to satisfy it does not imply that the representation leaves its semantic region. Whether a representation crosses a region boundary depends on both the magnitude and direction of displacement, whereas our condition considers only magnitude. The discrepancy between condition satisfaction and actual survival is therefore expected. It highlights the conservativeness of a direction-independent sufficient condition.
Scope. As discussed in our response to Reviewer trmg (W1), the PGD-based estimate does not provide a certified upper bound on maximum displacement. Our analysis therefore characterises the relationship between semantic margins, observed displacements, and membership, rather than providing a robustness certificate.
Generalisation. To address the concern about experimental generality, we extended our evaluation to ImageNet using both CNN and Transformer architectures (Fw25 W3). The additional experiments reproduce the key phenomena observed on CIFAR-10 and CIFAR-100, including substantially higher survival rates for robust models, the discrepancy between condition satisfaction and observed preservation, and the retention of true-class membership despite misclassification. Although our empirical evaluation focuses on norm-bounded image perturbations, the geometric condition is not dependent on a specific attack algorithm. We will add a discussion of this distinction (the generality of the theoretical condition vs. the scope of our empirical findings) in the final version.
Thank you for the detailed rebuttal and additional experiments. I appreciate the authors’ efforts to clarify the conceptual contribution and the scope of the theoretical and empirical findings. While these clarifications are helpful, my main concerns regarding conceptual novelty and the strength of the theoretical contribution remain. Therefore, I will maintain my original score.
Acknowledgment to All Reviewers
We thank all reviewers for your constructive feedback. We noticed that several of your concerns overlap; however, to make the rebuttal as convenient to read as possible for each of you, we have provided a clean and complete response for every reviewer individually.
We also sincerely apologise for the delayed submission. Our new adaptive attacks, along with the extensive ImageNet evaluation across multiple models and architectures, proved to be highly time-consuming. We appreciate your patience.