- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes TCRA (Tilt Curvature Regularization Attack) to improve the transferability of confrontational examples. The motivation of this method is to assume that the transferable disturbance should be located in the flat area shared by the model, not just the specific flat area of the agent. TCRA combines finite difference gradient detection, parallel intersection gradient decomposition and exponential tilt to construct the curvature perception attack direction without querying the target model. Experiments on ImageNet compatibility and CIFAR-10 benchmarks show that the success rate of attacks based on standard, counter training and Transformer-based target models has improved.
Critical strengths
- The paper provides a meaningful perspective on adversarial transferability by distinguishing surrogate-specific flatness from potentially shared cross-model flat regions.
- TCRA combines finite-difference probing, gradient decomposition, and exponential weighting in a coherent attack framework without target-model queries.
- The method is evaluated across multiple surrogate/target models, adversarially trained models, Transformers, defenses, CIFAR-10, and several existing attack frameworks.
Critical weaknesses
- The connection between the proposed “shared flat region” motivation and the actual optimization is not fully established. The conceptual curvature-regularized objective in Eq. (3) is not directly optimized by TCRA, and the paper itself acknowledges that the proposed update is only motivated by, rather than being the gradient of, this objective. Moreover, the current visualizations mainly examine the surrogate loss landscape and do not directly demonstrate that the discovered regions are flat across unseen target models
- Several experimental protocol and reporting issues require clarification. The sensitivity analysis appears to select and based on performance over the same black-box target models used for evaluation, which may introduce target-side hyperparameter tuning. In addition, important implementation details such as the exponential tilting parameter are not clearly reported.
- There are inconsistencies in the reported results. For example, Table 4 reports an average ASR of 86.5% over six black-box models, which does not match the corresponding average implied by Table 1. Similarly, some “black-box average” results in Tables 2 and 3 appear to include the white-box source model, and the text incorrectly refers to RAP as the strongest baseline in one comparison where PGN performs better.
- The experimental comparisons could be stronger and more up to date. Although the related work discusses recent landscape-aware attacks such as CWA, AWT, LPAA, and PFA, these closely related methods are not included in the main experimental comparison.
- Some methodological claims are stronger than what is theoretically supported. In particular, orthogonal gradient components are described as more stable or transferable, although the theoretical analysis only establishes geometric properties and explicitly notes that orthogonality itself does not guarantee transferability. Likewise, exponential tilting favors high-loss samples but does not directly prefer low-curvature regions.
Questions for authors
- Were , , and other hyperparameters selected using the same black-box target models reported in the final evaluation, or were they fixed using a separate development setting?
- Could the authors clarify the discrepancy between the 86.5% average ASR reported in Table 4 and the corresponding results in Table 1, as well as whether the averages in Tables 2–3 include white-box source models?
- What values are used for the exponential tilting parameter and TCRA momentum coefficient in the experiments?
- Can the authors provide direct evidence that TCRA discovers regions that are flat across both surrogate and target models, rather than only flatter regions on the surrogate?