- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes CPRU (calibration point relative utility), which is a trajectory reading method for transferable confrontational attacks. CPRU does not always deploy the final iteration, but uses target-to-target unrelated proxy models and attack specific utility readers to evaluate the saved intermediate confrontation state, and selects image-specific operations related to regular endpoints. This method retains the original attack generation process, and the official target is still inaccessible before deployment. Experiments on CIFAR-10 and ImageNet-1K in multiple attack and target architectures show that trajectory reading can improve the success rate of transfer attacks.
Critical strengths
- The paper identifies image-specific trajectory selection as an underexplored degree of freedom in transfer attacks.
- Source, proxy, development, and formal-target models are explicitly separated, reducing the risk of formal-target leakage.
- The paper evaluates multiple attacks, targets, source models, two datasets, uncertainty intervals, and several controlled ablations.
Critical weaknesses
- There is a mismatch between the theoretical utility formulation and the implemented reader. The theory defines , whereas the ExtraTrees regressor is trained with highly asymmetric 31/3/1 sample weights. Therefore, the learned score is generally not an unbiased estimate of the conditional utility used in the theoretical analysis, which weakens the interpretation of the zero-utility threshold and the fitted-reader bound. 2.The method relies on substantial auxiliary resources. CPRU requires four proxy models, five development models, a labeled development population, and 44 additional proxy forward passes per image, yet there is no strong resource-matched comparison against simpler proxy-based selection or ensemble strategies.
- The calibration claim is insufficiently validated. Although the method is described as a calibrated utility readout, the paper does not provide direct calibration, utility-prediction, or sign-accuracy analysis to verify that predicted scores correspond reliably to actual relative utility.
- Some experimental comparisons and protocol choices need stronger justification. The LPAA comparison contrasts a trajectory-readout method with a different attack-generation method, while the reported runtime excludes the offline reader-development cost. In addition, the ImageNet reader is trained on a subset of the validation set rather than on a fully separate development split.
- Several implementation details remain insufficiently justified. Important design choices such as the 31/3/1 weighting, 180 trees, minimum leaf size, and the exact BP14 definition lack adequate motivation or sensitivity analysis.
Questions for authors
- How do the asymmetric 31/3/1 sample weights affect the interpretation of the reader output as ? Does the theoretical analysis still apply to the weighted regressor?
- Were the reader hyperparameters, including the 31/3/1 weighting, 180 trees, and minimum leaf size, fixed using only the development set before any formal-target evaluation?
- In the ConvNeXt-Small source-transfer experiment, is the reader reused without retraining, or is it refitted using trajectories generated from the new source model?
- How does CPRU compare against simpler resource-matched proxy-based trajectory selection rules, such as selecting the step with the highest mean proxy margin or proxy success rate?
4 comments
Deadline for Discussion is Approaching in Less than 3 Days
Dear reviewer npNC ,
We have carefully considered all the valuable points and concerns you raised in your initial review through the initial rebuttal. As the deadline for discussion is approaching in about 3 days only, we respectfully ask whether our response has addressed your concerns, or you still have questions to raise. Your comments are highly valuable to us. Thank you once again for your professional time and insightful effort in reviewing our submission.
Best regards,
Authors
Deadline for Discussion is Approaching in Less than 2 Days
Dear reviewer npNC ,
We have carefully considered all the valuable points and concerns you raised in your initial review through the initial rebuttal. As the deadline for discussion is approaching in about 3 days only, we respectfully ask whether our response has addressed your concerns, or you still have questions to raise. Your comments are highly valuable to us. Thank you once again for your professional time and insightful effort in reviewing our submission.
Best regards,
Authors
Your Comments are Highly Valuable to Us [Deadline in One Day]
Dear reviewer ,
We have carefully considered all the valuable points and concerns you raised in your initial review through the initial rebuttal. As the deadline for discussion is approaching in only one day, we respectfully ask whether our response has addressed your concerns, or you still have questions to raise. Your comments are highly valuable to us. Thank you once again for your professional time and insightful effort in reviewing our submission.
Best regards,
Authors
We thank the reviewer for recognizing image-specific selection, model-role separation, and the breadth of the evaluation.
1. Weighting and theoretical alignment (Q1).
We agree that sign-dependent weighting changes the squared-loss estimand. We replaced 31/3/1 with 1:1:1: ordinary MSE now targets the conditional signed utility in Eq. 16 (Eq. 29), retaining the target-clean normalization in Eq. 14. Proposition 2 describes the ideal selector; the fitted-reader bound in Eqs. 21-22 explicitly depends on prediction error to that conditional utility. Gains remain +7.347 pp on CIFAR-10, while ImageNet improves from the original +2.280 to +2.693 pp (Tables 1, 4).
2. Parameter sensitivity and the origin of BP14 (Q2).
All reader hyperparameters were determined using only the development set. Varying trees over 90/180/360 and minimum leaf size over 8/16/32, one factor at a time, gives +7.137-7.519 pp on CIFAR-10, with only 0.382 pp ASR spread (Tables A.29-A.30). Gains therefore do not depend on the precise 180/16 setting. Tables A.2-A.3 document model roles, constructors and preprocessing.
BP14 arose from our early work on MDCS: we sought to make its scaling responsive to disagreement between the current normalized gradient qi,t and its historical mean qˉi,t−1. We introduced the coordinate-wise ratio ri,t (Eq. A.73) and adaptive exponent pi,t=1/4+ri,t/4 (Eq. A.74) to couple perturbation and momentum scaling (Eq. A.76). Although this improved the baseline, fixed-endpoint deployment remained a key transfer bottleneck, motivating CPRU. We retained BP14 as one of five trajectory generators; Appendix A.4.3, Eqs. A.70-A.77, provides its complete definition.
3. The original source experiment refitted readers; frozen reuse also works (Q3).
The original ConvNeXt-Small experiment used source-specific development trajectories to test CPRU with a different source. We now also directly reuse frozen ViT-B/32 readers: +4.004 pp, retaining 94.0% of the dedicated readers' +4.260 pp (Table 3). This verifies direct reuse across these sources without separately retraining the reader.
4. Direct proxy selectors and CPRU utility analysis (Q4).
RelMargin and RelVote use the same trajectories, actions and four-proxy outputs (44 forwards per image and attack), without reader training or inference. RelMargin retains per-image intermediate-state selection, clean-logit normalization, final-relative margins and the zero-score Final fallback (Eqs. 24-26, 30). RelVote uses final-relative proxy-success votes; both retain Final unless the best score is positive. CIFAR-10 mean ASRs are 54.707% (Final), 60.049% (RelMargin), 57.822% (RelVote), and 62.054% (CPRU). The learned reader adds 2.005/4.232 pp over the two controls (Tables A.17-A.18). RelMargin is itself part of our contribution: a lightweight, reader-free variant of the CPRU trajectory-readout framework.
CPRU utility analysis. Recovery exceeds destruction: 9.330 vs 1.983 pp on CIFAR-10 and 4.726 vs 2.033 pp on ImageNet (Table A.31). Appendix A.9, Table A.33 compares mean predicted/observed signed utility on unseen formal targets: 6.054/7.347 pp on CIFAR-10 and 2.912/2.693 pp on ImageNet-1K. Predictions reflect positive aggregate gains and successfully capture the contrast between larger gains on CIFAR-10 and smaller gains on ImageNet.
5. LPAA: training-free deployment and comparison purpose.
Strong performance without reader training. RelMargin achieves 66.10% ASR versus LPAA's 63.28% (+2.82 pp), taking 106.010 vs 595.531 s for 1,000 images; LPAA takes 5.62 times as long (Table 2). Timing includes online generation/selection and one target's loading and clean/adversarial forwards.
No new reader training is required. Our reader-free CPRU variant retains strong ASR gains without fitting a reader. Together with the reuse evidence in Q3, this supports online-cost comparisons for deployments requiring no new reader training.
Comparison purpose. We agree LPAA changes attack generation, whereas CPRU performs post-hoc readout. Section 4.3 tests whether selecting intermediate states from an unchanged ten-step trajectory, with zero additional source gradients for readout, can match or outperform a strong gradient-enhancement attack. Implementation and complete budgets are in App. A.4.3 and Table A.5(b).
6. ImageNet development and evaluation are image-disjoint.
The classifiers were pretrained on ImageNet training images. We fit utility on held-out validation images to reflect attacks on images outside classifier training. We use 2,000 development images and a disjoint 8,000-image held-out pool, sampling 1,000 evaluation images from that pool (Sec. 4.1). Evaluation images are excluded from reader fitting and tuning; formal targets are not queried during reader development or action selection (App. A.3).