- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper addresses subject fidelity in unrestricted targeted adversarial generation by introducing a carrier: a visually secondary object placed in the background, outside the primary subject, to provide an additional spatial pathway for attack-related modifications. Built on FLUX.1-Kontext-dev with subject-specific LoRA adaptation and SAM3-based localisation, the framework applies globally RMS-normalised classifier guidance. Three implementations—CRA, CIRA, and JIA—are evaluated under three carrier conditions across 600 source–target pairs. Reported results include white-box Top-1 success rates of up to 99.67%, black-box Top-5 success rates of up to 55.07%, and DINOv3 similarity scores of 0.9799–0.9960. The paper also presents a blinded human study covering 5,400 images, reporting a result of 99.96%, and a carrier-whitening intervention under which 52.8% of initially successful attacks lose their target Top-1 prediction.
Critical strengths
- An informative intervention-based analysis of the carrier’s contribution. On 1,163 localisable CRA composites, whitening only the unoccluded carrier region while leaving the primary subject unchanged reduces the target logit in 98.3% of samples. The removed area correlates strongly with the logit reduction (Spearman’s ρ = 0.774, p < 0.001), and 52.8% of initially successful attacks lose their target Top-1 prediction. These results provide concrete evidence that the carrier region contributes substantially to the target prediction, beyond what aggregate attack success rates alone can establish.
- Substantial experimental scale and internally consistent reporting. The evaluation comprises 600 source–target pairs, 1,800 carrier-controlled cases, 5,400 attacked images, and three annotations per image. My recomputation confirms all verifiable numerical relationships, supporting the internal consistency of the reported results.
Critical weaknesses
- The Target Carrier condition introduces a fundamental ambiguity in the adversarial interpretation. Under this condition, an instance of the target class is explicitly inserted into the image. Consequently, some of the reported attack success and cross-model transferability may reflect correct recognition of a genuinely present target object rather than classifier deception. For example, if an image contains both a dog and a castle, predicting “castle” is not necessarily an error. Conditional ASR excludes cases in which the target class is already recognised before the attack, but it does not by itself distinguish adversarial misclassification from correct recognition of the constructed carrier. The whitening results establish the carrier’s importance to the prediction, but do not resolve this distinction: removing a legitimate target-class cue could produce the same effect.
- The human study measures primary-subject recognisability rather than attack unobtrusiveness. The prompt template in Appendix B.2 explicitly requests a carrier “in the distant background, slightly blurred by shallow depth of field,” encouraging a small, distant, and defocused object. Participants are then asked to select the “most relevant option describing the primary subject,” with only the subject label corresponding to a salient foreground instance. The per-annotator rates of 99.74%–99.93% suggest that this is a near-ceiling recognition task. The study therefore supports the narrower conclusion that the intended primary subject remains recognisable, but does not establish that the carrier is unobtrusive or that the resulting image appears unedited.
Questions for authors
- When the carrier explicitly depicts the target class, what evidence distinguishes classifier deception from correct recognition of an inserted object? In particular, the finding that carrier whitening causes 52.8% of initially successful attacks to fail appears compatible with either explanation. Could the authors collect human judgments of whether the target label validly describes an object present in the image, alongside judgments of which class a classifier would be expected to predict?
Response to Reviewer: Clarifications on Whitening, Carrier Optimization, and Visual Naturalness
Thank you for your careful review and for recognizing our intervention analysis and experimental consistency. Your comments helped us clarify the interpretation of the carrier experiments and extend our evaluation of visual naturalness.
Weakness 1 & Question 1: Target-class content and the interpretation of whitening
Thank you for raising this distinction. Our setting allows a visible secondary carrier while requiring the personalized subject to remain the primary image content. We agree that, for Target Carriers, target-label membership and original post-attack whitening alone do not establish that the target label is semantically invalid.
However, our original whitening experiment also includes Non-Target Carriers, which do not belong to the target class (Appendix J.3). Removing these carriers causes 51.0% of initially successful attacks to lose the target Top-1 prediction, comparable to 54.6% for Target Carriers. For example, when the target is ambulance and the carrier is an ordinary minivan, the intervention removes a minivan rather than an actual ambulance. Thus, the observed effect is not limited to removing a genuinely present target-class object.
Motivated by your concern, we added pre-attack whitening followed by clean-carrier restoration (Appendix J.4). We whiten the carrier region before optimization and restore its original clean pixels afterward. The final image therefore contains the clean carrier without retaining the changes produced inside that region during the attack. Nevertheless, standard-strength attack success remains below that of the original carrier attacks. Under strong guidance, ASR remains high at 97.96%, but subject DINO is 0.8160, compared with 0.9345 in the original Target-Carrier condition. In other words, restoring the carrier afterward does not recover the subject-preservation benefit obtained when its original content is available during optimization. These results support the carrier’s role during optimization and are consistent with our normalized update-allocation mechanism.
Weakness 2: Subject recognition and visual naturalness
Thank you for pointing out this difference. Our setting does not require the carrier to be hidden or imperceptible. It should remain visible but visually secondary, with the personalized subject remaining the primary image content. Our original human study evaluates this objective, rather than whether the image appears unedited.
Even when an observer knows the original image and notices the added carrier, a semantically plausible background object may still appear more natural than conspicuous distortions. In our NatADiff adaptation, target-related features may emerge on the subject. Our carrier instead provides a designated secondary region for such changes, reducing their impact on the subject. For the strong No-Carrier attacks baseline, it may also produce conspicuous unnatural noise and patterns that seem unnatural for the human observer.
Following your suggestion, we completed a comparative human study to assess how natural the outputs look to observers. Annotators judged outputs from all three carrier conditions to look less unnatural or artificially manipulated than the strong No-Carrier baseline. Together with the original subject-recognition study, this suggests that the carrier can remain visible and visually secondary while the personalized subject stays dominant and the overall image looks more natural. Please see Appendix L.2 for the study setup and full results.
Thank you again for helping us clarify these distinctions and strengthen our evaluation.