- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates the robustness of adversarial prompt learning for vision-language models, noting that existing methods primarily attack and defend in the pixel space despite learnable prompts being inserted inside the encoder. The authors propose a joint pixel-feature threat model where an adversary perturbs both the input image and intermediate residual-stream activations at selected visual encoder layers. To address this, they present JPFAT, which comprises JA-PGD to alternate updates between pixel and multi-layer feature perturbations, Relative Activation Budgets to calibrate feature perturbation radii against layerwise activation scales, gradient-effort allocation to adjust step sizes while preserving fixed projection radii, and VAAL to weight training examples by output and internal drift. Experiments across 11 few-shot datasets using CLIP ViT-B/32 and MaPLe prompts evaluate base-to-new generalization, cross-dataset transfer, single-path and joint robustness, ablations, computational cost, AutoAttack, adaptive attacks, deeper attacks, and the ViT-B/16 backbone. The primary finding is that joint pixel-feature adversarial training improves joint robustness, accompanied by a modest drop in clean accuracy.
Critical strengths
-
Strong motivation and a cohesive methodological formulation: The paper highlights the asymmetry between prompts operating internally and defenses remaining restricted to pixel space. It formalizes a joint pixel-feature threat model, where JA-PGD, RAB, effort allocation, and VAAL serve well-defined complementary roles to form a coherent framework.
-
Comprehensive experimental evaluation: The validation covers 11 datasets, base-to-new generalization, cross-dataset transfer, pixel/feature/joint evaluations, ablations, computational overhead, AutoAttack, adaptive attacks, deeper attack depths, and alternative backbones. The empirical results consistently support the claim that joint training outperforms pixel-only adversarial prompt baselines under the proposed threat model.
Critical weaknesses
-
Practical relevance of the threat model and low absolute robustness: The feature perturbation path assumes white-box write access to intermediate activations, which is uncommon in typical image-based adversarial settings. Furthermore, even under this threat model, the harmonic mean of joint robust accuracy remains around 5%–6%, which limits its practical security utility. The paper also acknowledges that feature-space robustness complements rather than replaces pixel-space robustness.
-
Methodological complexity, hyperparameter sensitivity, and reporting consistency: JPFAT introduces multiple hyperparameters across RAB budgets and steps, allocation temperature and momentum, VAAL attention temperature and floors, robust loss weight , and attack depth. Ablation results indicate that the performance gains of RAB and effort allocation are somewhat dataset-dependent. Additionally, baseline comparisons involve non-equivalent threat sets during training, making JPFAT's advantage under joint evaluation largely expected. Finally, discrepancies in table labels and numerical values across sections should be resolved to ensure clarity, reliability, and reproducibility.
Questions for authors
- Feature perturbations require white-box write access to internal activations. Could the authors elaborate on more realistic deployment scenarios for this threat model? Does JPFAT retain an advantage over baselines under black-box or transfer-based attack conditions?
- Does the joint evaluation protocol inherently disadvantage pixel-only trained baselines? Were the training compute, total perturbation budgets, and attack iteration counts matched across methods? Could the authors clarify the naming and numerical discrepancies across the tables?