- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes TokenShield, a quantization-aware adversarial protection method against unauthorized image editing by autoregressive (AR) generative models. The central observation is that perturbing continuous image representations does not necessarily change the discrete visual tokens consumed by AR editors, because hard quantization can map different continuous features to the same codeword.
Critical strengths
- The paper identifies an important limitation of conventional adversarial protection methods when applied to discrete-token image generators.
- The paper evaluates protection across eight editors and two datasets, including both AR and discrete diffusion architectures. This is a relatively comprehensive evaluation for a newly proposed protection setting.
Critical weaknesses
- Insufficient justification of the proposed quantization-aware protection objective.
- Mismatch between codeword displacement and editing failure: The proposed method maximizes the Euclidean displacement between quantized codewords. However, codeword distance does not necessarily correspond to semantic changes or the failure of the requested editing operation. Consequently, it remains unclear whether maximizing the proposed objective directly improves the intended protection effectiveness.
- Limited connection to target-editor representations: TokenShield optimizes perturbations using a single frozen LlamaGen tokenizer, while the evaluated editors employ heterogeneous visual representations. The paper does not establish whether the observed improvements result from disrupting the target editors' actual discrete token assignments or from more general adversarial feature transfer.
- Limited guarantees under pixel-space constraints: Although OCC has desirable properties in the unconstrained feature space, these properties do not necessarily extend to bounded pixel-space optimization. The authors acknowledge that small OCC loss may not imply large hard-codeword displacement and that gradients can vanish or cancel during backpropagation. The practical implications of these limitations remain insufficiently investigated.
- Insufficient evidence of substantial practical improvements over strong baselines.
- Marginal gains over direct PGD baselines: Although TokenShield substantially outperforms several external protection methods, its improvements over PGD-C and PGD-E are considerably smaller. For example, on Emu Edit, its average paired LPIPS improves only from 0.631 to 0.636 over PGD-E, and it is not consistently superior across individual editors. The absence of uncertainty estimates makes the reliability of these improvements difficult to assess.
- Lack of direct editing-failure evaluation: The primary metrics measure differences between clean-input and protected-input editing outputs, rather than whether the requested edits are successfully prevented. The supplementary Target CLIP results show relatively small improvements over PGD-E (0.241 to 0.238 on PIE-Bench and 0.220 to 0.215 on Emu Edit). More direct instruction-following failure rates and source-content preservation evaluations are needed.
- Limited robustness and computational analysis: Robustness is primarily evaluated under JPEG compression, without comprehensive comparisons against strong baselines under other transformations. Furthermore, TokenShield requires 500 PGD iterations, but the actual protection-generation cost and performance under matched computational budgets are not reported, making its practical advantage difficult to establish.
Questions for authors
See weakness and solve my concerns.