- Rating
- 2
- Confidence
- 2(−1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes Q-Hack, a black-box typographic attack framework targeting vision-language model-based image quality assessment (VLM-IQA). The method adopts a coarse-to-fine strategy that first generates three types of quality-related adversarial text and identifies suitable placement regions using semantic, degradation, and depth information. It then iteratively refines text-region pairs based on target-model feedback to improve attack effectiveness. Experiments on three IQA datasets and four VLM-IQA models demonstrate that Q-Hack effectively manipulates predicted quality scores while maintaining perceptual fidelity and scene consistency.
Critical strengths
- This paper provides clear task-specific motivation by identifying three categories of quality-related adversarial text and investigating how text types and placement in degraded regions affect attack effectiveness.
- The proposed framework integrates semantic, degradation, and depth information for natural text placement, achieving strong attack effectiveness and perceptual fidelity across multiple datasets and VLM-IQA models.
Critical weaknesses
- The methodological novelty is limited, as joint text-placement planning, naturalistic rendering, and black-box feedback optimization have been explored in prior works [1–3]; the main contribution lies in task-specific adaptation and integration.
- The observed advantage of placing adversarial text in degraded regions is mainly established through artificially introduced localized distortions, with limited direct evidence of its underlying mechanism or generalizability to complex real-world degradation patterns.
- This paper lacks an independent ablation of IQAGR and comparisons under matched query budgets, making it difficult to distinguish methodological improvements from gains due to additional optimization.
- Although Eq. (2) formulates a multi-objective optimization problem, the refinement stage primarily relies on target IQA scores for candidate selection, leaving the roles of scene consistency and perceptual fidelity in the actual optimization process unclear.
[1] Yue Cao, Yun Xing, Jie Zhang, Di Lin, Tianwei Zhang, Ivor Tsang, Yang Liu, and Qing Guo. SceneTAP: Scene-Coherent Typographic Adversarial Planner against Vision-Language Models in Real-World Environments.
[2] Ziyuan Luo, Xinyu Chen, Qi Song, and Renjie Wan. Naturalistic Typographic Attacks on VLM-Based Image Quality Assessment.
[3] Shihong Liu, Samuel Yu, Zhiqiu Lin, Deepak Pathak, and Deva Ramanan. Language Models as Black-Box Optimizers for Vision-Language Models.
Questions for authors
- Can the authors clarify the key methodological differences between Q-Hack and prior works [1–3], particularly regarding text-region joint optimization, beyond task-specific adaptation?
- Can the authors provide additional experiments on real-world localized distortions to validate the effectiveness of degradation-aware placement, especially compared with placing text in non-degraded or degradation-mismatched regions?
- Can the authors provide an ablation study without IQAGR and compare Q-Hack with existing methods under matched query budgets to better isolate the contribution of feedback-guided refinement?
- How are the scene consistency and perceptual fidelity terms in Eq. (2) incorporated into the actual optimization process, and how are the weighting parameters μ and λ determined?
[1] Yue Cao, Yun Xing, Jie Zhang, Di Lin, Tianwei Zhang, Ivor Tsang, Yang Liu, and Qing Guo. SceneTAP: Scene-Coherent Typographic Adversarial Planner against Vision-Language Models in Real-World Environments.
[2] Ziyuan Luo, Xinyu Chen, Qi Song, and Renjie Wan. Naturalistic Typographic Attacks on VLM-Based Image Quality Assessment.
[3] Shihong Liu, Samuel Yu, Zhiqiu Lin, Deepak Pathak, and Deva Ramanan. Language Models as Black-Box Optimizers for Vision-Language Models.
4 comments
Thank you again for your thoughtful comments and constructive feedback. We sincerely hope that our response has adequately addressed your concerns.
As the discussion period nears its deadline, we would appreciate it if you could share whether our responses have sufficiently clarified the issues you raised or if any concerns remain.
Thank you very much for your time and consideration!
Thank you for your response. It has addressed my questions. That said, I still find it difficult to fully assess the overall quality of the manuscript, so I have lowered my confidence.
Thank you for taking the time to review our revised responses and for acknowledging that we have addressed your questions. We understand that you may still have some reservations regarding the overall quality of the manuscript, and we sincerely appreciate your thoughtful feedback and the time you have devoted to reviewing our work.
Q1 & W1. Technical novelty
We acknowledge that several technical components of Q-Hack have been explored in prior works. However, our contribution lies in how these techniques are integrated and adapted to address the specific challenges of VLM-IQA, rather than introducing entirely new components. The key methodological differences are summarized as: 1) compared to [1], Q-Hack establishes a correspondence between text semantics and local quality degradations, enabling quality-aware text-region matching; 2) compared to [2], Q-Hack jointly considers quality degradation, scene semantics, and depth geometry to identify regions that are both attack-relevant and visually plausible; 3) compared to [3], Q-Hack extends feedback-driven optimization to text-region pairs, enabling the target IQA model's feedback to jointly refine adversarial text content and spatial placement.
Q2 & W2. Observation of degradation-aware placement
To validate the generalizability of this observation, we conduct additional experiments on real-world distortions. Specifically, we use Q-Ground to identify distorted and undistorted regions in images, along with the corresponding distortion types. We then consider three text placement settings: 1) placing attack text in undistorted regions (Table 5); 2) placing attack text in distorted regions with mismatched distortion types (Table 5); and 3) placing attack text in distorted regions with matched distortion types (Table 5). Please refer to Section 4.3 for detailed experimental settings. The results show that the third setting leads to the best attack performance, confirming that degradation-aware placement can generalize to real-world image distortions. It indicates that VLM-IQA assesses visual quality based on local distortions in images; placing semantically matched attack text in these distorted regions helps highlight such distortions.
Q3 & W3. Ablations on IQAGR
We evaluate IQAGR with different rounds (0, 2, 4, 6, 8, 10, 12, and 14), where 0 indicates that IQAGR is disabled. The experimental results in Fig. 6(d) in the revised manuscript show that 1) Q-Hack still achieves stronger attack performance than baselines even without IQAGR; and 2) ASR increases with the IQAGR rounds and gradually converges after 10 rounds.
We also evaluate a minimum-cost configuration of Q-Hack (denoted as Ours*) in Tables 3 (Section 4.2) and 7 (Appendix C.3). Ours* requires only 3 queries, which is comparable to advanced typographic attacks such as SceneTAP (1 query) and NTA (1 query). In this case, Ours* still achieves better attack performance compared to baselines under comparable query budgets.
Q4 & W4. Issues on Eq. (2)
We apologize for the confusion caused by the inappropriate formulation of Eq. (2) in the original submission. Ideally, an effective typographic attack against IQA should consider three aspects: attack effectiveness, scene consistency, and perceptual fidelity. However, Q-Hack addresses these aspects through different mechanisms rather than jointly optimizing them. Specifically, Q-Hack employs semantic-aware region selection and LVTR-based rendering to promote scene consistency, whose effectiveness is supported by objective metrics (i.e., TSIS) and our newly added human subjective evaluation (Section 4.2). Regarding fidelity, Q-Hack selects the smallest suitable region to limit the size of the embedded text, thereby reducing its impact on the original image quality. The MAE and DISTS results further demonstrate its superior fidelity preservation compared with existing methods. Therefore, Q-Hack explicitly optimizes only attack effectiveness during the refinement stage.
To better reflect this distinction, we have revised Eq. (2) by reformulating scene consistency and perceptual fidelity as constraints rather than explicit optimization objectives. The revised Eq. (2) formulates the desired attack problem, while Q-Hack provides a practical solution that explicitly optimizes attack effectiveness and implicitly promotes scene consistency and perceptual fidelity through its design. Accordingly, the thresholds ϵ1 and ϵ2 conceptually characterize acceptable levels of scene consistency and perceptual fidelity, rather than serving as numerical constraints explicitly enforced during refinement.