- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper investigates natural adversarial example generation for LVLMs. The proposed EvoNAT framework performs source-free attacks via natural language-guided evolution, enabling adversarial image generation without relying on a specific source image. The authors further extend the framework with a source-conditioned editing variant. Experimental results across multiple models and tasks demonstrate the effectiveness of the proposed attack.
Critical strengths
Natural adversarial example generation is an interesting research topic. EvoNAT achieves good performance on multiple evaluation metrics and datasets.
Critical weaknesses
- The writing issues: This paper is not easy to follow.
In my view, a good abstract and introduction should tell the readers three aspects: “What”, “Why” and “How”.
“What is EvoNAT?” => a source-free adversarial image generation method that leverages natural language-guided evolution. (Well, it looks interesting)
“How does it work?” => it introduces evolutionary search over structured visual descriptions on objects, attributes and scene context. A text-to-image diffusion model is used to render the adversarial image. (It sounds reasonable)
“Why do we do this research?” => Previous work limits the range of visual content that can be explored AND THEN? (This paper largely misses the discussion on this part)
- The baselines are not sufficient.
As an attacker, two core metrics should be considered: attack success rate and stealthiness. Regardless of whether the adversarial image is generated from a source image or not. Therefore, the authors should compare with multiple black-box attack methods [1][2] to sufficiently verify the superiority of source-free attacks.
[1] Li et al. A Frustratingly Simple Yet Highly Effective Attack Baseline: Over 90% Success Rate Against the Strong Black-box Models of GPT-4.5/4o/o1. NeurIPS’25.
[2] Jia et al. Adversarial Attacks against Closed-Source MLLMs via Feature Optimal Alignment. NeurIPS’25.
Questions for authors
About the “Why” in writing issues:
-
Why is source-free better than source-based methods? Do they achieve better ASR? Do they have better stealthiness? Are they computationally friendly?
-
Why introduce EvoNAT-Edit? Especially since it is still source-conditioned and seems inconsistent with the motivation of this paper.
-
Why use evolutionary search instead of gradient-based optimization? Faster? More interpretable?