- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes GeoSTA, a typographic intervention intended to mitigate image-based geolocation by large vision-language models. It preserves the original image region and appends text in an extended margin. The method selects a plausible incorrect country, constructs an authoritative location instruction, and, when necessary, uses feedback from the target model to generate an explanatory statement reconciling the visual content with that country. Evaluation covers five commercial LVLMs and three datasets of 100 images each, using country-level error rate as the attack success metric.
Critical strengths
- The paper addresses a consequential privacy concern and demonstrates substantial susceptibility to contextual text across 5 commercial LVLMs. The reported improvements over the evaluated baselines are large, making the empirical observation worth investigating.
- The framework is straightforward, and the component ablations, prompt variations, and transfer experiments provide useful evidence about when instructional and explanatory text affects country predictions.
Critical weaknesses
- The novelty is limited and not clearly demonstrated. Self-Generated Typographic Attacks already uses confusing targets, explanatory text, and added white margins. GeoSTA mainly adds target-model feedback, but the experiments do not show whether this feedback is better than generating an explanation directly from the image.
- The experimental results do not sufficiently support the privacy claims. The original image remains intact, making it easy to bypass the protection by cropping away the added border. Does any protection remain after cropping? Some explanations explicitly name the true landmark and country, potentially revealing key location clues. For example, although the text in Figure 5 denies that the image shows the Merlion in Singapore, it still gives the reader the correct location as a clue. Evaluation is limited to country-level classification error rates on three datasets of 100 images each, without distance-based metrics, evaluation on established public benchmarks, or comparisons with GeoShield and ReasonBreak. Evaluating on established benchmarks such as Im2GPS3k and Google Street View at distance thresholds of 1, 25, 200, 750, and 2500 km would provide stronger evidence of practical privacy protection.
Questions for authors
- Did you compare against the version of Self-Generated Typographic Attacks that includes explanatory text? How much does target-model feedback improve GeoSTA compared with generating the explanation directly from the image, without feedback?
- Does the protection still work if the added border is cropped out? What stops a bot from accessing the original image shown to users?
- Can you compare GeoSTA with GeoShield and ReasonBreak on a standard benchmark at 1, 25, 200, 750, and 2500 km? Please also report attack success only on images the model could correctly locate before protection.
- Some explanations explicitly name the true landmark and country, potentially revealing key location clues. For example, although the text in Figure 5 denies that the image shows the Merlion in Singapore, it still gives the reader the correct location as a clue. How is residual location disclosure accounted for?