- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents VizAnchor, a framework designed to detect, localize, and explain post-creation semantic manipulations in data visualizations. The core idea is to couple tamper localization with an invertible watermarking module that embeds a metadata payload (a URL referencing the authentic chart). A Vision-Language Model (VLM) sequentially infers the tamper type, reconstructs contrasting chart narratives, and decodes the misleading intent based on the authentic chart, tampered chart, tamper map, and localized comparison. The framework is evaluated quantitatively on evidence construction and manipulation understanding benchmarks, complemented by a user study assessing human-perceived explanation quality.
Critical strengths
- Leveraging an authentic reference chart retrieved via watermarking provides a viable strategy for semantic manipulation analysis.
- The multi-stage workflow is systematically structured and promising.
Critical weaknesses
-
Limited Technical Novelty and Confounded Performance Gains. The core technical components are invertible watermarking tamper localization, which are all well-established techniques. This paper thus reads more like a combination of VisDefender and the access to the authentic chart. It is expected that downstream VLM understanding and explanation metrics will improve substantially with the reference. Consequently, it is unclear whether the observed gains reflect algorithmic/reasoning innovations or simply asymmetric information access over reference-blind baselines.
-
Ablations Reveal Minimal Impact of the Proposed Spatial and Reasoning Components. As shown in Appendix Table 10, the vast majority of performance improvements are achieved simply by introducing the authentic reference chart. Adding the spatial tamper map and localized comparisons yields negligible marginal gains, and in fact leads to slight degradation on some metrics. This directly undermines the claim that the spatial anchor and fine-grained visual comparison components are essential drivers of the framework's reasoning capabilities.
-
Lack of a Direct Pixel-Differencing Baseline for Localization. Once the authentic reference chart is retrieved, a direct pixel-wise difference would naturally highlight modified regions. The paper lacks a comparison against such a simple differencing baseline. Without this benchmark, it is difficult to justify the complexity and overhead of training a U-Net localizer, especially when a minimal pipeline that solely embeds the URL payload and applies direct visual differencing might suffice in practice.
Questions for authors
- Does the U-Net provide statistically meaningful localization gains over direct pixel-differencing?
- Does combining VizDefender with authentic reference chart produces a comparable result?
2 comments
Thank you again for your careful review and constructive discussion! Your feedback has helped us improve the clarity and rigor of our work. We sincerely appreciate the time and attention you have devoted to our paper.
Best regards,
The Authors
I appreciate the authors' efforts in addressing my concerns. The additional experiments have strengthened the evaluation. However, I remain concerned about the technical novelty, particularly the necessity of the proposed crop-aware localization mechanism when the authentic reference chart is available. It is unclear whether conventional image registration or alignment techniques could achieve comparable results without the proposed position-map-based design. Therefore, I remain inclined to maintain my original rating.