- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
- Investigates how VLM judgments change with the visual presentation and apparent authority of substantively identical evidence.
- Proposes Apparent Provenance Manipulation (APM), a paired evaluation framework comparing Plain Text, Text-in-Image, Neutral Document, and Authoritative Document under fixed evidence content and conversation history.
- Finds that official-looking documents are more persuasive than simple text-in-image renderings, particularly when the evidence is semantically relevant to the target claim.
Critical strengths
- Provides a systematic evaluation framework that controls evidence content and conversation history to examine the influence of visual presentation on VLM judgments.
- Evaluates multiple VLMs and datasets, with additional analyses of semantic relevance, document formats, and belief persistence.
- Investigates a practical reliability concern regarding the influence of unverified visual authority cues on VLM judgments.
Critical weaknesses
- Prior studies have already investigated authority bias and multimodal persuasion, limiting the methodological novelty beyond extending these findings to visual document presentation.
- Authority Bias in Conversational Search Engines for Academic Paper Recommendation (EMNLP 2026)
- LLMs Trust Humans More, That's a Problem! Unveiling and Mitigating the Authority Bias in Retrieval-Augmented Generation (ACL 2025)
- .
- Authoritative and Neutral Documents differ in layout, typography, and potentially legibility, making it difficult to isolate the effects of authority cues.
- Reliance on self-reported confidence makes it difficult to distinguish persistent belief changes from temporary response compliance.
- ASR includes successes from earlier textual persuasion rounds, making it difficult to assess the independent contribution of the final visual evidence.
Questions for authors
I would appreciate it if the authors could address the concerns raised in the weaknesses above.
2 comments
Thank you for the detailed rebuttal and clarifications.
While the responses have clarified several points, my main concerns remain regarding the limited methodological novelty and the difficulty of isolating authority effects from other presentation factors.
I will therefore maintain my original rating.
We thank Reviewer M1hp for the comments on positioning and measurement. We answer the three concerns below.
Question-1: Novelty relative to prior authority-bias work. Answer-1: We agree that authority bias and multimodal persuasion are established topics. The paper does not claim to discover authority bias. Prior work varies author and venue metadata in academic recommendation or textual source identity in retrieval-augmented generation. Neither holds substantive evidence and interaction history fixed while comparing rendered document presentations. The contribution is the formulation of evidence-presentation robustness and a paired, branch-isolated test of apparent visual provenance, including the distinction between apparent and verified provenance. The paper therefore presents an operational and empirical advance rather than a new psychological phenomenon. Both cited papers are discussed in Related Work.
Question-2: Layout, typography, and legibility. Answer-2: The paper's claim is at the bundle level, not an atomic authority-cue effect. Neutral and authoritative documents may differ in legibility, typography, and layout; the paper says so in Section 5.3 and the Limitations. The OCR(text) control, cue ablation, and occlusion analysis are the evidence the paper provides. The ablation is non-monotonic and does not support independent additive cue effects. A layout-matched OCR-like comparison would isolate legibility, but that is a different question. The paper's claim is that document-like presentation bundles change judgments, not that one graphical cue causes the entire difference.
Question-3: Measurement validity: confidence, persistence, and ASR. Answer-3: Confidence is an expressed behavioral signal, not a calibrated belief probability. The paper supplements it with Persist@1, S(5), half-life, and Wrong Frac under paraphrased follow-up questions with the history fixed and no new persuasive evidence. This is a direct behavioral test of persistence rather than a second persuasion attempt. The authoritative document has the highest short-term retention and longest half-life. The paper treats this as conditional retention, not proof of an internal belief state, and notes that manipulated subsets can differ across conditions.
ASR is cumulative by construction, and the paper does not use it alone to infer the image-stage contribution. ISR measures final-stage threshold crossing, IPR measures paired confidence decrease after image submission relative to the preceding textual stage, and the controlled ladder uses final confidence under a shared interaction history. The Legal Document case illustrates why ASR alone is insufficient: it has the highest ASR (0.73) but a low IPR (0.31). The paper uses ASR for end-to-end success and ISR/IPR for the image-stage analysis.