- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies how suppressing image frequency bands changes VLM answers. It evaluates eight band-stop interventions across four VQA datasets and five configurations from two model families, using semantic labels to track answer preservation, degradation, and correction.
Critical strengths
The paired design controls the model and question across interventions. Tracking answer transitions provides more information than aggregate accuracy, particularly when degradation and correction coexist. Human annotation checks and statistical comparisons strengthen the behavioral analysis.
Critical weaknesses
The main limitation is the gap between observing answer changes and explaining visual understanding. The paper does not distinguish destroyed visual evidence from failures in visual encoding, question-conditioned information selection, or reliance on language priors. Its discussion offers little explanation of the observed patterns or guidance for visual–language interaction.
VQA is inherently question-dependent: different questions about the same image require different regions and details. Dataset-level frequency comparisons do not isolate this dependence and may instead reflect differences in text size, object scale, or image statistics.
The eight-band partition is justified by spectral approximation error, which does not establish its suitability for semantic analysis. Sensitivity to band boundaries, removed energy, and image scale remains unclear. Likewise, improved answers after filtering could reflect successful guessing rather than improved grounding.
Finally, two model families at 2B–14B provide limited support for generalization across VLM architectures, particularly those without a separate vision encoder.
Questions for authors
What mechanistic hypothesis explains the observed patterns, and how could it be tested?
Does frequency sensitivity change with different questions about the same image, particularly when filtering relevant versus irrelevant regions?
Are filtered images still answerable, and how are visual evidence loss and language shortcuts distinguished?
Do the conclusions hold under different frequency partitions, low-/high-pass filtering, resolutions, and model architectures?