- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper discusses how Vision-Language Models (VLMs) operate under input shifts, i.e., changing properties of the input image without altering its target 'class'. They construct a toy dataset in which a VLM classifies differently colored shapes. At test time, they vary the saturation and blur of the input image and test whether the VLM predictions remain the same. To understand the source of change in predictions, they look at the VLM's image encoder representations and text decoder predictions.
Critical strengths
None
Critical weaknesses
-
The scope of the study is very narrow. The authors aim to test the performance of VLMs under input shifts using a toy dataset of colored shapes, varying saturation and blur levels. This toy setting is far from any practical application. By using only single shapes, the analysis does not consider cases where confounders can play a crucial role. For instance, the presence of multiple objects requires the model to localize predictions and isolate the contributions of each object. Additionally, by only considering two very simple input shifts (color, blur), it is difficult to draw any meaningful conclusions about the models in question.
-
My main issue with the paper is that there are no clear takeaways from the study:
-
When the input shift is big, the image representation differs significantly from the original, but it can be recovered with a simple mean correction. This does not answer anything about the image encoder, let alone give us any insight into how the VLM operates. Additionally, some VLMs (LLaVA) seem to be less affected by specific shifts, which means that the image representation is somehow different, but the authors do not elaborate further on that finding.
-
The text decoder predictions change but do not completely fail under these shifts, and the larger the shift, the worse the prediction gets. This is an expected result but again does not provide any insight into why this is happening and why there are discrepancies across the different VLMs.
-
In their last experiment, the authors directly replace some of the activations of a non-shifted image with the activations of its shifted counterpart. This is not really connected to the other two evaluations, and it is unclear what its goal is. The results they show (Section 4.3) are hard to interpret, as they do not establish exactly what question they are trying to answer.
Overall, the results come across as a collection of experiments with no coherent story to convey. Having read Section 4 multiple times, I still struggle to understand what the takeaway message is supposed to be.
-
-
The writing of the paper makes it impossible to follow. The authors keep introducing terms, such as scaffold group and recipient stress, which have not been properly defined in the paper. Some of these terms may be common in VLM works, but for a general reader, it requires a lot of back-and-forth to try and connect the various concepts. Single-line conclusion paragraphs such as "Thus, these settings show both consistent signed modulation and larger absolute modulation along the natural direction than along the matched controls." (line 428) should be self-explanatory since they are trying to convey a straightforward conclusion/result to the reader. In their current state, they are riddled with ambiguous terms and confuse the reader even more.
Questions for authors
-
How did you choose saturation and blur as the two shifts under which you evaluate the VLMs? There are many other image-level augmentations to apply that do not modify the target properties (e.g., crops, rotations, translations, pixelization) and could serve as additional experiments.
-
Why did you choose to use the same reader (linear layer or MLP) across all models, and does that play a role in the results of Table 1? Each of the models tested probably utilizes a different latent dimension for its encoding blocks, and these discrepancies could affect the prediction accuracy for the Fixed condition. If Qwen is using a much bigger latent dimension, then the MLP could more easily overfit to the relatively small training set, explaining the drop in performance when using the fixed condition.
-
Did you try not pooling the visual tokens and instead using the CLS when it is available? Does that improve the performance under shifts, considering that the CLS is probably trained to ignore some of those shifts (through self-supervised training)?