- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies models that can both generate and understand images, and asks whether such a model is a reliable checker of generated images. The question is whether the model reports what it actually sees or is swayed by what was requested and by who it is told made the image. The paper tests this with the Bagel model on hand images generated by Janus-Pro, asking it to count fingers under four prompt versions: without the requested count, with the requested count, with the requested count plus a note that the image was made by “another model,” or by “you”. They find that showing the requested count roughly halves counting accuracy, while the note about who made the image has little effect. They also show that turning off selected attention heads recovers part of the lost accuracy.
Critical strengths
Clear experiment design:
The paper changes only one thing at a time in the prompt: whether the target count is shown, and who is said to have made the image. The image and the question stay the same, so each effect is easy to read. The main finding is clear: when the model sees the requested count, its accuracy drops from 77.5% to 37.5%.
Several ways of measuring:
The paper does not rely on a single number. It compares scores, final answers, and image selection, showing that these can disagree. For example, the condition with the best ranking score has the worst accuracy.
Honest intervention results:
Turning off selected attention heads raises accuracy by 27.5 points and works better than turning off random heads. The paper also openly reports that the fix is incomplete and has a small cost on normal counting.
Critical weaknesses
The title and abstract of the PDF version of the paper do not match those on OpenReview.
Too narrow for the general claim.
The study uses only one model, one image generator, one task (counting fingers), and 120 test images. It is unclear whether the results hold for other models, tasks, or objects. Also, the model never checks its own images, so the “generated by you” condition is only a change in wording, and the setting that motivates the paper is never tested.
Little new beyond prior work:
The large effect, in which the model follows the prompt rather than the image, is already known from Rudman et al., and the head-removal method follows that work. The paper’s new question, whether saying who made the image matters, gives almost no effect: both conditions reach exactly the same accuracy (35.83%). Simply hiding the target from the model performs better than the proposed fix (77.5% vs. 65.0%), and no simple prompt-based fix is included for comparison. In addition, Rudman et al. is cited as an arXiv preprint, although it was published at ACL. Since it is the closest prior work, it should be cited correctly.
Weak evidence for image selection, and hard to read:
Only 8 of 24 image groups contain a correct image, so the selection results tell us very little, yet they are listed as a main contribution. The heads are pre-selected using a simple activation measure; no correction for multiple comparisons is applied, and the image labels come from a single annotation column. The text also contains many caveats, making the main message hard to find.
Questions for authors
Do the results hold for images that Bagel itself generated?
How sensitive are the attribution effects to other wordings of the source statement?
Does turning off the heads make the model reject correctly generated images more often?
How does the head removal compare with a simple instruction to count independently of the request?
How were the labels produced, and how well do annotators agree?