- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates whether independently trained image generation models can use each other's generated digits to perform arithmetic operations. The authors evaluate modulo-23 addition, binary addition, and multi-step multiplication.
Critical strengths
The research question is potentially interesting.
Critical weaknesses
- Very limited novelty and significance. The paper essentially demonstrates that models can recognize generated digits and perform simple arithmetic operations. It is unclear what fundamentally new capability or insight this provides.
- Extremely simplistic experimental setting. The experiments rely on fixed layouts, predefined digit positions, and a tiny arithmetic vocabulary. Even the largest cross-model multiplication experiment only evaluates 20 pairs of 8-bit operands. The results provide little evidence of meaningful generalization.
Questions for authors
See weakness.