- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes OmniTTT, which combines global visual TTT, local visual attention, and language attention to continually train pretrained multimodal generative models. It maintains generation quality close to full-attention baselines on text-to-image and text-to-video tasks while substantially reducing computational costs, and also demonstrates acceleration in reference-to-video generation.
Critical strengths
By combining global visual TTT, local attention, and language attention, the authors apply the approach to image, video, and reference-conditioned generation models. This provides a valuable practical exploration of reusing pretrained weights to reduce generation costs.
Critical weaknesses
- The claim regarding “unified generation models” is not adequately supported, as the three task categories are evaluated using three different backbones. Describing OmniTTT as “a general-purpose acceleration architecture for multimodal generative backbones” would be more appropriate.
- The experimental evaluation is insufficient. The comparisons cover relatively few methods, only one backbone is evaluated for each task category, and benchmark coverage is limited. In particular, the reference-to-video generation tasks lack quantitative quality evaluation. The paper appears insufficiently developed, and its core contributions are not clearly articulated.
Questions for authors
- The boldfacing of the “All” score in Table 1 appears incorrect: the +SFT baseline achieves a higher score.
- Please clarify the claim regarding “unified generation models,” given that the three task categories are evaluated using separate backbones. Would “a general-purpose acceleration architecture for multimodal generative backbones” more accurately describe the contribution?
- Please include additional comparison methods, evaluate more backbones for each task, broaden benchmark coverage, and provide quantitative quality evaluation for the reference-to-video generation tasks.