- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
InterleaveThinker employs a design consisting of a Planner, a Generator, and a Critic to produce coherent sequences of images and text. The authors propose a comprehensive training pipeline—covering all stages with well-structured data—and incorporate a sound reward mechanism for reinforcement learning (RL). Experimental results across several benchmarks demonstrate the effectiveness of the proposed method.
Critical strengths
-
The paper is well-written and organized.
-
The overall framework is robust, with training data that thoroughly covers the error-correction process.
-
The experimental evaluation is comprehensive, including performance testing on various benchmarks, as well as ablation studies across different models and configurations.
Critical weaknesses
-
The scoring provided by Gemini may be unreliable—particularly in tasks like image editing or maintaining consistency for items such as clothing or products—as it often struggles with fine-grained details and is prone to hallucinations. This raises questions regarding the trustworthiness of the resulting labels and supervisory signals.
-
Furthermore, given that Gemini is tasked with evaluation, generating training data, and providing rewards for RL, how do the authors address the inherent trade-off of having the "referee" also act as a "competitor" (or participant)? Is there any human-based evaluation?
-
Could the evaluation be expanded to include more specialized editing tasks, such as virtual try-on?
Questions for authors
-
Please see the Weaknesses.
-
Is it possible to perform joint fine-tuning that includes the Generator? Currently, the Generator remains static, yet it is likely to produce various errors that could be addressed through such joint optimization.