- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper presents EAR, an autoregressive text-to-image generation framework that enables parallel prediction of grouped visual tokens. The method introduces a game-theoretic formulation based on Shapley values and mutual information to model dependencies among visual token groups and guide their generation order. A neural network is employed to predict the generation schedule, while a Mixed Visual Autoregressive Transformer (MVAT) uses positional query tokens to generate multiple visual tokens in parallel. The framework also incorporates global and local textual representations extracted from a pretrained CLIP encoder. Experiments are conducted on COCO and MJHQ to evaluate generation quality and inference efficiency, including comparisons with existing generative models and ablations on different generation ordering strategies.
Critical strengths
The paper addresses a well-motivated problem in autoregressive image generation: sequential decoding limits inference efficiency, while naive parallel prediction may disrupt spatial dependencies among visual tokens. Exploring dependency-aware generation ordering to balance parallelism and generation quality is a meaningful research direction.
Critical weaknesses
1.The ordering objective in Eq. (6) appears to be permutation-invariant for a fixed grouping, since both mutual information and the spatial distance weights in Eq. (5) are symmetric. It is therefore unclear how this loss can guide the claimed generation order, and the reported experiments do not establish that the learned ordering is actually induced by the proposed theoretical objective.
- Eq. (5) directly expresses the Shapley value using weighted mutual information, but the paper does not establish a mathematical relationship between these two quantities. A rigorous derivation or justification is needed to support the proposed game-theoretic formulation.
3.Table 1 significantly exceeds the right page margin, which is a conspicuous formatting issue in one of the paper's central experimental results. Such an obvious issue raises concerns about the overall care taken in preparing the manuscript.
Questions for authors
-
Given the symmetry of mutual information and spatial distance weights, Eq. (6) appears to be permutation-invariant for a fixed grouping. Could the authors clarify how this objective provides a learning signal for the generation order and demonstrate that the learned ordering is driven by this loss?
-
Could the authors provide a mathematical derivation or theoretical justification for expressing the Shapley value as weighted mutual information in Eq. (5)?