- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper reduces the cost of image and video generation by allocating tokens according to the detail needed in different regions. It uses rectangular tokens of different sizes and an asymmetric flow parameterization to predict a full-resolution latent field from a shorter token sequence. The method is adapted to pretrained FLUX.2 and Wan2.1 models through fine-tuning. The experiments compare generation speed and quality at different token budgets and demonstrate layouts derived from bounding boxes, segmentation masks, and depth. The largest reported speedups are 2.04× for images and 3.53× for videos, excluding the cost of obtaining the layouts.
Critical strengths
-
The method in Section 4 provides a practical way to support heterogeneous token layouts in pretrained models. It addresses patch embedding, full-resolution prediction, and initialization together while retaining the existing VAE. Being able to adjust the local token budget without training a new generative model from scratch makes the approach useful.
-
Tables 1–2 show encouraging results on both image and video generation. At the evaluated budgets, LoT generally offers a better quality–speed tradeoff than the compared compression methods. These results, together with the layout-controlled examples in Figures 4–6, are the main reason I lean toward acceptance.
Critical weaknesses
-
The main quantitative results and the demonstrations of flexible layout control use models trained under different settings. The experimental setup in Section 5 describes mixed-source training for layout-controlled generation, whereas Section 5.2 uses models trained exclusively on texture-variance layouts for Tables 1–2. The strongest quantitative evidence therefore comes from a specialized setting. The examples with other layout sources show that the method can handle them, but leave open whether the mixed-source model retains the reported quality–speed advantages. This limits the evidence for the breadth of the method.
-
The ablation does not fully explain the benefit of asymmetric flow prediction in this setting. The Direct HR prediction variant in Table 3 performs substantially worse, but its target includes high-dimensional noise that may be difficult to predict from compressed inputs. A comparison with direct clean-latent prediction would help distinguish the benefit of the asymmetric parameterization from the more general benefit of avoiding full-dimensional noise prediction. This matters for understanding what the flow formulation contributes in the proposed multi-resolution setting.
Questions for authors
-
In Appendix A.9, the layout-translation experiment shows that subject placement can follow the fine-token region. Beyond placement and coverage, how are subject detail and prompt adherence affected? In particular, are the objects and attributes required by the prompt preserved when the layout changes? Relatedly, for the FID improvements over the full-resolution model in Table 1, is there a control that receives the same layout information, or other evidence that separates the effects of layout conditioning from those of token allocation?
-
For the direct full-resolution velocity variant in Table 3, are data scaling and effective loss weighting matched to the full model, and how is the output head initialized? More importantly, how would direct clean-latent prediction perform with the same compressed input and full-resolution output architecture? If this comparison is unavailable, can the existing results or analysis explain what the asymmetric parameterization gains over that alternative?
-
The experimental setup in Section 5 describes mixed-source training for layout-controlled generation, while Section 5.2 and Tables 1–2 use models trained exclusively on texture-variance layouts. How does the mixed-source model perform quantitatively across the supported layout sources? Are the reported quality–speed advantages retained by the model used for flexible layout control?
-
Eq. (7) describes a fixed projection to dimensions, whereas Eq. (12) uses an input head that is fully fine-tuned. Is the fixed projection preserved throughout training, or is it only used to initialize an otherwise unconstrained input head? This affects how I understand the information retained by each token.
-
The Foveated Diffusion baseline has already been extended to larger patch sizes. What additional technical difficulties arise when applying AsymFlow to such a model, and which LoT-specific changes address them? I would appreciate an explanation tied to the existing results, rather than necessarily another complete baseline implementation.
Dear Reviewer eJ4p, as the discussion period is ending soon, we would like to kindly follow up on our responses above. To address your concerns, we included the following set of experiments:
We would appreciate hearing whether these responses resolve your concerns, and we are happy to clarify further in the time remaining. If they do, we would be grateful if you would consider updating your score. Thank you again for your time and feedback.