- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
LightMGT is a masked generative transformer for text-to-image generation and editing with a 148M backbone (MM-JiT double-stream blocks, two 512-way heads over 18-bit Open-MAGVIT2 codes, frozen Qwen3-0.6B text encoder).
The paper claims three contributions: the compact pre-train model LightMGT; MGT-OPD, which composes a T2I and an editing specialist through a token-level reverse KL loss; and APM, a one-step distillation built on Di[M]O. Validation: GenEval 0.70 and GEditBench-EN 6.49 (Turbo: 0.58 / 6.21), throughput against FLUX.1-dev, SD3-Medium and Meissonic, and FID 6.80 vs. 6.91 for Di[M]O on MaskGIT ImageNet-256.
Critical strengths
- A useful recipe and baseline. A single 148M-backbone model covers both generation and editing (GenEval 0.70, GEditBench-EN 6.49), with documented open data (Tables 9–10). This is the main contribution of this paper for the community.
- Solid Experimental reselts. With a 148M backbone, one model reaches GenEval 0.70 and the best GEditBench-EN average in Table 2 (6.49), above OmniGen2 (4B, 6.31) and FLUX.1 Kontext-dev (12B, 6.26). MGT-OPD keeps most of both specialists (0.70 vs. 0.73; 6.49 vs. 6.64) and beats joint training (0.63 / 6.06).
Critical weaknesses
-
The novelty of this paper is limited. For the three main contributions listed in the paper, they are all based on existing recipes with very incremental modification. For example, APM's Eq. (5) is the generalized Jeffrey divergence of Di[M]O (arXiv 2503.15457, Eq. 8) with the explicit logit gradients of its Eqs. (16)-(17); Eq. (6) is the surrogate whose gradient is Di[M]O's Eq. (7). And the experimental comparison of APM and Di[M]O on MaskGIT also shows that these two are similar in terms of performance.
-
The paper is motivated by MGTs offering limited efficiency advantages over diffusion models (l. 053–054). SANA-Sprint (arXiv 2503.09641) reports SANA-0.6B at 0.9 s (GenEval 0.64) and one-step SANA-Sprint-0.6B at 0.21 s (GenEval 0.72) on an A100, whereas LightMGT needs 1.42 s (0.70) and Turbo 0.235 s (0.58).
-
"FLUX.1-dev-level performance" also rests mainly on GenEval Position (0.62 vs. 0.20), while DPG-Bench is lower (78.32 vs. 82.56). This matters because efficiency is the paper's main motivation.
Questions for authors
- what is the motivation for introducing eq(2) for KL loss calculation?
- What is Monetico mentioned in this paper, not clear without citing the corresponding paper.
- It's not clear why the authors construct two masked versions in APM. There is no ablation against equal-cost alternatives.
3 comments
Follow-Up to Your Review (Second Reminder)
Dear Reviewer A2pj,
Thank you again for the time and care you put into reviewing our work!
We know this is a busy period, so we wanted to follow up briefly on our point-by-point responses and the revised manuscript, where we highlighted the changes for easy reference.
If you have a chance to look over our responses, we would appreciate hearing whether they address your main concerns. If anything remains unclear, we would be happy to clarify it here.
Thanks again for your support!
Sincerely yours,
The Authors of Submission 11907
Follow-Up to Your Review (Third Reminder)
Dear Reviewer A2pj,
We are following up on our point-by-point responses and the revised manuscript, which we posted several days ago. We believe these materials further address your concerns and highlight the changes we made in response to your feedback.
As the end of the Author-Reviewer Discussion phase is fast approaching, please let us know whether our responses address your main concerns or if any points still need clarification. We are available to discuss them here.
Thank you again for your time and effort devoted in this review!
Best,
The Authors of Submission 11907
Follow-Up to Your Review
Dear Reviewer
A2pj,Thank you again for the time and effort you put into reviewing our work!
We understand that this might be a super busy period for you. We wanted to briefly let you know that we have posted point-by-point responses to your questions and concerns and uploaded a revised manuscript with the changes highlighted.
Whenever you have a chance, we would be grateful for your feedback on whether the responses address your concerns. We would be happy to clarify anything that remains open.
Thank you!
Best,
The Authors of Submission
11907