- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents CanvasFlash, which uses a semantic image tokenizer that naturally produces many Canvas Tokens. The paper exploits this structure through sparse AR training and a simple Canvas-token draft strategy for faster decoding, while using a diffusion decoder for final rendering. CanvasFlash highlights the redundancy carried by reconstruction-oriented visual representations.
Critical strengths
-
The core efficiency idea is simple and technically appealing. Canvas Sparsity gives a natural signal for removing redundant tokens during training and reusing the Canvas Token for speculative decoding without an extra draft model. This idea is interesting, but also makes the lack of convincing end-to-end efficiency measurements more consequential.
-
The method achieves strong generation quality despite aggressive token reduction. The paper reports competitive benchmark results while retaining only a fraction of the original training tokens, suggesting that the representation preserves useful semantic information.
Critical weaknesses
-
The main efficiency claim is not validated end-to-end. The reported 3.09× decoding speedup excludes diffusion rendering, while training efficiency is mainly expressed through retained token count rather than wall-clock time, throughput, or compute. Since efficiency is the central contribution, this missing system-level evidence is a critical weakness.
-
The contribution of Canvas Sparsity to final quality is not well isolated. DPG-Bench improves from 83.95 after SFT to 89.69 after GRPO, so a large part of the final performance gain comes from reinforcement learning rather than the proposed sparse representation itself. This makes it difficult to judge whether the proposed mechanism alone offers a strong enough quality–efficiency trade-off.
Questions for authors
-
Could the authors report end-to-end latency, including the diffusion decoder, and actual training throughput or GPU-hours with and without Canvas-Sparse Training?
-
Please provide the main efficiency-quality comparison before GRPO, so that the contribution of Canvas Sparsity can be evaluated independently.
Dear Reviewers,
The authors have posted their rebuttal. Please read it carefully, assess whether they address your concerns, and leave a follow-up comment for the authors.
Thank you for your time and constructive feedback.
AC