- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses the token explosion in generic multi-reference DiT models, where reference tokens dominate the joint sequence. The authors run a cheap probing pass of the generator itself on 2× downsampled inputs with a sparse timestep schedule, and score each reference token by the attention it receives from generative and prompt tokens. Before the main denoising, high-score 2×2 blocks are kept at full resolution, mid-score blocks are replaced by a single low-resolution token, and the rest are discarded. The method is training-free and needs no external model. Experiments on three base models and two benchmarks show better quality–speed trade-offs than ToMeSD and VisPruner, lower peak activation memory, and compatibility with in-model acceleration methods.
Critical strengths
-
Well-motivated problem and a clean design. Reducing reference tokens before the main denoising, rather than inside the DiT, is an underexplored but practically important direction for multi-reference generation. It is also what makes the peak-VRAM reduction and the composability with in-model methods (Table 2) possible. Using the generator itself as a low-resolution probe avoids an external saliency model. The keep, substitute, discard tiers are simple but clearly motivated, and Table 3 shows the intermediate tier matters.
-
Solid efficiency gains without quality loss. On FLUX.2-Klein, the fast setting gives roughly 2.3–2.5× end-to-end speedup and about halves activation VRAM while matching baseline quality. The slow setting improves average quality on both benchmarks (4.70→4.88 on MultiBanana, 6.18→6.27 on MACRO). The trend holds across three base models of different architectures, including the pixel-space HiDream-O1. This is what most supports my positive assessment.
Critical weaknesses
The paper's central claim is that early reduction is preferable to in-model reduction, yet the most relevant in-model method, ToPi (Lin et al., 2026), which prunes reference tokens inside the DiT for in-context generation, is only discussed in related work. The compared methods, ToMeSD and VisPruner, both reduce tokens before the model, and TransPrune in Table 2 is also a VLM method. Without comparing to ToPi at matched speedup, including peak VRAM, this central claim remains untested.
Questions for authors
Please address the concern raised under Critical Weaknesses.
3 comments
Thank you for the detailed response and the additional experiments. The new comparison with ToPi, together with the compatibility results, addresses my concern. After considering the rebuttal, I maintain my original rating.
We sincerely thank the reviewer for the follow-up and are glad that our additional experiments have addressed your concern. We appreciate your time and consideration.
We sincerely thank the reviewer for the careful reading and the valuable suggestion. We have revised the manuscript accordingly (the blue text in the PDF) and respond below.
We implement and evaluate the in-model token reduction method ToPi [1] on FLUX.2-Klein-4B under the same MultiBanana evaluation protocol:
Table: Comparison with ToPi.
Ours achieves better quality, faster inference, and lower peak activation VRAM than ToPi under both Fast and Slow settings, showing the advantage of our early reduction over the in-model reduction. The full per-dimension quality metrics are provided in Appendix C.2 (Table 11).
Compatibility with ToPi: Early token reduction and in-model token reduction do not compete with each other, as they act at different stages. Our method reduces the reference sequence before the main denoising stage, while ToPi can further progressively prune reference tokens inside the DiT. This allows the combination to remove additional reference-token redundancy after our early reduction.
Table: Compatibility between Ours and ToPi.
Combining Ours with ToPi further improves speedup while maintaining comparable generation quality. The full per-dimension quality metrics are provided in Appendix C.2 (Table 12).
[1] Lin et al., Token Pruning for In-Context Generation in Diffusion Transformers, arXiv:2602.01609, 2026.