- Rating
- 3
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces I-DiT, the first fully integer-only inference framework for diffusion transformers. It proposes three methods tailored for integer-only inference: dynafit for dynamic scale adaptation, a log2-domain integer online softmax for memory-efficient tiled attention, and a factored dyadic requantization for fine-grained activation quantization. Experiments across PixArt, SD3, and FLUX demonstrate strong performance, largely preserving FP16 generation quality under W8A8 settings.
Critical strengths
1.This paper presents the first integer-only inference framework for DiTs and achieves remarkable state-of-the-art performance. 2.The proposed method is technically solid and successfully addresses several critical challenges in building a fully integer-only inference framework. I think the framework is important so I would give a relative positive assessment.
Critical weaknesses
None
Questions for authors
1.The evaluation uses a single sampler configuration for each model, but Dynafit's calibrated scales are tied to a specific denoising trajectory. It remains unclear whether these scales generalize across different samplers (e.g., DDIM vs. DPM-Solver), which may lead to different activation dynamics. Could the authors provide results under at least two distinct sampling configurations? 2. Could authors discuss further on the potential implication of integer-only framework and illustrate why integer-only is important
2 comments
Interesting work, thanks
Response to reviewer SPnG
1. Do the calibrated scales generalize across different samplers?
→ Thank you for an interesting experiment idea. We added cross-sampler experiments using PixArt-α and PixArt-Σ. Whilst keeping the same calibrated base scales from the original sampler, we only swap the sampler to a different one during inference. All other settings are kept identical. We report FID scores of 5k prompts sampled from MJHQ dataset.
Table E. FID comparison across different samplers.
The results show that the calibrated scales generalize well to different samplers. Since our method dynafit adjusts the quantization range during inference, it provides flexibility to accommodate activation changes induced by different samplers. We also added a new experiment section in the revised manuscript to highlight this experiment. Thank you again for a great suggestion.
[1] J. Song, C. Meng, and S. Ermon, “Denoising diffusion implicit models,” in Proceedings of the International Conference on Learning Representations (ICLR), 2021.
[2] W. Zhao, L. Bai, Y. Rao, J. Zhou, and J. Lu, “UniPC: A unified predictor-corrector framework for fast sampling of diffusion models,” in Advances in Neural Information Processing Systems (NeurIPS), 2023.
2. Potential implication of integer-only framework and its importance.
→ Its potential implication is to broaden the hardware platforms on which diffusion backbones can run while preserving generation quality. Concrete deployments already demonstrate demand for efficient local generation. For example, Qualcomm deployed INT8-quantized Stable Diffusion 1.5 on a smartphone powered by Snapdragon 8 Gen 2, generating a 512×512 image in under 15 seconds without requiring an Internet connection [1]. Arm demonstrated diffusion transformer generating 128×128 face images on an Alif Ensemble E8 development board, with neural-network execution accelerated by the Ethos-U85 NPU and sampling controlled by a Cortex-M55 CPU [2].
Supporting these applications on a wider range of edge devices requires exploiting the integer computation capabilities of their accelerators, as many achieve their efficiency through dedicated integer arithmetic. For example, Google’s Edge TPU delivers 4 TOPS of fixed-point integer computation at approximately 2 W [3], while Arm’s Ethos-U85 provides up to 2048 INT8 multiply–accumulate operations per cycle, corresponding to approximately 4 TOPS of integer arithmetic at 1 GHz [4]. To execute a complete backbone on such integer accelerators, nonlinear operations and requantization must also use supported integer arithmetic, as remaining floating-point operations must be converted or executed on a separate processor. I-DiT addresses these arithmetic gaps for diffusion transformers, providing a foundation for deployment subject to each platform’s operator support and memory capacity.
[1] Z. Asghar and J. Hou, "World’s first on-device demonstration of Stable Diffusion on an Android phone," Qualcomm OnQ Blog, Feb. 23, 2023. Accessed: Nov. 11, 2026. [Online]. Available: https://www.qualcomm.com/news/onq/2023/02/worlds-first-on-device-demonstration-of-stable-diffusion-on-android
[2] A. Naik, "Generative AI comes to embedded: Powered by Arm Ethos-U NPU," Arm Community, Nov. 3, 2026. Accessed: Nov. 11, 2026. [Online]. Available: https://developer.arm.com/community/arm-community-blogs/b/ai-blog/posts/generative-ai-comes-to-embedded-powered-by-arm-ethos-u-npu
[3] Google Coral, "USB Accelerator datasheet," datasheet. Accessed: Nov. 11, 2026. [Online]. Available: https://dlcdnwebimgs.asus.com/files/media/6dd0bb60-207c-4ddf-bb34-934447605ce9/coral-usb-accelerator-datasheet.pdf
[4] Arm, "Arm Ethos-U85 product brief," product brief. Accessed: Nov. 11, 2026. [Online]. Available: https://armkeil.blob.core.windows.net/developer/Files/pdf/datasheets/arm-ethos-u85-product-brief.pdf