- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes PACED for dynamic-length decompression in compressed-latent diffusion language models. PACED makes the decompressor prefix-consistent by masking attention between output positions, predicts an initial output length from the denoised latent, and uses cached extension when the prediction is too short. The paper proves that recovery reproduces the full-length output of the same prefix-consistent decompressor and evaluates the method on ROCStories, CNN/DailyMail, and ELI5.
Critical strengths
-
The prefix-consistency and recovery construction is clean. The exact-recovery argument is simple but useful, and the paper validates it carefully, including numerical-precision tests.
-
The experimental protocol is more careful than usual for this type of systems work. In particular, the paper reports actual decompression timing, calibration behavior, multiple fine-tuning seeds, and the quality/efficiency trade-off introduced by the new attention mask.
Critical weaknesses
-
The practical end-to-end benefit is not established in a regime with good generation quality. With the default 200-step sampler, decompression is only about 0.6% of total generation time. The reported 1.2--1.8x speedups are for decompression alone. The paper argues that PACED becomes more useful with few-step samplers, but its few-step experiment is obtained by simply reducing the number of steps of the existing model, which severely degrades generation quality. Thus the main regime where PACED would materially affect end-to-end latency remains hypothetical.
-
Exact recovery is only with respect to the modified prefix-consistent decompressor, not the original full-attention Cosmos decompressor. Obtaining the prefix property requires changing and fine-tuning a large decompressor, and generation quality remains worse than the pretrained model, especially on CNN/DailyMail and ELI5. Therefore the efficiency gain is not output-preserving with respect to the original model. This trade-off weakens the practical significance of the result.
Questions for authors
-
Can the authors report end-to-end batched generation latency, including diffusion, and demonstrate a meaningful speedup in a setting where generation quality remains comparable to the 200-step model? A result with a quality-preserving few-step sampler would materially change my assessment.
-
Can the authors demonstrate a setting where the prefix-consistent decompressor matches the original full-attention decompressor more closely in generation quality while retaining meaningful length savings? In particular, results on a larger maximum length or a conditional generation task would help establish that the trade-off remains useful outside the current L=128 unconditional setting.
We thank the reviewers for their careful reading and feedback. We agree that, with the 200-step sampler, decompression is a small share of the generation cost, and that the gap in quality to the pretrained decompressor remains open while promisingly achievable.
Our main aim, however, was not simply to accelerate decompression, but to make diffusion-based text generation capable of generating variable-length output natively while remaining parallel. Because compressed-latent models fully denoise the content before decoding it, the output length does not need to be fixed in advance. PACED makes the decoded text independent of the number of positions evaluated, so it can be decoded in parallel blocks, streamed, and extended without being rewritten. On the efficiency side, the work is also intended to be forward-looking: as samplers require fewer steps and latents become more compressed, decompression accounts for a larger share of the generation cost, and evaluating only the positions an output requires may become increasingly valuable. We see this as a step toward diffusion models that generate long outputs both in parallel and with lengths determined at generation time, and we will take the reviewers’ suggestions into account in future work on this direction.