- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Uni-HPCM, which extends HPCM by sharing conditional latent distributions between entropy coding and sampling. Its hybrid training combines a rate–distortion objective for fully coded reconstructions with perceptual supervision for partially sampled reconstructions. The framework supports reconstructive and generative compression by varying the proportion of coded and sampled latents, and enables class-conditional generation using hyper-latents extracted from DiT-generated images. Experiments demonstrate substantial improvements over direct sampling from HPCM while retaining competitive compression performance.
Critical strengths
1.The framework extends a single codec to support reconstructive and generative compression through flexible coding–sampling combinations, without increasing the parameter count or computation of fully coded compression. This offers a practical way to add generative capabilities to an existing compression model.
2.HCST substantially improves sampling over both direct HPCM sampling and matched-budget RD-only fine-tuning (Table 2). These results support the effectiveness of adapting the context model and decoder to trajectories containing sampled latents.
Critical weaknesses
1.The value of the complete class-conditional generation pipeline remains insufficiently established. CCLS first uses DiT to generate a complete image and then extracts its hyper-latent for resampling. Although this dependency is disclosed and Table 9 shows improvements over the chosen teacher configuration, Table 1 reports codec-only costs. Comparisons at matched end-to-end computation are needed to establish the benefit of this additional generation stage.
2.The evidence for compression–generation synergy is limited. Table 4 shows modestly worse overall rate–distortion performance than HPCM-Base, while improvements from increasing model capacity do not isolate the benefit of joint training. Moreover, Table 2 fixes and without reporting actual bitrates. Since HCST also updates the hyperprior, the sampling gains may partly reflect richer conditioning information, leaving the contribution of improved shared distribution modeling unclear.
Questions for authors
1.What are the end-to-end latency and computation of CCLS, including DiT and hyper-latent extraction? Does its improvement over teacher-only generation persist at matched total computation and across reasonable teacher guidance settings?
2.What are the hyper-latent and coded main-latent bitrates for the variants in Table 2? Do the quality improvements remain at matched actual bitrate, particularly when all main-latent subsets are sampled?