- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes ResGVC, a residual coding framework for GVC that guides denoising toward original pictures by transmitting residual signals. ResGVC first encodes the source pictures within a learned video codec and then decomposes the distortion between the codec reconstruction and the source pictures into a sequence of residual segments, where each residual segment is acquired at each denoising step. Residual segments are then compressed using a novel residual codec with a diffusion transformer as entropy model. Experimental results show that, compared with the previous state-of-the-art method, ResGVC achieves 63.7% and 83.8% BD-rate reductions in terms of LPIPS and PSNR, respectively, while also delivering superior visual quality.
Critical strengths
-
The proposed method that is inspired from the diffusion process to progressively encode the residual between the raw and compressed frames is novel;
-
The experiments show promising results and ablation studies are informative.
Critical weaknesses
-
The proposed method uses DCVC-UF as its base codec, however, it is not compared with in the experiments.
-
In Table 1 and Figure 5, the FloLPIPS performance of the proposed method is always lower than LPIPS performance, especially, the FloLPIPS is worse than YODA on MCL-JCV given better LPIPS. This raises a concern that whether the temporal consistency of the proposed method is not satisfying.
-
Using DCVC-UF as its base codec should be clearly claimed in the main text, instead of only in the Appendix.
Questions for authors
Please see Weaknesses.
3 comments
Thank the authors for the response and additional results. I would keep my weak acceptance recommendation.
Response to Reviewer pDJL
Thank you for your reply! We appreciate your suggestions and feedback all along.
Response to Reviewer pDJL
Thank you very much for your careful review of our paper and insightful comments. We hope the following responses can alleviate your concerns.
W1: Additional baseline
According to your advice, we have included DCVC-UF as an additional baseline. As shown in Table R3.1, for perceptual metrics, ResGVC demonstrates substantial improvements over DCVC-UF. For PSNR and MS-SSIM, although ResGVC performs worse than DCVC-UF, the gap remains relatively small, and it still outperforms the GVC method S2VC which achieves the best fidelity- oriented performance among all GVC baselines.
Table R3.1. BD-rate (%) ↓ / BD-metric ↑ averaged on UVG, HEVC B, and MCL-JCV. “N/A” arises from insufficient overlap between rate-metric curves.
W2: Temporal consistency
We acknowledge that the temporal consistency of ResGVC has room for improvement indeed. However, in most cases on test datasets, the FloLPIPS of ResGVC is still competitive with or better than that of YODA. In the supplementary material, we also upload an MP4 video for the reviewer to compare the temporal consistency between ResGVC and YODA.
Regarding the relatively weaker FloLPIPS performance of ResGVC in some cases, we believe one possible reason is that ResGVC learns to maintain temporal consistency in a GOP-by-GOP manner, which is more challenging than the frame-by-frame processing adopted by YODA. We will improve this point in our future work.
W3: Clarifying the base codec
We have clearly claimed in Section 3.2 of our revised manuscript that DCVC-UF is used as our base codec.