- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies distributed image compression with decoder-only side information. Using conditional expectation, it decomposes the target-only reconstruction residual into an SI-predictable component and an orthogonal remainder. The proposed CRDIC framework combines SI-assisted deterministic reconstruction with reliability-controlled stochastic residual generation. An odd projection suppresses mean shifts in the stochastic residual, while a control parameter adjusts its amplitude at inference. Experiments on three datasets evaluate the method’s reconstruction fidelity and perceptual quality.
Critical strengths
-
Good reconstruction quality.
Experiments on KITTI Stereo, Cityscapes, and InStereo2K demonstrate good reconstruction fidelity and perceptual quality across multiple bitrates.
-
Detailed supplementary explanations and analyses.
The appendix provides implementation and training details, together with analyses of residual orthogonality, reliability calibration, and stochastic reconstruction behavior. These additions help clarify the implementation and limitations of the method.
Critical weaknesses
-
Limited novelty.
The proposed conditional residual decomposition offers limited novelty. The basic strategy of deterministic reconstruction followed by conditional residual generation already appears in “A Residual Diffusion Model for High Perceptual Quality Codec Augmentation” (Ghouse et al., 2023). The SI reliability estimation and residual-scale control introduced here primarily constitute specific mechanisms within this established framework, limiting the novelty of the overall reconstruction framework.
-
Poor calibration of the remaining uncertainty.
The proposed mechanism relies on accurate SI reliability estimates to determine the remaining residual scale through . Overestimating reliability therefore suppresses the estimated residual scale, particularly affecting stochastic restoration when SI is weak. Fig. 6 shows precisely this pattern: reliability is overestimated under weaker SI conditions, while remaining residual scales are generally underestimated.
The resulting coverage error is substantial. In Fig. 8, even at , approximately 30–35% of the conditional rank mass lies at each boundary, versus approximately 3% per rank under the uniform reference. This indicates pronounced underdispersion at both evaluated operating points. These results directly weaken the interpretation of the predicted scale and restoration parameter as quantitatively calibrated measures of the remaining uncertainty.
Questions for authors
-
Presentation of specific contributions.
Please give greater prominence in the main text and Fig. 1 to the specific contributions in SI reliability estimation and residual-scale control, helping readers distinguish them from existing residual-generation frameworks. The text and image elements in Fig. 1 are also small; enlarging them would improve readability.
-
Calibration of the remaining uncertainty.
Figs. 6 and 8 indicate underestimated residual scales and insufficient variation in the generated samples. To what extent do these discrepancies affect the quantitative characterization of the remaining uncertainty and the practical interpretation of the restoration parameter? How do the existing results support the quantitative correspondence between reliability, remaining variance, and stochastic restoration?
2 comments
Q2. Calibration of the Remaining Uncertainty
Thank you for your detailed comments and questions. We provide additional experiments to quantify the observed discrepancies and clarify their implications for stochastic reconstruction.
1. To what extent do these discrepancies affect the quantitative characterization of the remaining uncertainty and the practical interpretation of the restoration parameter?
Table 1. Remaining-scale estimation on InStereo2K.
| BPP | Predicted bias (%) | Local-target bias (%) |
|---|---|---|
| 0.01020 | -28.52 | -2.70 |
| 0.08062 | -10.26 | +2.89 |
| 0.15134 | -0.84 | +1.42 |
| 0.25281 | +6.27 | +3.70 |
(i) Effect on the quantitative characterization of remaining uncertainty.
The remaining scale exhibits larger estimation bias at extremely low bitrates, with relatively small mean bias at higher bitrates. Table 1 compares the predicted scale RMS with the realized residual RMS on InStereo2K. The mean bias is at 0.01020 bpp and remains within at the two higher bitrates. Replacing the predicted reliability with its local supervision target reduces the absolute mean bias to within across all four bitrates, indicating that reliability estimation contributes substantially to the low-bitrate scale bias.
We further examine whether improved statistical coverage leads to better reconstruction quality. With the trained model fixed, a global stochastic amplitude multiplier is fitted using conditional-rank statistics. As shown in Table 2, the combined boundary-rank frequency approaches the uniform reference of , while PSNR and LPIPS deteriorate at all four bitrates. This shows that improving statistical coverage through amplitude rescaling does not necessarily improve reconstruction quality. The difference is consistent with the MSE and LPIPS objectives used to train the stochastic branch.
Table 2. Effect of statistical calibration on reconstruction quality on InStereo2K.
| BPP | Boundary ranks: Original (%) | Boundary ranks: Rescaled (%) | PSNR (dB) | LPIPS |
|---|---|---|---|---|
| 0.01020 | 59.75 | 13.25 | -4.553 | +0.2203 |
| 0.08062 | 65.50 | 11.25 | -7.081 | +0.2547 |
| 0.15134 | 66.50 | 11.00 | -7.783 | +0.2870 |
| 0.25281 | 62.00 | 6.75 | -7.631 | +0.2810 |
(ii) Effect on the practical interpretation of the restoration parameter. The discrepancies affect the absolute stochastic variation produced at a given , while its practical role as a relative control of restoration strength remains unchanged. In CRDIC, corresponds to deterministic reconstruction, and increasing progressively increases stochastic restoration around the fixed deterministic result. Its numerical value specifies a restoration level within the learned model, allowing the distortion--perception trade-off to be adjusted without changing the transmitted bitstream or retraining the network.
We have included the additional experiments and clarified the practical interpretation of in the revised Appendix A.5. All corresponding revisions are highlighted in blue.
2. How do the existing results support the quantitative correspondence between reliability, remaining variance, and stochastic restoration?
The existing results show that higher SI reliability corresponds to lower remaining residual variance, and that the estimated reliability and residual scale capture this relationship across different SI conditions. Specifically, Fig. 6(a) verifies the approximate orthogonality of the decomposed residual components, while Fig. 6(b) demonstrates a consistent decrease in measured remaining variance as SI reliability increases. Figs. 6(c--e) further show that the predicted reliability and residual scale follow the corresponding measured trends, despite the calibration differences discussed above.
For stochastic restoration, Figs. 5(a,b) demonstrate how varying controls the distortion-perception trade-off at fixed bitrates and SI, while Figs. 5(c,d) show the reconstruction responses under different SI conditions. Together, these results demonstrate the empirical correspondence between SI reliability, remaining residual variance, and the resulting stochastic restoration behavior.
Response to Reviewer ASjX
Thank you very much for taking the time to review. We try our best to address your questions as follows.
W1. Limited novelty relative to DIRAC
Thank you for your comments and suggestions. We have further clarified the novelty and technical contributions of CRDIC as follows.
1. The basic strategy of deterministic reconstruction followed by conditional residual generation already appears in “A Residual Diffusion Model for High Perceptual Quality Codec Augmentation” (Ghouse et al., 2023).
Research problem. DIRAC (Ghouse et al., 2023) addresses perceptual enhancement in single-image compression by generating the residual left by a distortion-optimized base codec. In distributed image comprression (DIC), decoder-only side information (SI) can additionally recover part of the target-only residual. Directly extending residual generation to this setting without distinguishing the contribution of SI may introduce stochastic corrections that overlap with SI-recoverable content, potentially modifying reliably reconstructed details and compromising reconstruction fidelity and semantic consistency. CRDIC addresses this issue by distinguishing the residual predictable from SI from the uncertainty remaining after joint decoding.
Technical distinction. DIRAC combines a distortion-optimized codec with conditional residual diffusion to improve perceptual quality. CRDIC formulates an SI-aware conditional residual decomposition, separating the target-only residual into an SI-predictable component and an orthogonal remainder. The contribution of SI is quantified by reliability ρ2=VS/VT, which determines the remaining residual scale σc=σ01−ρ02. Accordingly, SI-supported information is incorporated into deterministic reconstruction, while stochastic restoration is regulated by the estimated remaining uncertainty. These differences are illustrated in the newly added Fig. 1(f,g) and clarified in the revised Introduction.
2. The SI reliability estimation and residual-scale control introduced here primarily constitute specific mechanisms within this established framework, limiting the novelty of the overall reconstruction framework.
Our contribution lies in the conditional residual decomposition framework for DIC, beyond the individual reliability estimation and residual-scale control modules. By distinguishing the residual recoverable from decoder-only SI from the remaining uncertainty, the proposed formulation provides a unified basis for coordinating deterministic reconstruction and stochastic restoration.
Specifically, the conditional orthogonality yields VT=VS+VT,S, where ρ2=VS/VT characterizes the fraction of target-only residual variance explained by SI. Accordingly, the remaining variance satisfies VT,S=(1−ρ2)VT, establishing a quantitative relationship between SI reliability and the uncertainty remaining after joint decoding. This relationship applies to the conditional reconstruction problem in DIC regardless of the particular codec or generative model employed.
Q1. Presentation of specific contributions
Thank you for your valuable suggestions. Following W1, we have revised the Introduction to clarify our contributions from conventional residual generation, emphasizing SI reliability estimation and residual-scale control. We also added Fig. 1(f,g) to illustrate the technical differences and enlarged the figure elements and labels for readability. All revisions are highlighted in blue.
W2. Poor calibration of the remaining uncertainty.
Thank you for highlighting the calibration discrepancies in Figs. 6 and 8. We acknowledge that the remaining scale is underestimated. The limitations were already discussed in Appendices A.3 and A.4 of the original submission.
In Fig. 6, reliability is evaluated using image-level residual statistics but trained with local error-reduction supervision. Under weak SI, this difference can overestimate ρ0 and consequently underestimate σc=σ01−ρ02, with additional bias from the learned σ0. In Fig. 8, the odd projection maintains residual centering, while the generated samples exhibit insufficient variation. This partly reflects the use of MSE and LPIPS objectives for reconstruction quality without explicit conditional distribution matching. These explanations are further clarified in the revised Appendix A.5.
These calibration discrepancies reflect the gap between statistical analysis and reconstruction-oriented learning, without affecting the core contributions of CRDIC. The conditional residual decomposition still guides the estimation of SI reliability and the control of stochastic restoration, with the effectiveness of these mechanisms demonstrated by the ablation studies and reconstruction comparisons.