- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The authors introduce theory for a compact representation of divergence-free vector fields. Prior divergence-free networks require computing increasingly large Jacobian matrices, scaling with dimensionality. This paper therefore proposes a compact representation that avoids computing these large Jacobians and designs a network architecture around this that guarantees zero-divergence. Experiments demonstrate the approach for self-supervised image denoising under Gaussian, Poisson, and real-world noise.
Critical strengths
- Proofs in Theorems 1 and 2 give a compact, sparse representation where every is parameterized by two partial derivatives. Also, the proposed expression in Eq. 8 (along with Assumption 1) avoids explicitly computing the Jacobian using a per-pixel MLP.
- Experimental results in Tables 1 and 2 suggest that the proposed method trains faster and performs better (according to tested datasets and reported PSNRs) than CENSURE, another divergence-free, self-supervised method.
Critical weaknesses
- Improvement over baseline methods in Table 1 appear to be quite minor (i.e., 0.1-0.2dB between CENSURE and Ours). The larger gains seem to come from reinjection (i.e., Ours$^\dagger$), which seems to be method-agnositic (you can enforce Eq. 19 for other baselines).
Questions for authors
- Minor request to add confidence intervals around the metrics reported in Table 1 (to give a sense of how reproducible the benchmarked results are)
3 comments
I thank the authors' for their response, and, after reading through their comments, I am inclined to maintain my current rating.
Thank you for your positive feedback!
Dear Reviewer uTRA,
Thank you for dedicating your valuable time to the evaluation of our paper and for your positive comments. We have revised the manuscript to address all the comments received (changes are in blue).
Modest improvements without signal-reinjection: Without signal-reinjection, the denoising improvements of our approach are indeed relatively minor compared to CENSURE, in the case of Gaussian noise. However, it achieves this performance gain at a considerably shorter training time, as reported in Table 2. Moreover, unlike CENSURE, our approach generalizes to both Poisson and real-world noise, as demonstrated in Table 1.
Signal-reinjection for other baselines: Regarding the method-agnostic nature of our signal-reinjection technique, we fully agree with your observation. To further investigate this point, we have added Section B.3 and Table 5 to the Appendix, in which we evaluate the potential benefits of applying signal-reinjection to other baseline methods. Our experimental results suggest that signal reinjection consistently improves the performance of constraint-based methods by compensating for their reduced expressivity (except for CENSURE in the case of Poisson and real-world noise), while providing no clear benefit to other types of baselines (see Table 5).
Confidence intervals: Could you please clarify what you mean by confidence intervals? To the best of our knowledge, confidence intervals are not standard in the image denoising literature (see, for instance, [1, 2, 3]). We assume that you may be referring to the variability in the PSNR values reported in Table 1 due to the random seed used to generate synthetic noise. In this regard, we would like to emphasize that our results are highly robust to the choice of random seed. For instance, across 100 randomly selected seeds, the average PSNR values obtained by all methods on BSD68 varied by no more than 0.03 dB. Finally, for the sake of a fair comparison, all methods were evaluated using the same random seed.
Reproducibility of the benchmarked results: With regard to reproducibility, we intend to make the training and evaluation code, along with the corresponding trained model weights, publicly available upon acceptance of the paper.
[1] Zhang, Kai, et al. Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising. IEEE TIP 2017.
[2] Huang, Tao, et al. Neighbor2neighbor: Self-supervised denoising from single noisy images. CVPR 2021.
[3] Zamir, Syed Waqas, et al. Restormer: Efficient transformer for high-resolution image restoration. CVPR 2022.