- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies implicit neural representations (INRs) for image representation. This is the most common application of INRs, although other modalities have been studied too (1D signals, videos, point-clouds, etc). The paper makes the observation that INRs tend to perform poorly when inpainting large missing regions (i.e., where there are no observations to act as a supervisory signal for the model). It proposes to learn a patch representation of the observed image and use that during reconstruction. In this sense it is similar to early super-resolution and energy-based image inpainting approaches. Experiments show quantitative and qualitative improvements for image completion at a modest increase in running time (53s vs 199s).
Critical strengths
The paper is well written and the approach is principled borrowing on ideas in the computer vision literature on patch-based approaches for image completion and in-painting. The technical aspects of the paper are clear with complete mathematical description of the algorithm. Experiments are promising albeit on a very small dataset and only for image completion.
Critical weaknesses
-
The idea of using self-learned patches for image completion is not new, and the paper cites some traditional approaches. The authors may consider also citing classic approaches in energy-based image inpainting (e.g., Komodakis and Tziritas, CVPR 2006) and image super-resolution (e.g.,Glasner et al., ICCV 2009).
-
The experiments are quite limited. Only a small number images are tested and only for image in-painting using five mask types. I would have liked to see results on other tasks such as super-resolution, which is the primary justification for INRs (i.e., resolution independence) and other modalities (e.g. 1D sound waves or 4D video).
Questions for authors
Please address the concerns raised above.