- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SOAR, which uses the squared variational derivative of a first-order image prior , , as an additional regularizer. It decomposes the variational response into the change in the magnitude of the intensity transition and the curvature of the level lines (isophotes), and shows, in a local edge model, that SOAR adds a response to the existing prior's response, thereby suppressing fast edge oscillations more strongly. Taking into account both the noise reduction from the extra smoothing and the loss of true structure, it also gives a local gain condition that holds when the difference in directional roughness is sufficiently large.
The actual algorithm first restores the image with DIP+TV whose strength is adjusted per image, and then applies the TV-derived SOAR only when the relative directional-roughness difference between the observed image and the TV result exceeds a threshold. In center-crop evaluations on PolyU, SIDD-Small, and FMD, it improves the mean PSNR over adaptive DIP+TV by about 0.043, 0.453, and 0.236 dB, respectively, and also improves SSIM. Among the reported baselines, its PSNR is the best on all three datasets, while its SSIM ranks first on PolyU and second on SIDD and FMD. Thus, the empirically demonstrated contribution is, together with the proposal of a general construction principle, the improvement of a system that combines SOAR with a selection procedure in TV-based restoration.
Critical strengths
-
It clearly connects a concise regularizer construction with an interpretable geometric analysis. SOAR is defined from the variational response of the chosen prior, and Eq. (2) decomposes this response into the change of the intensity profile and the curvature. The logical flow from the problem setup to the variational decomposition, the local edge model, and selective application is clear. The local model explains why the additional term suppresses the high-frequency components of edge displacement more strongly, as well as the trade-off that it may also deform true structures. The appendix distinguishes the preservation of the prior's minimizers from the solution of the full restoration problem, and explicitly states the scope of the analysis: the local theory does not guarantee the success of the practical selection rule. This analysis is valuable in that it goes beyond simply adding a higher-order term and tries to interpret when it can help. (§3.1, Appendices A.1–A.3)
-
It demonstrates both improvement over a controlled baseline and the practical utility of the selection rule. Compared with the same adaptive DIP+TV, mean PSNR and SSIM improve on all three datasets. Table 4 directly compares the gain from applying SOAR to selected versus excluded images: the mean PSNR change is +0.665 dB vs. −0.448 dB on SIDD, and +0.378 dB vs. −0.933 dB on FMD. A permutation test against random selection with the same number of activations also reports a significant separation of PSNR gains on all three datasets ( permutations, ). This is concrete evidence that the selection rule identifies images that benefit, on the evaluation data. It matters that the paper experimentally confirms why selection is needed, rather than only reporting an overall average improvement. (Tables 1, 3–4)
Critical weaknesses
-
The contributions of the SOAR term itself and of the selection strategy to the final advantage are not sufficiently disentangled. Table 3 compares always-on SOAR with the Laplacian and Euler–Elastica, so an ablation of the term itself is not absent. I also acknowledge that the strengths of the existing regularizers were set via the search in Appendix B before comparison. With SOAR's default setting in Table 3, always-on SOAR does increase PSNR on SIDD, but it lowers SSIM on all three datasets and lowers PSNR on FMD by about 0.113 dB. Under this setting, the selection procedure must be combined for both metrics to improve over adaptive DIP+TV on all three datasets. However, there are no results applying the same selection procedure to the existing regularizers. If the existing terms also achieve similar gains when applied only to favorable images, a substantial part of the current results could be explained by the strategy of selective higher-order regularization rather than by the way SOAR is derived. A comparison under the same DIP+TV, the same selection rule, and equivalent strength tuning is needed to evaluate the unique utility of the proposed term more clearly. This does not negate the improvement of the final system; rather, it is a lack of the controls needed to judge the size of the core contribution. (Table 3, Appendix B)
-
The configuration process and validation scope of the key selection rule are limited. The local theory is formulated with respect to the clean structure, but the actual algorithm uses the TV result as a proxy and decides whether to apply SOAR with a threshold of 0.9 on the relative roughness difference. Because the score can also be large when TV has erased true structure, this rule is an empirical approximation. The selection rule does have motivation from the local theory and experimental support, and the results of applying the same setting to the three datasets and the sensitivity analyses in Tables 5 and 8–9 are positive. However, these analyses alone do not reveal on which data and by which criterion the final threshold, regularization strength, and weighting constants were determined, nor whether the data used for configuration were separated from the final evaluation data. Therefore, the concern is not the use of a heuristic or a lack of empirical support, but that the unclear configuration process and independent validation make it difficult to judge generalization to new conditions. The average gain of the selected group alone does not reveal how often individual images get worse or how accurate the selection is under new conditions. The three benchmarks cover different real capture environments, but there is no analysis that separates noise type, strength, and spatial correlation. Comparing noise that produces irregular directional fluctuations with directional corruption such as stripes would have given a deeper understanding of the operating conditions of the proposed geometric explanation and selection rule. This is a suggested analysis to make the operating conditions of the proposed mechanism concrete, not a request for performance on every noise type. The restoration experiments are also limited to smoothed TV and a single DIP architecture. While the theoretical construction is general, the scope supported by the current empirical evidence is selective restoration in this setting. This scope and the configuration procedure need to be clearer in order to assess the reproducibility and generality of the contribution, including the selection algorithm. (§3.1, §4.1, Tables 4–5, 8–9, Appendix B.1)
Questions for authors
-
Comparison to isolate the unique effect of SOAR: How do the results change if the same -based selection rule is applied to the Laplacian and Euler–Elastica in Table 3? I would like to see whether SOAR's advantage holds when DIP+TV and the optimization settings are fixed and each regularizer's strength is given an equivalent tuning opportunity. This is not a request to newly develop every alternative method, but a question to separate the roles of the proposed term and of the selection strategy in the current final performance.
-
Configuration and reliability of the selection rule: I have checked the sensitivity analyses in Tables 5 and 8–9. Separately from those, could you explain on which data and by which criterion the final settings — , , and the constants of the adaptive TV weight — were determined? Please also clarify whether the data used for configuration were separated from the final evaluation data. In addition to the averages in Table 4, can you report the proportion of selected images whose PSNR or SSIM gets worse, and by how much? I acknowledge that the same rule was used on all three datasets, but this information is needed to judge the reliability of the selection and the risk of losing true structure.
Side note — optional research direction: Interestingly, the objective discussed in §4 of Barrett and Dherin's Implicit Gradient Regularization has a mathematical construction similar to SOAR. It is intriguing that this structure appears in problems as different as model training and image restoration. Exploring the connection between the two perspectives may yield additional interpretations or ideas for extensions. This is not a request for a comparison or an answer needed for my evaluation, but a comment on a possibility that may be worth exploring in the future.
We thank the reviewer for the feedback and the suggestions.
Q1. SOAR vs. selective activation
To isolate the contributions of the regularizer and selective activation, we apply the same activation rule ((\widehat G>0.9)) to Laplacian, Euler–Elastica (EE), and SOAR, keeping the DIP+TV baseline, optimisation settings, and selected images identical.
PSNR (dB) / SSIM. We retain the regularisation ratios from the original experiments (Laplacian: (r=0.5), EE: (r=1), SOAR: (r=12)); the Laplacian and EE ratios were selected through the cross-dataset PSNR sweeps reported in Table 7.
The results show that selective activation also benefits EE, particularly on SIDD and FMD, while its effect on Laplacian is limited. Under the same selection rule, SOAR achieves the highest PSNR across all datasets, with competitive SSIM. This suggests a contribution from the SOAR regularizer beyond the selection strategy alone.
Q2. Configuration and reliability
Parameter selection. The hyperparameters were determined through a global sweep over all images from PolyU, SIDD, and FMDD, based on average PSNR and SSIM. The same images were used for the final evaluation, without a separate validation split. A single configuration was adopted across all three datasets.
Reliability of selected images. We analyse the individual PSNR/SSIM changes among the selected images in Table 4, reporting the proportions showing improvement or degradation and their corresponding mean changes.
Selective activation improves PSNR for most selected images on PolyU (92.3%) and SIDD (67.9%). For FMDD, larger gains on 40% of selected images outweigh the more frequent degradations. While these results support the overall effectiveness of our strategy, they also suggest its limitations and the need for more image-adaptive selection. We appreciate the reviewer’s suggestions on this issue and will take them into account in future revisions.