- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies target-domain post-training for generative image restoration using imperfect generated targets. Starting from real low-quality images, an image editing model generates candidate high-quality targets. A vision-language model identifies semantic hallucinations on an 8-by-8 grid, and the corresponding regions are excluded from spatially aligned training losses. A localized editing and verification loop attempts to correct these regions and recover additional supervision. The paper also presents a controlled synthetic study of broad-degradation pre-training followed by target-degradation post-training, and evaluates the proposed pipeline with SeeSR, OSEDiff, and HYPIR on old-photo enhancement, UGC enhancement, and real-world super-resolution.
Critical strengths
- The paper addresses a relevant problem: generated restoration targets can contain hallucinated content, and discarding an entire image may waste useful supervision in otherwise reliable regions. Attempting to retain and repair this supervision is a reasonable direction.
- Several qualitative examples show sharper structures and additional details after post-training. The experiments also consider restoration models with different training formulations, suggesting that the pipeline could be applicable beyond a single backbone.
Critical weaknesses
-
The pre-training experiments do not establish the claimed necessity or sufficiently separate the effect of initialization from the training budget. In Figure 2(a), the model without degradation pre-training steadily approaches the pre-trained model over the reported post-training interval. This supports an advantage in initial performance and early convergence, but does not establish an advantage after convergence. Moreover, the pre-trained model receives 30K additional training steps before the 5K-step adaptation stage. Longer target-only training and comparisons under matched total training budgets are needed. Similarly, Figure 2(b) compares Narrow and Wide pre-training at a single post-training endpoint; the LPIPS difference after adaptation is only 0.001. Without learning curves over a longer adaptation horizon, variation across runs, and an analysis of the allocation between pre-training and post-training, it is difficult to assess how robust this conclusion is to the selected training schedule.
-
The reliability of the generated supervision, which is central to the method, is not directly established. The paper needs to show that the retained regions are reliable and that refinement improves target fidelity. Downstream improvements after fine-tuning do not by themselves establish either point. Table 3 provides a limited evaluation on 20 real LQ images, but the source and construction of the "hallucination-free references" are unspecified. Its one-round refinement baseline also does not establish the quality of the initial editing-model outputs. There is no reported evaluation of hallucination localization against human annotations, no quantitative analysis of residual errors in regions retained by the mask, and no systematic initial-GGT versus refined-GGT comparison on data with genuine clean references. Figure 3 provides an illustrative example, but a broader set of successful and failed localization/refinement cases is needed.
-
The ablation setup and evaluation are insufficiently documented. The datasets and experimental protocols used for the ablations are not clearly specified, making the results difficult to assess or reproduce reliably. Metric coverage is also incomplete; in particular, Table 2 reports only no-reference quality scores, leaving the effects of masking and refinement on fidelity and input consistency unclear.
-
The additional target enhancement is not evaluated separately. The supplementary material mentions HYPIR-based enhancement of the old-photo targets but provides no results with and without this step, making its contribution to the reported improvements unclear.
Questions for authors
- Which restoration model, dataset/domain, data split, and training schedule are used in Tables 2 and 3?
- Can the authors extend Figure 2 to convergence and provide target-only baselines under matched total training budgets? How sensitive are the Narrow-versus-Wide results to the duration of post-training and to random seeds?
- How are the 20 hallucination-free references in Table 3 obtained and verified? Can the initial and refined GGTs be evaluated against genuine clean references on a paired benchmark?
- Can the authors evaluate VLM localization against human annotations and quantify the fidelity of regions retained by the mask? Please also provide representative successes and failures showing the initial GGT, detected/masked regions, refined target, and unresolved regions.
- Can Table 2 include fidelity or input-consistency metrics alongside quality metrics?
- Can the old-photo experiments include an ablation without HYPIR-based target enhancement while holding the remaining processing fixed?