- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Conformal Selective Generation (CSG) for image inpainting. Instead of showing all generated content, CSG decides which regions to release and which to withhold. It fixes one completion for delivery and uses additional generated samples to estimate regional uncertainty. The main score measures DINOv2 feature disagreement between the designated completion and the auxiliary samples. Conformal risk control is then used to select a release threshold. The method aims to control the expected proxy error risk at the source level, where proxy errors are defined using CLIP distance from a reference image.
The authors evaluate CSG on Places365 using four image inpainting methods. They compare different scoring methods and conduct experiments on human judgments, perturbations, and mask geometries. The main method achieves 65.3% region coverage at a mean proxy risk of 0.098. The experiments also reveal limitations under common-mode errors and challenging region geometries.
Critical strengths
1. Clear Problem Formulation and Risk Control
The paper addresses a meaningful problem: deciding which generated regions can be safely shown to users. The proposed framework provides a clear formulation of regional release decisions and uses conformal risk control to provide a statistical guarantee under stated assumptions.
2. Comprehensive Experimental Evaluation
The experiments are extensive and well designed. The authors evaluate multiple image restoration models, scoring methods, and settings, including human evaluations and distribution shifts. They also report important failure cases, such as common-mode errors and challenging region geometries. These analyses help clarify both the strengths and limitations of the proposed method.
Critical weaknesses
1. Limited Novelty
The framework mainly combines regional selection with existing conformal risk control. Although the problem is meaningful, the paper does not clearly show what new methodological or practical advantages it offers over related conformal masking methods, such as Kutiel et al. and Adame et al. This makes the novelty of the contribution less convincing.
2. Practical Reliability of the Risk Guarantee
The theoretical guarantee only applies to CLIP-defined proxy errors, rather than actual errors among released regions. The results are also sensitive to the choice of proxy error threshold and show clear limitations under common-mode errors. These issues raise concerns about how well the proposed framework can ensure reliable image inpainting in practice.
Questions for authors
1. Novelty and Contribution
What are the main advantages of CSG over existing conformal masking methods, such as Kutiel et al. and Adame et al.? Which experimental results best demonstrate these advantages?
2. Proxy Error Definition
Why is CLIP distance chosen to define proxy errors? What evidence supports its use as a measure of actual reconstruction errors?
3. Sensitivity to
The results are sensitive to the choice of . Why is the 75th percentile selected for the main experiments? How should this threshold be chosen in real applications?
4. Common-mode Errors
The experiments show that common-mode errors can significantly affect risk control. How could CSG handle such errors when new reference-labeled calibration data is unavailable?
5. Candidate Region Construction
What motivates the use of SLIC and the specific parameters (128 regions and )? How do these choices relate to the intended applications?
6. Designated Completion
How exactly is the designated completion selected for each instance? Could the authors clarify the seed/index selection procedure to support reproducibility?
7. Writing and Clarity (Suggestion)
The experiments are extensive, but the presentation could be improved. Some important design choices and definitions, such as candidate region construction, the reference-aware oracle, and appearance + structure fusion, should be explained more clearly in the main text.