- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
- This paper proposes Flow-Filter, a plug-and-play framework for Structure-Aware Image Smoothing. It uses a pretrained pixel-level Flow Matching model as a global generative structure prior, combined with first-/second-order mixed-difference MCP gradient geometry and RGB group-sparse texture priors, enabling structure-texture decomposition without task-specific fine-tuning.
- Key components include Flow-ADMM Level Matching, which links the Flow perturbation scale to the ADMM penalty; Clean-Endpoint Anchoring and Noise-Endpoint Refresh to reduce structure drift and prevent residual texture accumulation; and 2D Cyclic Patch-Phase Shifting to alleviate patch-boundary artifacts.
- Experiments on texture filtering, JPEG artifact removal, NKS synthetic benchmarks, detail enhancement, and HDR tone mapping show a better balance between structure preservation and texture removal than conventional optimization-based and supervised/fine-tuned methods.
Critical strengths
- Well-motivated generative-prior integration: Rather than using the generative model as an end-to-end smoother, which may introduce texture hallucination or structural distortion, the paper uses it as a source of global structural guidance and combines it with explicit differential priors within a unified ADMM framework.
- Effective solution to the deployment challenge of patch-based generative priors: The proposed 2D cyclic Patch-Phase Shifting (PPS) mechanism addresses phase-locked boundary artifacts that can accumulate during multi-step iterations with patch-based generative models such as JiT. Importantly, it requires neither additional retraining nor network evaluations, and the ablation study clearly demonstrates its effectiveness in removing stitching artifacts.
Critical weaknesses
-
Limited quantitative evaluation on real-world natural images: Most quantitative results are based on 50 clip-art images for JPEG artifact removal and 200 synthetic textures from the NKS dataset. Evaluation on complex natural images and real-world multi-scale textures relies mainly on qualitative comparisons, with limited evidence from large-scale user studies or downstream tasks such as edge detection and salient object segmentation.
-
High computational cost limits practical and interactive applications: As reported in Table 4, processing a relatively small image of approximately resolution takes about 3.5 seconds, making the method orders of magnitude slower than real-time or sub-second smoothing approaches. The paper does not explore low-step sampling (e.g., 5–10 steps) or distillation-based acceleration.
Questions for authors
-
Hyperparameter robustness and adaptivity: If a single fixed set of hyperparameters is used across all tasks and test images, how much does performance degrade on the NKS and JPEG artifact removal benchmarks? Is there an input-adaptive strategy for automatically estimating these parameters, rather than relying on task-specific manual tuning?
-
Potential for few-step acceleration: The current inference requires up to 50 model evaluations. Does the proposed decomposition remain effective when the sampling steps are drastically reduced to 3–5 steps?
-
End-to-end benefits for downstream tasks: Can the authors provide quantitative results on downstream tasks using the smoothed images, demonstrating practical advantages over conventional real-time filters?