- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
ProtoFlow adapts a pretrained FLUX.2-4B model for one-step image restoration, starting directly from the degraded image’s latent representation. It learns Gaussian prototype banks for degradation and semantic information, retrieves prototype-based guidance, and fine-tunes the restoration backbone using LoRA. The method also uses the timestep to adjust restoration strength. Experiments on CoTIR-Bench show improved full-reference metrics and substantially faster inference than CoTIR-4B.
Critical strengths
-
Clear improvements in restoration accuracy and speed. Under vague prompts, ProtoFlow improves PSNR over CoTIR-4B by 1.82 dB and reduces inference time by approximately 7.7×. SSIM and LPIPS also improve.
-
Useful ablations support the prototype design. The paper evaluates the degradation and semantic prototype banks separately and together. Both contribute to performance, and their combination produces the best results in the reported ablation.
-
The method offers useful flexibility. It supports both vague and precise degradation prompts, with a smaller performance gap between these settings than CoTIR. Qualitative examples also demonstrate restoration-strength adjustment through the timestep.
Critical weaknesses
-
Gains in no-reference quality are limited. Although ProtoFlow improves full-reference metrics and inference speed, its Q-Align and LIQE scores are slightly lower than CoTIR’s, while the improvement in CLIP-IQA+ is small. Further evidence, such as a human preference study, would help establish whether these gains translate into better visual quality.
-
The generalization of the prototype design needs further validation. The prototype banks use predefined degradation categories and organizational structures. Existing ablations support their effectiveness on the evaluated benchmark, but it remains unclear whether they outperform prototype-free or simpler conditioning alternatives on unseen degradations. A setting without any text prompt is also not separately evaluated.
Questions for authors
As described in "Critical Weaknesses".
4 comments
R-W2 2): Restoration with an empty prompt.
We additionally evaluated ProtoFlow with an empty text prompt, passing an empty string to the text encoder while retaining the same prototype conditioning as in the vague-prompt setting. We use the same trained checkpoint and CoTIR-Bench test images.
| Prompt | PSNR ↑ | SSIM ↑ | LPIPS ↓ |
|---|---|---|---|
| Empty | 26.32 | 0.8740 | 0.0834 |
| Vague | 26.34 | 0.8741 | 0.0836 |
The results are nearly identical: removing the generic text instruction changes PSNR by only 0.02 dB, with negligible differences in SSIM and LPIPS. This directly demonstrates that ProtoFlow does not require a textual degradation instruction to maintain its restoration accuracy on CoTIR-Bench, as the learned prototype guidance provides effective degradation and semantic conditioning.
Thank you for the careful rebuttal which addressed some of my concerns. I will maintain my positive score.
Dear Reviewer VCvi,
Thank you for taking the time to read our response and for your positive score. We appreciate your constructive feedback and are glad the rebuttal addressed your concerns. If you have any further concerns, we would be happy to answer them.
Best regards,
The Authors
We sincerely thank Reviewer VCvi for the constructive feedback. We address each concern directly below.
R-W1: Human preference study.
While ProtoFlow's Q-Align and LIQE scores are marginally below CoTIR-4B (by less than 1.5%), no-reference metrics alone cannot determine whether visually plausible restorations preserve the actual scene content or introduce hallucinations. To directly assess these aspects, we conducted a human study with 50 participants, each evaluating all compared methods on 10 independently sampled CoTIR-Bench images. The outputs were anonymized and randomized, and participants rated visual quality (VQ), fidelity to ground truth (Fid.), and absence of hallucinations (AH) on a 0–100 scale.
ProtoFlow achieves higher mean human ratings than CoTIR-4B across all three criteria under both prompt settings:
† indicates that a precise degradation prompt is provided.
Under vague prompts, the proportion of visual-quality ratings ≥80 increases from 80% to 92%, while fidelity improves from 74.56 to 79.04. Under precise prompts, the proportion of high visual-quality ratings increases from 80% to 90%. These results provide direct human evidence that ProtoFlow improves perceived visual quality and reference fidelity while reducing hallucinations, complementing its superior full-reference metrics.
We have incorporated the complete human evaluation into Table 1, rating distributions into Fig. 3, and the evaluation protocol into Appendix D.
R-W2 1): Generalization to unseen degradation combinations.
We further evaluated ProtoFlow on an independent external benchmark [1] containing 200 images across eight degradation combinations absent from our training data. All methods were evaluated on the same images without additional fine-tuning.
ProtoFlow outperforms all compared methods across all six full-reference and no-reference metrics under both vague and precise prompts. More importantly, comparison with the same one-step architecture without prototypes directly establishes the contribution of prototype guidance under this distribution shift:
† indicates a precise degradation prompt. “w/o Proto.” denotes the variant without prototype representation.
Under vague prompts, prototype guidance improves PSNR by 1.80 dB and reduces LPIPS from 0.4123 to 0.2896. Under precise prompts, the PSNR improvement is 1.41 dB, with consistent gains across all six metrics.
These results demonstrate zero-shot generalization to previously unseen combinations of degradation types and show that prototype guidance remains effective beyond the original CoTIR-Bench evaluation distribution. The complete six-metric comparison and visual examples are provided in Appendix E.2 (Table 5 and Fig. 14).
[1] Zhu K, et al. An Intelligent Agentic System for Complex Image Restoration Problems. ICLR, 2025.