- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes InCaRP, an all-in-one image restoration Transformer for handling different degradations with a single model. It introduces Low-Rank Relation-Space Attention (LRSA), which compresses key and value responses before attention computation, and Coupled-Axis Prompt Calibration (CAPC), which uses paired prompts to adapt the compact attention relations to each input. The two components aim to reduce redundant interactions while providing degradation-aware relation modeling. Experiments on AIO-3, AIO-5, and CDD-11 show strong performance across single and composite degradations, and the ablation studies support the effectiveness of the proposed components.
Critical strengths
- The method has a clear motivation. LRSA and CAPC provide a clear way to combine compact attention computation with input-adaptive relation modeling.
- The paper revisits prompt-based restoration from a practical perspective. Instead of applying prompts only to image features, it studies how prompts can directly adjust attention relations, providing a useful view of where degradation conditioning should be introduced.
Critical weaknesses
-
Practical efficiency has not been fully demonstrated. Although the paper claims improvements in computational efficiency, it fails to report runtime, FLOPs, or peak memory usage for the complete model under a unified experimental setup.
-
Evaluation in real-world scenarios is limited. Most experiments were conducted on paired datasets, lacking sufficient evaluation on images with unknown ground-truth degradation characteristics—such as visual comparisons involving images without ground truth.
Questions for authors
-
The practical efficiency of the full model remains unclear because runtime, FLOPs, and peak memory usage are not reported under a consistent setting.
-
The generalization ability on unknown real-world degradations is not sufficiently demonstrated, as most experiments are based on synthetic or paired datasets.
-
CAPC retrieves prompts from global feature statistics, so it is unclear whether it can accurately represent spatially localized degradations such as local rain streaks or motion blur.
4 comments
[Part 2] Official Comment by Authors
R3.3: Concerns of spatially localized degradations representing
Thank you for this insightful question. Global conditioning helps a shared restoration model determine how to adapt to an input. For example, PromptIR [5] and CPL [6] compose input-dependent prompts, while MoCE-IR [7] uses input-dependent expert routing. CAPC also derives its conditioning from global feature statistics, and it applies this conditioning directly to the attention relations that govern feature aggregation.
The retrieved query and relation prompts generate scale and shift fields for the logits between query channels and relation atoms. These calibrated logits determine how each query channel combines spatially indexed value responses. Because the value responses depend on local image content, the same image-level calibration can affect different regions differently. Figure 5(b) in Section 4.3 of the revised manuscript illustrates this effect by comparing learned and identity calibration with the decoder-block input held fixed. The resulting response changes concentrate around elongated rain streaks in deraining examples and around blur-affected boundaries and contours in deblurring examples.
We further evaluate whether CAPC-induced output changes are spatially aligned with degradation on Rain100L [8] and GoPro [9]. For each input, we compare restored outputs with CAPC enabled and disabled at the D1-1 decoder block, keeping model weights and all other blocks fixed. We correlate the output-change map with the degradation residual computed from the degraded input and clean target. The pixel-wise Pearson correlation measures whether locations with stronger degradation residuals tend to show larger output changes when CAPC is disabled. As a spatial control, we circularly shift the residual, preserving its values and spatial structure while disrupting alignment with the output-change map. Table 13 (Appendix C.7 of the revised manuscript) reports positive correlations on Rain100L (0.5625) and GoPro (0.7547), which fall to near zero after shifting, indicating that the association depends on spatial alignment. These results support our conclusion that global prompts can modulate restoration locally through CAPC, with larger effects in regions more strongly affected by degradation.
Spatial alignment between CAPC-induced output changes and degradation residuals (Table 13 in Appendix C.7 of the revised manuscript).
| Dataset | Real spatial correlation ↑ | Shifted residual correlation | Correlation gain (Δρ) ↑ | Permutation p-value ↓ |
|---|---|---|---|---|
| Rain100L | 0.562 | -0.001 | 0.563 | < 0.0001 |
| GoPro | 0.755 | -0.008 | 0.762 | 0.00049 |
In a word, CAPC leverages prompts retrieved from global feature statistics to recalibrate attention relations and change how spatially indexed value features are aggregated. This enables the model to respond more selectively to localized rain streaks and blur-affected regions.
We hope the additional evaluations address your concerns about practical efficiency, generalization to real-world and unseen degradations, and spatially selective restoration, and we welcome further discussion.
References
[1] Tianyu Wang, Xin Yang, Ke Xu, Shaozhe Chen, Qiang Zhang, and Rynson W. H. Lau. Spatial Attentive Single-Image Deraining With a High Quality Real Rain Dataset. CVPR, 2019.
[2] Wenhan Yang, Wenjing Wang, Haofeng Huang, Shiqi Wang, and Jiaying Liu. Sparse Gradient Regularized Deep Retinex Network for Robust Low-Light Image Enhancement. IEEE TIP, 2021.
[3] Yurui Zhu, Tianyu Wang, Xueyang Fu, Xuanyu Yang, Xin Guo, Jifeng Dai, Yu Qiao, and Xiaowei Hu. Learning Weather-General and Weather-Specific Features for Image Restoration Under Multiple Adverse Weather Conditions. CVPR, 2023.
[4] Liangqiong Qu, Jiandong Tian, Shengfeng He, Yandong Tang, and Rynson W. H. Lau. DeshadowNet: A Multi-Context Embedding Deep Network for Shadow Removal. CVPR, 2017.
[5] Vaishnav Potlapalli, Syed Waqas Zamir, Salman Khan, and Fahad Shahbaz Khan. PromptIR: Prompting for All-in-One Image Restoration. NeurIPS, 2023.
[6] Gang Wu, Junjun Jiang, Kui Jiang, Xianming Liu, and Liqiang Nie. Beyond Degradation Redundancy: Contrastive Prompt Learning for All-in-One Image Restoration. IEEE TPAMI, 2026.
[7] Eduard Zamfir, Zongwei Wu, Nancy Mehta, Yuedong Tan, Danda Pani Paudel, Yulun Zhang, and Radu Timofte. Complexity Experts are Task-Discriminative Learners for Any Image Restoration. CVPR, 2025.
[8] Wenhan Yang, Robby T. Tan, Jiashi Feng, Zongming Guo, Shuicheng Yan, and Jiaying Liu. Joint Rain Detection and Removal from a Single Image with Contextualized Deep Networks. IEEE TPAMI, 2020.
[9] Seungjun Nah, Tae Hyun Kim, and Kyoung Mu Lee. Deep Multi-Scale Convolutional Neural Network for Dynamic Scene Deblurring. CVPR, 2017.
The authors' response has addressed my concerns. Therefore, I have decided to maintain my original score.
We are pleased that our response has addressed your concerns. Thank you for your thoughtful review, constructive feedback, and positive assessment and rating of our work.
[Part 1] Official Comment by Authors
We thank the reviewer for the constructive comments and helpful suggestions. We address the questions concerning (1) computational cost and practical efficiency, (2) generalization to real-world and unseen degradations, and (3) spatially selective restoration through global prompts. The corresponding evaluations and explanations are added to the revised main text and supplementary material, together with quantitative results, visual comparisons, and supporting analyses. Please refer to these updates for further details.
R3.1: Model complexity and efficiencyWe appreciate the reviewer’s meaningful suggestion. We have additionally measured the parameter count, peak GPU memory, FLOPs, and runtime of the complete models under a unified setting. As reported in Table 4 of Section 4.3 of the revised manuscript and discussed in our response to Reviewer uJmP [W2], our method achieves the lowest parameter count, memory consumption, and FLOPs while retaining competitive runtime, demonstrating its practical efficiency. At the same time, our approach also outperforms recent state-of-the-art methods across multiple all-in-one restoration settings (Tables 1 and 2 in Section 4.2 and Table 7 in Appendix B.1 of the revised manuscript) and on real-world benchmarks (Table 3 in Section 4.2 of the revised manuscript), achieving a favorable trade-off between restoration quality and computational cost.
Computational demands comparison (Table 4 in Section 4.3 of the revised manuscript).
Evaluation setup. We report the total number of parameters for each complete model. FLOPs, peak GPU memory usage, and inference latency are evaluated under the same setup for all methods, using 224 × 224 input images on an NVIDIA GeForce RTX 3090 Ti GPU.
R3.2: Generalization to real world and unseen distributionThank you for highlighting the importance of real-world evaluation. We additionally evaluate InCaRP on real-world datasets, covering deraining on SPA [1], low-light enhancement on LOL-v2-Real [2], desnowing on RealSnow [3], and shadow removal on SRD [4]. Desnowing and shadow removal extend the evaluation beyond the degradation types in AIO-5. We use PSNR, LPIPS, and CLIP-IQA to assess pixel fidelity, perceptual quality, and no-reference quality, respectively. InCaRP achieves the best results across all datasets and metrics (Table 3 in Section 4.2 of the revised manuscript). Figure 6 in Appendix B.2 of the revised manuscript presents paired real-world deraining and low-light enhancement examples. Overall, these results demonstrate that InCaRP generalizes more effectively than the competing methods to real-world images, both for degradation types covered by AIO-5 and for unseen types such as snow and shadows.
Quantitative comparison on four real-world benchmarks (Table 3 in Section 4.2 of the revised manuscript).