- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies continual capability expansion for image restoration: given a pretrained image restoration model, enable it to sequentially learn new degradation types without accessing historical training data, while preserving its existing restoration performance as much as possible.
The authors propose RestoreMore. The method freezes the original pretrained restoration model and inserts lightweight residual expansion modules after several feature stages. At each stage, the model first extracts spatial and frequency statistics from the current feature to construct a degradation descriptor . It then selects the Top- capabilities based on the similarity between and historical capability prototypes . Each selected capability corresponds to a router that maps into a routing query . Next, is matched against the keys of experts in an expert bank to select the Top- experts. Finally, the model applies a two-level weighting scheme to the selected expert outputs and adds the resulting residual feature back to the original backbone feature.
When a new degradation task arrives, the authors add a new capability prototype, router, residual expert, and routing key, keeping the pretrained backbone and past components frozen. Experiments are conducted across CNN, Transformer, and Mamba backbones on tasks including deraining, desnowing, dehazing, deblurring, and denoising.
Overall, the strengths of the paper lie in its practical problem formulation, its ability to easily extend existing restoration models, and its solid continual learning results across multiple backbones and tasks. The main weakness is that the necessity of bi-level routing over simpler expert routing lacks convincing validation. In addition, the methodology section and mathematical notations could be organized more clearly to reduce reading effort, and the main architecture diagram and experiment figures are presented in raster format rather than vector format, leaving clear room for visual improvement.
Critical strengths
1. The problem formulation is practical, and the method directly applies to existing image restoration models.
The paper focuses on continuously adding new restoration capabilities to an already trained restoration model without retraining from scratch. RestoreMore keeps the original model as a frozen capability anchor and only adds residual expansion modules at specific feature stages. This interface places minimal constraints on the internal backbone architecture, and the authors validate it across CNN, Transformer, and Mamba designs. Compared to continual learning methods designed for one specific restoration architecture, this approach provides broader model compatibility, which is one of the most valuable aspects of this work.
2. The experiments thoroughly evaluate the core objective: learning new capabilities while preserving old ones.
The paper tracks performance changes across incremental stages for both old and new tasks, rather than just reporting final average metrics. For example, when expanding ALGNet from a single deblurring model to five restoration tasks, the initial deblurring capability shows minimal drop after multiple expansions, while newly added tasks achieve strong restoration performance. The authors also investigate task orderings, real-world scenes, unseen degradation types, and unseen degradation severities. Overall, these experiments demonstrate that RestoreMore achieves a solid empirical balance between stability and plasticity.
Critical weaknesses
1. The novel algorithmic contribution is not sufficiently positioned against existing continual image restoration works.
Several key ingredients of RestoreMore are already present in published continual image restoration methods. DELNet / DELNet+ [1, 2] use a dynamic expert library, freeze historical experts, add new experts for newly arriving tasks, and reuse historical experts through similarity-based routing. LDP [3] also uses query-key matching to retrieve accumulated knowledge.
Therefore, the main technical contribution of RestoreMore appears to lie in its particular combination of a frozen pretrained restorer, stage-wise residual expansion, and the bi-level capability-to-expert routing mechanism. However, the paper does not clearly explain how this design differs from, or improves upon, these closely related approaches.
A more direct comparison with DELNet / DELNet+ and LDP is needed to clarify the actual methodological contribution of RestoreMore.
2. Bi-level routing is a core design choice in this paper, but the current experiments do not demonstrate that this extra level is necessary.
For each selected capability, RestoreMore first computes a weighted combination of expert outputs and then performs another weighted combination across the selected capabilities. The final residual can therefore still be viewed as an input-dependent mixture of experts.
A natural simplified baseline would directly use the descriptor to generate a routing query, match it against the expert keys, and select the Top- experts, without the intermediate capability-selection stage. Such a single-level query-key router would still support continual expansion of the expert bank.
This issue is especially apparent during the first incremental stage. At this point, the expert bank contains only the null expert and one non-zero expert . Even if multiple capabilities are selected, all capability-specific routers ultimately operate over the same single non-zero expert. The bi-level mechanism therefore mainly controls the weight of at this stage, while genuine multi-expert composition only becomes possible after more tasks are accumulated.
I therefore think a direct comparison with a single-level query-key expert router is necessary to justify the bi-level design.
[1] Shihong Liu, Kun Zuo, and Hanguang Xiao. DELNet: Continuous All-in-One Weather Removal via Dynamic Expert Library. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2026.
[2] Shihong Liu, Kun Zuo, and Hanguang Xiao. DELNet+: Dynamic Expert Library Image Continual Restoration Network. Image and Vision Computing, 2026.
[3] Peijun Zhao, Tongjun Wang, Wei Wang, Zhaoxu Feng, and Songnan Chen. Learning Discriminative Prompts for Continual Image Restoration. IEEE Access, 2026.
Questions for authors
1. [Evaluation-critical experimental question] Can the authors provide a single-level query-key expert routing baseline matched in parameter count and computational cost?
Specifically, the model could map the current degradation descriptor through a single router:
compute
and directly select the Top- experts, bypassing the intermediate capability prototype selection and capability-specific routers.
This comparison would address the central design question: given an extensible query-key expert bank, does the extra hierarchy
consistently outperform the direct formulation
Because bi-level routing is the main component distinguishing this paper from prior modular continual restoration methods, this result will heavily influence my assessment of the technical contribution.
2. [Evaluation-critical related-work / experimental question] How do the authors distinguish RestoreMore from DELNet / DELNet+ [1, 2] and LDP [3]?
DELNet and DELNet+ already use a dynamic expert library, adding new experts for new tasks, freezing historical experts, and reusing past knowledge via similarity-based selection. LDP already uses query-key retrieval in continual image restoration to select relevant prompts from an expanding pool.
Based on the current manuscript, the primary distinctions appear to be: using an arbitrary pretrained restorer as a frozen anchor, applying residual expansion across multiple feature stages, and employing capability-to-expert hierarchical routing. I encourage the authors to articulate these differences more explicitly, and ideally provide direct experimental comparisons or controlled ablations on these key designs.
Demonstrating that stage-wise expansion or bi-level routing provides consistent and notable gains over existing expert/prompt retrieval mechanisms would substantially strengthen my evaluation of the paper's novelty.
[1] Shihong Liu, Kun Zuo, and Hanguang Xiao. DELNet: Continuous All-in-One Weather Removal via Dynamic Expert Library. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2026.
[2] Shihong Liu, Kun Zuo, and Hanguang Xiao. DELNet+: Dynamic Expert Library Image Continual Restoration Network. Image and Vision Computing, 2026.
[3] Peijun Zhao, Tongjun Wang, Wei Wang, Zhaoxu Feng, and Songnan Chen. Learning Discriminative Prompts for Continual Image Restoration. IEEE Access, 2026.