- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes RwF for continual image restoration. It localizes degradation-critical filters via parameter-space Integrated Gradients and regenerates only those filters from a filter bank using low-rank transforms, leaving the rest of the backbone frozen. The method is evaluated on synthetic and public multi-task benchmarks across CNN, Transformer and diffusion backbones.
Critical strengths
The filter-reset study shows that ~2–3% of filters carry each task’s restoration ability, clearly more than random filters.
Data-free, no inference overhead, and applicable to CNN, Transformer and diffusion backbones.
Critical weaknesses
Freedom from forgetting comes from per-task parameter storage plus task identity. Comparisons with single-model CL baselines and task-agnostic all-in-one methods are therefore not like-for-like, and the main tables don’t state whether oracle task IDs are used.
The parameter-efficiency claim is inconsistent: the abstract and Tab. 3 claim ~10× fewer parameters than LoRA, but Tab. 6 reports per-task storage comparable to rank-8 LoRA (3.7% vs. 3.5%).
The IG baseline does not isolate the current task. Cross-task attention uses untrained random projections, ablation gains are small and from single runs, and several hyperparameters are inconsistent.
Questions for authors
Do the main results use oracle task IDs or the router? Please report end-to-end results with the router.
Please give consistent parameter accounting, including the stored per-task filter values.
What are the configurations of LoRA-Similar and LoRA-Full, and do they use the same task-ID access?
Were the all-in-one baselines retrained on the same splits? Please add joint-training and per-task fine-tuning references.
Please report multi-seed variance for the main results and the ablations.
The authors do not provide a rebuttal. I will keep my original rating.