- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes TaskIR, a two-stage task-driven image restoration framework for handling multiple degradations while improving downstream vision performance. In Stage I, a Degradation Representation Module extracts global and spatial degradation information to modulate a shared restoration network. In Stage II, features from classification, semantic segmentation, and object detection networks are converted into task feedback. A prototype-based feedback weighting module and a selective refinement module then use these signals to further modify the restoration features. Experiments are conducted on ImageNet-1K, Cityscapes, and PASCAL VOC2012 under eight synthetically generated degradation types, evaluating both restoration quality and downstream task performance.
Critical strengths
- The paper studies an important trade-off in task-driven restoration. It aims to improve both restoration quality and downstream task performance under multiple degradation types, rather than optimizing either objective in isolation.
- The experimental evaluation is relatively comprehensive. The paper evaluates image classification, semantic segmentation, and object detection across three datasets and eight degradation types. It also reports stage-wise comparisons and ablations of the task-feedback modules, allowing the effects of task adaptation on restoration and downstream performance to be examined.
Critical weaknesses
- The inference cost is substantial. The full TaskIR pipeline appears to require running three additional downstream networks, i.e., ResNet-50, SegFormer, and YOLOv8, to generate task feedback during inference. This substantially increases the parameter count and FLOPs compared with the Stage-I restoration network. The paper does not clarify whether all three task networks must be executed when only one downstream task is required, nor does it report the total latency and memory cost of the complete three-task inference setting.
- The interaction and potential conflict among different task feedback signals are not sufficiently analyzed. The method combines feedback from classification, segmentation, and detection through prototype matching, Sinkhorn-based relevance estimation, and selective refinement. However, the paper does not directly analyze whether these task objectives provide complementary or conflicting restoration directions. It also does not show whether improving one task can degrade another task or the basic restoration quality.
- The evaluation is restricted to synthetic degradations. All experiments are conducted by applying eight predefined synthetic degradations to clean images from ImageNet-1K, Cityscapes, and PASCAL VOC2012. Although the benchmark covers multiple degradation types and tasks, it does not evaluate real camera noise, natural blur, real haze, low illumination, or naturally occurring compound degradations. Therefore, the experiments characterize the method under controlled synthetic degradations, while its behavior on real-world degradations remains unclear. Comparisons on real-degradation benchmarks or naturally captured degraded images would be important for assessing the practical claims.
- The comparison does not include sufficiently direct task-driven restoration baselines. Most compared methods are general all-in-one restoration methods rather than methods that explicitly use downstream task losses, task features, or task feedback to guide restoration. The paper should include representative task-driven restoration baselines under the same multi-degradation and downstream-task settings.
Questions for authors
- Does inference require running ResNet-50, SegFormer, and YOLOv8 simultaneously, even when only one downstream task is needed? Please report the total latency, memory usage, and FLOPs of the complete three-task inference setting.
- How do the classification, segmentation, and detection feedback signals interact during training and inference? Please report their task-specific weights and analyze whether improving one task affects the other tasks or the basic restoration quality.
- Can the authors evaluate TaskIR on real-degradation benchmarks or naturally captured degraded images, in addition to the current synthetic degradation setting?
- Can the authors compare TaskIR with representative task-driven restoration methods that use downstream task losses, task features, or task feedback under the same multi-degradation and downstream-task protocols?