- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Deep Repurposing (DR), a post-hoc framework for adapting pretrained models when parts of their output space become obsolete, without retraining. However, I have significant concerns about both the paper’s presentation and its technical contributions, particularly the insufficient justification of its methodological novelty and the lack of convincing experimental validation of its core repurposing mechanism. I believe these issues are unlikely to be adequately addressed during the rebuttal phase.
Critical strengths
- The paper propose a practical solution for adapting models in settings where retraining is costly.
- The experiments cover a diverse range of datasets and tasks.
Critical weaknesses
-
The Introduction and Related Work do not sufficiently establish the research gap or explain how the limitations of existing methods motivate the specific design of Deep Repurposing (DR). In particular, the central concept of “useful obsolete evidence” remains insufficiently defined, and the paper does not clearly explain (1) what constitutes such evidence, (2) how useful information shared between obsolete and retained regions can be identified and preserved, and (3) how DR fundamentally differs from existing feature-editing, decision-boundary modification, and output-remapping methods. Although Section 4 describes the proposed pipeline and the experiments provide some evidence of its effects, the paper does not fully establish the necessity or distinctiveness of its core repurposing mechanism.
-
The experiments do not convincingly demonstrate that useful evidence is genuinely redirected to semantically appropriate retained regions. The ablations also do not sufficiently isolate the contribution of evidence redirection from obsolete-feature removal and residual refinement. Thus, the central claim of repurposing remains insufficiently validated.
Questions for authors
- For W1. While the Section 4 specifies an operational procedure for selecting a destination region, it remains unclear what makes the transferred obsolete evidence genuinely useful and how its semantic usefulness is independently validated.
- The discussion in Section 2 is largely descriptive and does not compare their mechanisms and limitations with those of DR. For example, what are the fundamental technical difference between [1] and DR? What distinct advantages does DR offer over other related methods [2-4]?
- Figure 4 provides a qualitative segmentation example, but quantitative results would strengthen the paper’s central claim of evidence repurposing, particularly that obsolete evidence is redirected toward semantically appropriate retained classes.
[1] Editing models with task arithmetic, ICLR 2023.
[2] Exploring and leveraging class vectors for classifier editing, NeurIPS 2025.
[3] Boundary unlearning: Rapid forgetting of deep networks via shifting the decision boundary, CVPR 2023.
[4] Eternal sunshine of the spotless net: Selective forgetting in deep networks, CVPR 2020.