- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3(+1)
Read review
Paper summary
This paper studies whether static selectivity is sufficient to characterize concept unlearning in promptable segmentation models. The authors first qualify post-unlearning model-target states using target suppression and retained-utility criteria under a canonical access route. They then characterize the qualified states along two axes: task-native access and subsequent target-clean model evolution.
Across 336 model-target runs, 28 states qualify. With the model fixed, residual target capability increases substantially when moving from canonical box access to point and model-ranked multimask access. A fixed-input SAM2 comparison further shows that changing only the model-side output-resolution rule produces a much larger disagreement after unlearning than in the original model. With canonical access fixed, target-clean adaptation also restores a large fraction of the target capability while mostly preserving monitored utility. The paper argues that static selectivity is a condition-specific qualification rather than an access- or state-invariant characterization of unlearning.
Critical strengths
-
The qualification-first design is clear and useful. It separates the question of whether a model passes a canonical unlearning criterion from the broader question of how the qualified capability behaves under different access routes and later model updates.
-
The fixed-input SAM2 comparison is particularly convincing. The image, box prompt, and model weights are held fixed while the model-side output rule changes. The negligible gap in the original model and the much larger gap after unlearning provide evidence that unlearning can disrupt consistency across native output routes.
-
The model-evolution experiment is also informative. Target capability returns quickly under the specified target-clean adaptation protocol while retained utility is mostly preserved. The authors are appropriately cautious and do not claim that behavioral return alone proves recovery of historical target information.
Critical weaknesses
-
The main characterization cohort is narrow. Only 28 of 336 states qualify, and 27 of these states are produced by SCU. The results therefore provide strong evidence about qualified SCU states under the tested settings, but support more limited claims about selective segmentation unlearning in general. The large State Bank should not be confused with broad coverage of successful unlearning methods.
-
Some interpretations depend on comparisons that change more than one factor. The Box-versus-Point comparison changes the prompt form and the available interaction information, while the model-evolution result uses one specific five-shot, full-decoder adaptation protocol. The fixed-input SAM2 experiment addresses part of this concern, but it covers only a subset of the qualified states. In addition, target-clean support excludes direct target-positive supervision but may still contain shared visual priors or indirect information relevant to the target. Thus the experiments establish access- and state-dependence, but do not identify the mechanism or the provenance of the returning behavior.
Minor related-work comment: The positioning is somewhat incomplete. The paper discusses task-native access and downstream adaptation, but does not engage with several relevant works:
- SHERPA: Fine-tuning Segment Anything Models with Task-relevant Guidance (ICML 2026), which studies task-relevant SAM adaptation while preserving general-purpose segmentation ability.
- ProMISe: Promptable Medical Image Segmentation using SAM (NeurIPS Workshop 2024), which studies domain adaptation while retaining SAM’s promptable interface.
- RClicks: Realistic Click Simulation for Benchmarking Interactive Segmentation (NeurIPS Datasets and Benchmarks Track 2024), which shows that realistic click distributions can substantially affect interactive segmentation evaluation.
These works do not undermine the paper’s main results, but discussing them would help clarify the distinction between the present unlearning-focused characterization and prior work on SAM adaptation and access-dependent evaluation.
Questions for authors
-
For the fixed-input SAM2 comparison, could the authors clarify precisely what differs between the controlled token-0 route and the deployed route? In particular, does the comparison change only output resolution, or does it also change candidate generation or output selection?
-
How is target-clean support guaranteed to contain no information that can directly or indirectly supervise the target? For example, can target instances occur as unlabeled regions, related categories, or shared parent concepts in the support images?
-
Given that 27 of the 28 qualified states come from SCU, how should the main conclusions be scoped with respect to other unlearning methods? Would the authors agree that the strongest claim is about the instability of qualified SCU states rather than all segmentation unlearning methods?
-
The paper would benefit from clarifying how its evaluation framework differs from prior work on SAM adaptation and prompt-dependent evaluation, including SHERPA, ProMISe, and RClicks.
Overall, I find this to be an interesting and well-motivated evaluation paper. The distinction between static qualification and broader capability characterization is useful, and the fixed-input SAM2 experiment makes the central claim substantially stronger than a simple comparison of different prompts. The conclusions should remain conditional on the evaluated cohort, access routes, and adaptation protocol, but within that scope the evidence is reasonably convincing. I therefore recommend weak acceptance.