- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper discusses the class-wise unlearning evaluation. Existing evaluation focuses on comparing classification accuracies with a retrained reference model, while authors claim that many unlearned methods still remain more forget-class recoverability than a totally retrained model. Authors propose a method from the logits layer to calibrate forget-class logits by using only remain-class data for auditing forget-class recoverability.
Critical strengths
- The paper emphasizes that recoverability should be evaluated relative to retain-only models. The motivation is clear, reasonable and of significance for unlearning topic.
- The study evaluates 16 unlearning configurations across multiple classes and seeds. The authors further examine utility-matched versus fully trained references, BatchNorm recalibration, and operating-point sensitivity. These analyses provide convincing evidence that excess recovery is widespread in the evaluated CIFAR-10 setting.
Critical weaknesses
-
The authors claim that an unlearned model exhibits greater recoverability than a retrained model. However, their discussion focuses primarily on the logits layer, with relatively little analysis or exploration of differences in feature distributions.
-
The retain-only references preserve a 10-way classification head despite receiving no positive training examples for the removed class. Consequently, the removed-class head is trained only through negative supervision, which may produce different score distributions from those of a standard 9-way retrained model. Since Woken Recall directly relies on this head, the observed excess recovery may partly reflect differences in classifier-head training rather than residual class information.
-
The audit distinguishes removed-class examples from retained classes but does not establish whether the recovered signal is specific to the removed-class or reflects a more general response to complete noise or OOD inputs. Comparisons with 9-way retrained backbones using feature probes, together with OOD controls, would help clarify the interpretation of the observed recovery gaps.
Questions for authors
Please refer to the above.
3 comments
Response to Reviewer 1vxb (2/2)
W3. Specificity to the removed class
Comment. The audit does not establish whether the recovered signal is specific to the removed class, or a general response to noise and OOD inputs. Comparisons with 9-way backbones and OOD controls would help.
Answer. The recovered signal is specific to the removed class. Unlearned models show no excess response to noise or OOD inputs. We establish this with new OOD controls, Gaussian noise inputs, and the 9-way backbones in W2. The first OOD set is SVHN [2]. The second is the CIFAR-100 classes that do not overlap with any CIFAR-10 class (5,500 images from 11 superclasses).
If the excess were a general response to unfamiliar inputs, unlearned models would also respond more to OOD images. We measured how well each model's score ranks removed-class images above OOD images (AUROC). We also measured recall at a threshold that holds the average false-positive rate on retained and OOD images at 5%.
| High-utility, saved, matched references | Woken gap (positive of 264) | Probe gap (positive of 264) |
|---|---|---|
| AUROC, removed class vs SVHN | +48.3 [44.8, 53.7] (260) | +4.7 [3.0, 8.0] (228) |
| AUROC, removed class vs CIFAR-100 OOD | +48.8 [40.3, 53.1] (264) | +7.7 [6.5, 9.1] (262) |
| Recall at OOD-aware threshold, SVHN | +56.1 [46.5, 74.4] (256) | +19.3 [12.9, 24.1] (248) |
| Recall at OOD-aware threshold, CIFAR-100 OOD | +56.55 [44.6, 76.4] (261) | +28.35 [24.0, 32.4] (263) |
Unlearned models rank removed-class images above OOD images far more reliably than matched references do, on both readouts. BN-recalibrated models give the same picture. Gaussian noise also gives no general response. It rarely crosses either threshold on unlearned models (median 3.0% for woken recall, 0.4% for the probe).
One more result supports the paper's main point. On SVHN, the calibrated woken threshold fires on about half of the images, for unlearned models (48.9%) and matched references (49.6%) alike. An absolute firing rate therefore says little. Recovery has to be read against a reference.
Proposed text (new Appendix D.8, with one sentence in Section 4.1).
We test class specificity with two OOD sets, SVHN and the CIFAR-100 classes with no CIFAR-10 counterpart. On both readouts, unlearned models rank removed-class images above OOD images more reliably than matched references (Appendix D.8). The excess is specific to the removed class.
We hope this clarification, together with the supporting evidence and corresponding manuscript revisions, satisfactorily addresses all aspects of your concern.
References
- Y. Gao, A. Unal, A. Rangamani, Z. Zhu. An Illusion of Unlearning? Assessing Machine Unlearning Through Internal Representations. AISTATS 2026. https://arxiv.org/abs/2604.08271
- Y. Netzer, T. Wang, A. Coates, A. Bissacco, B. Wu, A. Y. Ng. Reading Digits in Natural Images with Unsupervised Feature Learning. NIPS Workshop on Deep Learning and Unsupervised Feature Learning, 2011.
Gentle reminder for response: revised manuscript uploaded
Dear Reviewer,
The discussion period ends soon, so we wanted to follow up on our response. We ran both controls you suggested. The revised manuscript is uploaded, with all changes in blue. Each of your concerns has been addressed in the paper:
- Feature-level analysis: Section 4.6 and Appendix H
- Nine-way retain-only references: Appendix D.7
- OOD and noise controls for class specificity: Appendix D.8
We would be grateful to hear whether this resolves your concerns. If it does, we hope you will consider updating your score. We are happy to answer any further questions.
Sincerely, The Authors
Response to Reviewer 1vxb (1/2)
Thank you for the constructive review and for the specific controls you suggested. We ran both of them, and have reported the findings below. Gaps are medians in percentage points. 95% bootstrap CIs resample removed classes or (method, class) cells, as in Appendix D.3.
W1. Feature-level analysis
Comment. The discussion focuses on the logits layer, with relatively little analysis of feature distributions.
Answer. The discussion covers both the logits layer and the feature distributions. The paper already has a feature-level readout, the frozen-feature probe in Section 3 (“Supervised feature recovery”), which may be easy to miss there. To further expand the analysis of feature distributions, this response adds three new analyses (listed at the end of this answer). The probe fits a logistic classifier on the frozen features of each model. It is compared with the same matched retain-only references as woken recall. All main results report both readouts.
The two readouts answer different questions. Woken recall asks what the released head still encodes, which one scalar can restore. The probe asks what a newly fitted linear classifier can extract from the features, as in [1]. Each is compared with its own matched reference, so together they can better show where the excess sits.
CF-k fine-tunes the last layers on retained data. Its head resembles the reference, while its features keep the class. SalUn shows the reverse.
W2 compares the features of 9-way and 10-way retain-only models. W3 tests whether the feature-level signal is specific to the removed class. In multi-class forgetting, the probe gap is positive in all 120 high-utility rows (median +11.05, 95% CI [8.35, 12.7]).
Proposed text (Section 4.6, after "Woken recall reads existing classifier scores; a feature probe asks a different question after fitting a new readout.").
W2. The 10-way head of the retain-only references
Comment. The retain-only references keep a 10-way head, so the removed-class row is trained only through negative supervision. Its scores may differ from those of a standard 9-way retrained model. Since woken recall relies on this head, the excess may reflect how the head was trained.
Answer. The excess does not reflect how the head was trained. The matched retain-only references keep the same 10-way head. So the removed-class row gets the same negative supervision in the unlearned model and in its reference. We kept the 10-way head for two reasons.
We also report results with 9-way retain-only references, as you suggest. The probe does not use the head, so 9-way references test it directly. We trained 9-way retain-only models for all 10 classes with 3 seeds each, using the same recipe and the same checkpoint epochs as the 10-way references. This gives 30 new training runs and 870 checkpoints. Fully trained 9-way and 10-way references reach the same retain accuracy (95.1% for both).
The head choice leaves the features unchanged. Against 9-way references, the probe gaps stay the same, and no high-utility row changes sign. Across all saved rows with both references, 2 of 362 change sign, and both are UNSIR.
Proposed text (Section 3, "Models and fixed configurations", after the sentence on the removed output).