- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This work presents UnAct that is a gradient-free class-unlearning method by an iterative attenuating the most responsive connections in response to the forget samples. As presented and claimed by the authors, it needs no gradients, no labels or retain data samples.
Critical strengths
The draft is well-organized and easy to read. The proposed method is well presented, also some limitations are discussed.
Critical weaknesses
- There is no experiment regarding multi-class unlearning
- The related works do not include the most recent works. There are several recent works that are not discussed. So the list of baselines is very limited. It is not clear how the model performs compared to the SOTA.
- In Section 3.1, the authors mentioned that a model retrained from scratch on the retain set is ideal unlearning. What is ideal unlearning? In ideal class unlearning, we want the model performs random on forget classes. However, in retraining from scratch, due to the generalization ability of the model, it may not perform randomly on forget classes. That is exactly why forgetting most of the time, degrades the model's ability on the retain set.
- It is mentioned that just one training seed is used. My question is why is that so? At least in classifier unlearning it is very common to use several seeds and report averaged results. So several conclusions claimed in the paper are based on just 1 seed's results so they are not robust evidence.
- In section D in the appendix, it is mentioned that the hyperparameters are selected on test. So the results regarding that are biased!
- The authors mentioned that their method suppresses the forgot class and does not erase it. It means it is admitted that the information regarding the forget classes is still there in the model's parameters even after unlearning. Then they discussed the results of the membership inference attack. We know that the information is there, so even if some MIA methods fail, it still says nothing about the privacy! So having such experiments and showing that some MIAs failed so the model is secure is superficial.
Questions for authors
Please see critical weaknesses.
4 comments
Response to Reviewer FUjV (2/2)
Membership inference. We agree that a failed attack says nothing about privacy, and the paper draws no privacy conclusion from it. We report the attack because the SSD and LFSSD protocols do, and then set it aside: "every method drives it to at most 0.9% on ResNet-18, below the retrained models' rates, so we do not use it to rank them" (Section 4.2). Our evidence about what remains in the model comes from the tests you would favour, a linear probe (Table 9) and relearning (Appendix M), and on that basis we state that UnAct suppresses the class rather than erasing it. The revision states explicitly that the attack supports no privacy claim.
"What is ideal unlearning?" We use the standard oracle: the model retrained from scratch without the forget data (Section 3.1), following Cao & Yang (2015), Ginart et al. (2019), and the protocols of SSD, LFSSD, SalUn, and the gap-to-retraining metric we adopt (Jia et al., 2023; Fan et al., 2024). This represents the model that would exist had the data never been included, which is precisely what a deletion request asks for.
The reviewer raises a valid philosophical point: due to generalization, a retrained model may still have non-trivial performance on the forgotten class. This is correct and the community has discussed it. However, for class removal on our tasks, the retrained model achieves exactly 0.00% forget accuracy on every dataset (Table 2): it never predicts the forgotten class, because it was never trained to do so. This is not chance performance: it is the model routing those images to other classes, which is the correct behavior after a class deletion.
The reviewer's deeper point, that the retrained model oracle is imperfect as a philosophical definition of ideal forgetting, is an active discussion in the unlearning community and we agree it is worth acknowledging. The LFSSD authors make the same point about over-forgetting: a model pushed too far from the retrained reference is detectable precisely because it differs. We use the retrained model as oracle in that spirit, as the consensus standard, and supplement it with the diagnostics in Table 9 (where each method sends forgotten images) and Appendix M (relearning speed), which go beyond to characterize what the edit actually does to the model.
Recent related work and baselines. We agree Section 2 should cover more recent work and will extend it, including the closest training-free method we are aware of, Kodge et al. (Deep Unlearning, TMLR 2024), which also avoids gradients but uses retain samples that UnAct does not. Our comparison is restricted to methods that operate under the same access conditions (no retained data, no fine-tuning), which is why SSD and LFSSD are the baselines; both receive strictly more information than UnAct. Optimisation-based methods such as SCRUB and SalUn use labels, retained data or both. We will extend Section 2 to cover these and any further recent works in the revision. We are committed to ensuring the related work is current and the baselines are as strong as possible within our stated setting. If the reviewer has specific additional methods in mind that require neither retained data nor gradient steps at request time, we will continue to survey the recent literature and add any that fit our setting to the comparison in the revision.
A correction on our side. Prompted by Reviewer HrVt, we found that LFSSD's few-image collapse in our submission came from how its reference implementation batches importance: a uniform batch size on both the forget and training sides at the whole class, but only one small batch on the forget side at small . With per-image importance, as LFSSD's own paper defines it, LFSSD is safe from five images and within one point of UnAct on ResNet-18. We withdraw the claim that LFSSD collapses with few images and replace its results throughout.
SSD's few-image failure is confirmed as genuine under every batching and every threshold from 2 to 2000. No UnAct result changes. Full details are in the general response and the reply to Reviewer HrVt.
I thank the authors for their responses.
- Regarding the new expriment presented for different seed, the SSD results for CIFAR-10 and CIFAR-20 have large sd. Can author clarify why is that so?
- Also can authors comment why the experimental results do not include the common datasets such as TinyImageNet and backbones such as ResNet-50 and Swin-T?
- In addition, several recent works are not discussed. As example I can mention the following (there are more...):
- Zhai W et al. Nullify: Null-Space Activation Steering for Training-Free LLM Unlearning. InProceedings of the 2026 Conference on Empirical Methods in Natural Language Processing 2026 Oct (pp. 20213-20225).
- Dehghani Z et al. A universal source-free class unlearning framework via synthetic embeddings. Transactions on Machine Learning Research. 2026;2026.
- Qian C et al. pH-Strips for Selective Forgetting: A Blunt but Fast Diagnostic Baseline for Machine Unlearning. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2026 (pp. 3306-3315).
We thank the reviewer for the follow-up and the references.
Large SSD standard deviation. The standard deviation is over three independently trained models (the paper's and two new ones), using the gold-free gap defined in Appendix O.4. SSD works on the paper's model, but its selected threshold fails on 5 of the 30 new class–model pairs: on CIFAR-10, one class collapses (retain accuracy 24%) and three are left largely unforgotten (forget accuracy 47.5%, 49.3% and 91.1%); on CIFAR-20, one class keeps 10% forget accuracy. Sweeping α from 2 to 50 (λ = 1) on both new CIFAR-10 models shows why: SSD works only in a narrow α window that moves between trained models; re-tuning recovers one model, while on the other no single α works for all five classes. SSD therefore needs re-tuning for every trained model. UnAct's percentile and attenuation factor transfer without re-tuning (std 0.09 / 0.04 / 0.42; no failure). Per-model results are in Appendix O.4 (Table 22) of the revised PDF; we will add the per-α sweep in the final version.
Datasets and backbones. We used CIFAR-10/20/100 with ResNet-18 and ViT-B/16 to match the setting in which SSD, our main baseline, was evaluated. We agree that TinyImageNet, ResNet-50 and Swin-T would strengthen the paper and will state their absence as a limitation. UnAct's ResNet score applies unchanged to ResNet-50 (its classifier also reads globally pooled channels; the incoming parameters become the last bottleneck's final convolution and BatchNorm). Swin-T pools tokens instead of using a class token, so the transformer score needs an adaptation we have not yet tested. We will add TinyImageNet with ResNet-50 in the final version.
Related work. Thank you for these references. The revised PDF now discusses all three in Section 2 (and adds pH-Strips to Table 1), together with Kodge et al. (TMLR 2024), a gradient-free class-forgetting method.
pH-Strips (Qian et al., CVPR 2026): it is training-free, needs no retain set in its base form, works from a few forget samples, and edits the model's weights. It differs in how: it removes the forget concept's feature subspace from linear-layer weights in one closed-form step, whereas UnAct ranks units by the forget signal they send to the classifier and attenuates them over several re-scored rounds, with an edit size fixed by rank. Its authors present it as a diagnostic baseline, in line with our evaluation point in Section 4.2. Its code is public, and we will add a quantitative comparison in the final version. Dehghani et al. (TMLR 2026) make existing gradient-based class-unlearning methods source-free by running them on synthetic embeddings pseudo-labelled by the model. It needs no forget data but requires the label of the forget class and runs optimisation; UnAct uses a few unlabelled forget images and no optimisation. The two are complementary. Nullify (Zhai et al., EMNLP 2026; arXiv October 2026, after our submission) unlearns in LLMs by steering hidden states at inference time under a null-space constraint built from retained data, without changing the weights; UnAct edits the weights and reads no retained data.
Response to Reviewer FUjV (1/2)
Thank you for the detailed comments. Two of them identified real gaps, which we have closed with new experiments; three concern points that the submission already addresses, and we give the locations.
Single training seed. We agree this was a limitation, and we stated it in Section 5. We trained two further ResNet-18 models per dataset with different seeds and applied every method at its submitted configuration, with no re-tuning. The new models have no retrained references yet, so we report a gold-free gap (|retain-accuracy change from the original model| + forget accuracy), which differs from Δ by at most 0.82 on the 15 classes where both exist (0.35 on average).
UnAct's results carry over: across all 45 class-model pairs its worst forget accuracy is 3.0% and its worst retain-accuracy loss 1.1 points. LFSSD's also carry over. SSD's selected threshold fails on 5 of the 30 new pairs; on one new CIFAR-10 model re-tuning recovers it, on the other no single threshold in its range works for all five classes. We also redrew the forget images for the few-image experiments (four draws): with five images UnAct's Δ is 0.17±0.05, 0.89±0.10 and 1.33±0.06. We will add Δ against retrained references for the new models in the final version.
Hyperparameters selected on the test split. This is a fair criticism, which we had stated in Section 5 and Appendix D. We now select every method's configuration on a held-out half of the test set (fixed seed, saved before any run, never used in any reported evaluation) and report on the other half: UnAct 0.34 / 0.69 / 1.06, SSD 0.47 / 0.15 / 0.39, LFSSD 0.28 / 0.21 / 0.24. No conclusion changes. All methods stay within about one point of retraining, with the same ordering as Table 2. Six of the nine selected configurations are identical to the submitted ones; for the other three, Δ on the held-out half moves by at most 0.1. Swapping the halves, or using the retrain-free rule of Appendix D on the validation half, gives the same picture (all Δ between 0.15 and 1.23).
"No experiment regarding multi-class unlearning." We thank the reviewer for raising this. The paper includes multi-class experiments in two forms, which we summarize here as the pointer from the main text may not have been prominent enough.
Why UnAct is designed for one class per request. This is a principled design choice, not an oversight. UnAct's scoring assumes the forget images come from a single class: this is what allows it to identify class-specific units without retained data, labels, or gradients. Extending the scoring to multiple simultaneous classes in a principled way is a direction we identify for future work. We will make the pointer to these experiments more prominent in the main text of the revised paper.
(continued in 2/2)