- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes CINDER, a meta-unlearning method designed to resist subsequent relearning. During training, CINDER simulates a full-parameter fine-tuning attack on one half of the forget facts and penalizes recovery on the held-out half relative to a retain-only twin. Experiments on synthetic entity-QA corpora show that its post-attack recovery is non-inferior to the twin and substantially lower than NPO across both headline and fresh seeds. Additional evaluations cover multiple recovery attacks, objective ablations, model scales, and limited experiments on TOFU and MUSE, although non-inferiority is not established for circuit removal or retained utility.
Critical strengths
-
CINDER introduces a clear and meaningful objective for relearning resistance by directly simulating a full-parameter attack and comparing recovery with a retain-only model that never observed the forget data.
-
The evaluation is unusually transparent and thorough, with multiple corpus seeds, a separate set of fresh seeds, extensive ablations, held-out attacks, multi-axis testing, and detailed reporting of negative results and failed configurations.
Critical weaknesses
i) Although the twin is presented as a reference for calibrated forgetting, CINDER does not consistently stop once the forget-set likelihood reaches the twin level. At 0.5B, the final forget log-probability is on average 1.08 nats below the twin, and this gap grows to 6.7 nats in the 5% forgetting experiment. The ablation results further show that preventing this overshoot substantially reduces relearning resistance: using a fixed coefficient or stopping at the twin boundary decreases the number of passed relearning tests from 15/16 to 10/16 and the number of certified cases from 8/16 to 1/16. This suggests that the strongest results may come from aggressive suppression rather than the proposed twin-matching principle.
Such suppression does not necessarily mean that the underlying information has been removed. Prior work shows that apparently forgotten knowledge can return after benign relearning [a] and may remain recoverable from internal representations even when output-level accuracy is low [b]. The paper should separate the benefit of twin guidance from the benefit of pushing the forget examples farther below their original likelihood, and should report the resulting effect on semantically related knowledge and downstream utility. This is particularly important because the larger-model experiments already show unstable utility and retention, including rejection of all six utility tests at 1.5B.
ii) Most of the evidence comes from Qwen2.5-0.5B on a synthetic entity-QA dataset in which the target facts are introduced during supervised fine-tuning. Because the retain-only twin shares the same pretrained base, this setting mainly tests whether CINDER can remove newly injected facts; it does not show whether the method can remove knowledge acquired during pretraining. This distinction matters because unlearning methods evaluated on fine-tuning data can appear successful while pretrained information remains recoverable [c]. The TOFU and MUSE experiments provide some additional evidence, but each uses only one seed and covers a limited subset of the available evaluation dimensions. On TOFU, the mean truth ratio also falls to 25.7 compared with 1.04 for the twin, again indicating substantial over-forgetting rather than close behavioral matching.
Scalability is also not demonstrated experimentally. Both the inner and outer optimization loops update full model parameters, and the estimated memory requirement increases from 12.9 GB at 0.5B to 199.4 GB at 7B. The main 0.5B experiments are also substantially slower than NPO and, on the reported testbed, even slower than retraining the retain-only twin. The 1.5B and 3B results show unstable utility, while the 7B setting is supported only by a memory estimate rather than an actual unlearning experiment. The paper should validate the method on larger pretrained models, naturally occurring knowledge, and multiple random seeds, while reporting end-to-end time and memory against exact retraining and other relearning-resistant baselines.
[a] Unlearning or Obfuscating? Jogging the Memory of Unlearned LLMs via Benign Relearning. ICLR 2025.
[b] An Illusion of Unlearning? Assessing Machine Unlearning Through Internal Representations. AISTATS 2026.
[c] Do Unlearning Methods Remove Information from Language Model Weights? arXiv 2024.
Questions for authors
-
How much of CINDER’s relearning resistance comes from matching the retain-only twin, and how much comes from suppressing the forget-set likelihood below the twin? Can you report results under an enforced stopping rule that prevents this overshoot?
-
Does CINDER remain effective when the forgotten knowledge was acquired during pretraining rather than introduced through supervised fine-tuning? Can you provide multi-seed results on TOFU, MUSE, or another realistic benchmark?
-
What are the measured runtime, peak memory, and utility results on larger models such as 3B or 7B, and how do these costs compare with exact retraining and other relearning-resistant methods?