- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies what successful LLM unlearning should mean beyond suppressing target answers. It proposes a specification combining indistinguishability across protected worlds with a shared admissible region of response distributions. WorldLeak measures residual risky behavior and deviations from admissible response proportions. Under the stated assumptions, bounds on this quantity imply indistinguishability at the chosen audit resolution. The paper also derives a unique closest behavior target under a WorldLeak budget. WorldRepair approximates this target through adaptive erasure and likelihood-based behavior correction under a retain constraint. Experiments on TOFU, MUSE News, and WMDP show reduced behavioral risk and cross-world distinguishability with competitive retained utility.
Critical strengths
-
The paper offers a compelling and precise account of the unlearning objective. I particularly appreciate the move beyond target-answer suppression to asking whether observable behavior still carries evidence of the protected information. The examples of indirect clues and shifted candidate preferences make this distinction concrete. Combining indistinguishability with admissibility also addresses the need to specify appropriate behavior after forgetting. This conceptual contribution substantially improves how the problem can be understood and evaluated, and is a central reason for my positive assessment.
-
The connection between theory, evaluation, and training is coherent and supported by convincing experiments. The shared admissible region provides a common reference for WorldLeak, an indistinguishability guarantee, and the projection target used by WorldRepair. The paired-world experiments are particularly valuable because the worlds are repaired independently without directly optimizing their discrepancy. In the TOFU audit, the reported mean per-seed maximum cross-world TV is 0.040, compared with 0.28 for the strongest baseline on this metric (Figure 5). The results across TOFU, MUSE News, and WMDP, together with the component ablations, provide persuasive evidence that the framework improves the measured behavior while maintaining competitive utility.
Critical weaknesses
- The practical coverage of the guarantee depends on the predefined behavior taxonomy and audit resolution. Similar distributions over a small number of behavior classes do not necessarily rule out distinguishable patterns within those classes, such as differences in wording or more subtle indirect clues. The paper explicitly recognizes this issue and gives an event-approximation term for extending label-level guarantees to full observations (Appendix A.6). However, the experiments do not establish a uniform bound on this term for unrestricted responses. Consequently, the empirical certification supports the specified audit channels, and the extent to which it captures richer forms of residual leakage remains uncertain. I view this as the main limitation on the scope of the contribution.
Questions for authors
Clarification of audit coverage: Beyond the admissible-region bound sensitivity study in Table 23, do you have evidence on whether the observed improvements remain stable when the behavior taxonomy is refined or the audit looks for distinguishing patterns within an admissible class? In particular, how should a practitioner assess whether the chosen resolution captures the residual leakage relevant to their application? This would help determine how broadly the reported certification and experimental gains can be interpreted.
3 comments
Thank you for the thoughtful response and the additional experiments. I appreciate the independent response-text classifier evaluation, particularly the results on the safe non-selection subset, which directly address my concern about potential distinguishability within predefined behavior classes.
While the theoretical guarantee necessarily remains dependent on the chosen audit resolution, I believe the new evidence and clarifications have satisfactorily addressed my concerns within the paper's stated scope.
I am satisfied with the response and will raise my positive rating to 4.
Thank you very much for your support and positive reassessment! We truly appreciate the time and care you put into reviewing our work and discussing it with us.
We are glad to have this constructive exchange. Thank you again for helping us improve the paper.
Thank you very much for your thoughtful review and positive assessment. We appreciate your recognition of our contribution and the connection between our theory, evaluation, and training method. Your questions on audit coverage help us add an experiment and clarify how users can choose the audit classes.
1. Additional evidence on audit coverage
To check for distinguishing patterns within classes, we added an independent classifier that predicts which world a response comes from using its text. We use a frozen
all-mpnet-base-v2encoder with logistic regression to predict world A or B from each response. Training and validation use separate batches of newly generated responses. For testing, we use 840 TOFU and 1,280 WMDP responses per method. We report balanced accuracy (BA) on all responses and the safe non-selection subset. The chance level is 50%.Several baselines also approach 50% within the safe subset, but their all-response BA remains above 60%, showing that their responses are still more distinguishable overall. For WorldRepair, this classifier's BA stays close to 50% on both the full response sets and the safe subsets. These results provide additional response-text evidence.
2. Choosing and checking the classes
Users should start with the information they need to protect. For example, when forgetting a person's hometown, the audit should distinguish directly naming the hometown from giving an indirect clue that narrows down its location. It can then separate uncertainty, helpful answers based on retained knowledge, and degenerate outputs according to the task's requirements.
To check whether the classes capture relevant leakage, users can inspect new responses within each class. When paired-world models are available, a response-text classifier can help detect remaining differences, as in our added experiment. If new clues are found, users can refine the classes and test them on another set of responses. The goal is to capture leakage relevant to the application.
Thank you again for your careful reading and constructive suggestions.