- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
Fine-tuning a previously unlearned model can cause unlearned knowledge to resurface in the model. In this work, they study the geometry and curvature of the loss space to determine a bound on the number of fine-tuning steps an unlearned model can tolerate before the loss on the forget set falls below a designated threshold. This becomes a certified durable unlearning budget. Using the insights from the geometry of the loss space, the proposed method regularizes standard unlearning objectives to find unlearning solutions with favorable geometries and curvatures. To validate their approach, they compare their approach to other unlearning methods on standard unlearning benchmarks such as MUSE and TOFU.
Critical strengths
The emergence of unlearned information after subsequent fine-tuning is an important problem in the unlearning literature. The formalization of a durable unlearning budget is an interesting contribution. Studying how the loss curvature affects the "durability/persistence" of unlearning is an interesting perspective.
Critical weaknesses
The main table in the paper (Table 1) uses CB as the primary metric for comparing unlearning methods. CB estimates the budget using the curvature proxy, but it is unclear whether CB is a reliable estimate. In Table 6 in the appendix, the estimate (which I believe corresponds to CB) overestimates the certified budget by 1000s (ex. , ). Why not use the certified budget in the main table to allow for a proper comparison? I am not convinced I can trust CB as a metric. CB uses the curvature proxy as part of its calculation. In the ablations in Table 4, the curvature proxy of PLATEAU is 186, but in Table 6, the certified curvature is 802. Thus, CB differs greatly from the actual budget . Therefore, I do not know how to interpret the results in Table 1, Table 2, and Table 4, which all rely on the CB estimate and curvature proxy as the primary comparison metric. How is the curvature proxy computed or estimated? How do we know if it is reliable? Why is CB a reliable metric? Why aren't the ablations done with the certified curvature to properly understand how each component affects curvature and budget?
Computing (Equation 5) is extremely expensive, and this costly computation is not addressed in the paper. The appendix proposes an upper bound using a local and Hessian-Lipschitz , but these computations are expensive as well. How are these values being computed/estimated? What is the computational cost?
The Certified Durability Training (CDT) only minimizes a proxy for the curvature and radius. The solution from CDT is then checked to see if the budget is satisfied. Otherwise, CDT has to be run again. It is unclear how long this back-and-forth would take. Furthermore, certifying the budget can be expensive. How expensive is the certification procedure for the budget and the curvature?
In general, the computations of both the certified values and the estimated values are very unclear. Can you specify the procedures to compute each of the relevant certified and estimated values?
Questions for authors
See the questions in the Weaknesses section.