- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The work put forward explores the intersection of exact machine unlearning and model composition. The paper outlines that sparse retraining archives enable exact catalog recovery, using sets of previously retrained models alongside the deletion subsets, to approximate the unlearned model for an arbitrary subset. Through theoretical analysis, the work introduces substantive bounds on the acquisition and precision required of the retraining archive to achieve guaranteed unlearning results. Finally, the theoretical claims are applied in empirical examples to observe the theorised results in deployed settings.
Overall this work presents an interesting delve into the combination of model composition and machine unlearning, offering evidence justifying further work in this area. However, the lack of clarity in presentation, confusing intention, and my concerns regarding the setting in which they place their analysis makes it difficult to recommend acceptance at this time. Given sufficient clarifications from the authors, I would be open to increasing my score.
Critical strengths
- The work appropriately backs up its theoretical claims with varied empirical measurements across a variety of data modalities and unlearning benchmarks including both visual and text-based tasks.
- The theoretical claims of the work, while difficult to read, are strong and provide an interesting insight into the intersection of machine unlearning and model composition - which motivates further exploration into this realm.
Critical weaknesses
- The intention and contribution of the paper is unclear, and difficult to follow. It was confusing and difficult to identify what exactly the authors were trying to present, propose, or analyse.
- While the main contribution the paper puts forward is the theoretical analysis and bounds - I struggle to find the practicality in the setting the authors have outlined particularly with reference to the existence and availability of this construction of the retraining archive in unlearning settings.
Questions for authors
- Can the authors outline justifications for studying this setting of the problem?