- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes PALMU for machine unlearning in one-round self-training. It updates the labeling classifier on retained data, regenerates pseudo-labels and acceptance decisions, and corrects the downstream classifier through Newton updates under fixed representations.
Critical strengths
- Considering the influence of deleted records on generated supervision is reasonable.
- The method combines pseudo-label regeneration and downstream correction coherently.
- The theoretical analysis and experiments support closer agreement with full retraining under fixed representations.
Critical weaknesses
- The motivation and formulation need clearer explanations, particularly the roles of the two classifiers, fixed representations, and replacement loss contributions.
- The method assumes that representations are independent of deletion-affected data. Its applicability is limited when deleted records also influence the encoder.
- The evaluation mainly establishes predictive agreement with retraining. Neither the forgetting score nor predictive total variation establishes that information about deleted records has been removed.
- Hyperparameter selection is described, but sensitivity analyses of the confidence threshold, pseudo-label weight, and regularization strengths are missing.
- Random deletion experiments do not sufficiently establish performance on imbalanced data or when deleted records contain unique characteristics.
- Some abbreviations are not defined at first use, and punctuation errors remain. Figure 1 also needs more consistent fonts and clearer spacing.
Questions for authors
- Can the authors better explain the roles of the two classifiers and how updating the labeling classifier reduces the influence of deleted records?
- Can PALMU handle deletion-affected representations and deletion of unique samples from imbalanced datasets?
- Can the authors provide stronger evidence of information removal beyond predictive agreement and the reported membership attack?
- Can the authors provide sensitivity analyses of the main hyperparameters?