- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies targeted class unlearning in decentralized continual learning when historical training data are unavailable. The authors propose Dec-UnHNet, which uses a task-descriptor-conditioned hypernetwork to generate task-specific classifiers, allowing selective modification of the target task with limited interference. The method combines diffusion-model-derived class prototypes with synthetic-feature supervision and regularizes generated classifiers to preserve unaffected tasks; a convergence analysis and results on two benchmarks are reported.
Critical strengths
(1) The approach is well motivated. Generating separate classifiers from task descriptors and regularizing outputs for unaffected tasks directly constrains the mappings that should be preserved, which is a sensible way to let the shared hypernetwork handle unlearning while limiting collateral changes.
(2) The problem setting is relevant, and the initial results are promising. Across two datasets and two heterogeneous partitions, the method retains relatively strong accuracy on retained classes while driving target-class accuracy to zero after the evaluated unlearning requests.
Critical weaknesses
(1) The convergence guarantee is not established by the current proof. In Appendix B.2, replacing the stochastic local update direction with the exact gradient stack and expanding are explicitly left unjustified, and the final bound does not show that the full stationarity measure tends to zero; this conflicts with Corollary 1 (Eq. 17). The theoretical claim needs a complete justification or substantial qualification.
(2) The evaluation mainly shows that classifier predictions change, not that unlearning is effective beyond suppression. Tables 1–2 use zero target-class accuracy as the main evidence, but this cannot distinguish the method from simpler target-class suppression; Section 4.3 also states that the feature extractor is unchanged and only the deployed predictive mapping is modified. More evidence is needed within that scope.
(3) The contributions of the proposed unlearning components are not isolated. Dec-UnHNet already outperforms several baselines before unlearning (e.g., 69.68% vs. 55.95% for UG-CLU under Dir(λ = 0.5) in Table 1), so retained-accuracy gains cannot be cleanly attributed to the unlearning mechanism. Figure 2 only varies regularization coefficients and does not isolate diffusion-based prototypes, task descriptor modification, or surrogate feature optimization.
(4) The experiments do not directly validate the motivating decentralized scenario. The introduction stresses agents that learn about the target class through communication without local samples, but Tables 1–2 report aggregate results under two Dirichlet partitions without separating agents that originally observed the target class from those that only acquired its knowledge through communication; Appendix C.2 (Table 3) varies topologies but does not test this distinction.
Questions for authors
(1) Provide a mathematically valid justification for replacing the stochastic local update direction with the exact gradient stack and for the expansion in Appendix B.2. With nonvanishing terms in the final bound, explain exactly how Corollary 1 (Eq. 17) follows; otherwise the convergence claim must be withdrawn or substantially weakened.
(2) The current evaluation does not rule out simple target-class suppression. Add a class-suppression baseline and/or a reference model retrained without target data, and show how Section 6.2 distinguishes genuine unlearning from suppression.
(3) Given the initial-performance gap in Tables 1–2, you cannot attribute retained-accuracy improvements to the unlearning mechanism without controls. Provide controlled experiments or component ablations that isolate diffusion-based prototypes, task descriptor modification, and surrogate feature optimization.
(4) Directly evaluate agents that never observed the target class locally but acquired its knowledge through communication. Report separate before/after unlearning results for these agents and for agents that originally observed the target class, including the Appendix C.2 topology settings.