- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
TSCU targets selective LLM unlearning, i.e., reducing access to designated knowledge while preserving other capabilities.
It uses topological differences to select layers, constrains low-rank interventions to forget-related subspaces, and trains with alignment and behavioral losses.
Experimental evaluation covers TOFU, RWKU, and WMDP.
Critical strengths
Selective forgetting is a meaningful problem because reducing target accuracy through general model damage would have little practical value. TSCU reports a strong trade-off: on Qwen WMDP, Bio/Cyber accuracy falls to 26.1/25.9, while MMLU remains 67.5, compared with 71.8 originally. Neighboring-knowledge tests and component ablations add evidence that the intervention is more selective than aggressive forgetting baselines.
Critical weaknesses
-
The main unresolved issue is whether topology makes a substantive contribution beyond existing subspace methods. [1] already combines layer/feature selection, subspaces, and constrained unlearning. TSCU differs in its selector and alignment scheme, but removing topology-based selection does not establish an advantage over simpler selectors with the same intervention budget. If the current evidence cannot distinguish these alternatives, the missing support concerns the central novelty rather than presentation.
-
Claims of knowledge erasure are stronger than the evidence. Representation movement toward the training target is not independent confirmation of removal, although the reported query-variation tests do support reduced recoverability. This can be addressed by narrowing the claim to the deployed intervened model. Permanent erasure or a comprehensive new recovery study is not a condition for acceptance.
[1] Model Unlearning via Sparse Autoencoder Subspace Guided Projections
Questions for authors
-
What is the specific advance over SSPU, and what evidence shows that topology improves the forgetting–utility trade-off over simpler matched selectors? Please clarify what the “without TDA” control actually selects; existing evidence that isolates this contribution could change the recommendation.
-
Are the conclusions intended to claim permanent knowledge removal or reduced recoverability while interventions are active? Please align the claims with the existing recovery tests and explain the limitations.