- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes NULLs, an LLM architecture in which MLP neurons are partitioned into a shared backbone and a sink pool where each training source is assigned a deterministic sparse mask over the sink pool, so source-specific knowledge concentrates in sinks while shared knowledge accumulates in the backbone. Unlearning a source then requires only disabling/zeroing its mask at inference (no gradient updates or retained-data access). Experiments train 1B models on Wikipedia with ~6M articles, showing Sink-Off closely matches gold-standard retraining, resists relearning attacks that reverse NPO in <10 steps, and preserves downstream benchmark performance vs. a standard transformer (Table 1).
Critical strengths
- Performance matches the retraining gold standard at unprecedented source granularity. NULLs scales to ~6M independently controllable sources without linearly scaling parameters (via combinatorial masks), and Sink-Off tracks retraining's performance (Fig. 4), while post-hoc baselines (NPO & GA) degrade shared and target knowledge in tandem (Fig. 3). This shows that training-time design can resolve the entanglement problem that post-hoc unlearning structurally cannot.
- Robust removal where prior methods fail. NULLs with permanent removal matches retraining against fine-tuning relearning attacks (Fig. 7b), directly addressing the documented failure mode of most post-hoc unlearning methods.
Critical weaknesses
-
The core mechanism is inherited wholesale from Ghosal et al. (2025). The training is repurposed without modification. The delta is a granularity shift (sequences to sources). Whether this constitutes sufficient conceptual novelty is questionable. The paper also provides no mechanism guaranteeing shared/sink role separation; it is only validated in experiments. In general, this paper reads like an application of Ghosal et al. (2025).
-
Models are just 1B parameters. It is unclear whether this scales to larger models, which have much larger capacity for storing and memorizing source-specific knowledge. This is a critical limitation for real-world deployment.
Questions for authors
-
Figure 1 seems misleading as sinks actually overlap by using the combinatorial mask.
-
How does the training ensure that such a separation effectively achieve the knowledge disentanglement goal? The model could very well ignore these memorization sinks, right? Do you design any mechanism to avoid such a case?
-
The combinatorial mask leaves it questionable about the claim that the knowledge is actually disentangled. After permanent removal of source A, what is the change in Sink-On truth ratio for semantically adjacent sources B? In particular, for source pairs with maximal mask overlap, how much does B's article-specific recall degrade?
Figure 1
Thank you for pointing this out. Figure 1 is a schematic, and we draw each source's sink as a separate block for visual simplicity. As described in the caption and Section 3.2, each sink is implemented as a sparse mask over a shared sink pool, so masks of different sources partially overlap. The overlap is small by design: with 100 of 8,000 sinks per source, two masks share 1.25% of their sinks in expectation, and Section 4.3 (Figure 8) shows that unlearning stays close to retraining across all overlap ratios we test. We will add a sentence to the caption making this explicit.
Scaling
On scale
Thank you for raising this. We agree that we test only 1B-parameter models, as stated in Section 5. Our results do, however, separate the two ways scale could affect NULLs.
Disentanglement of Knowledge
As the combinatorial mask is assigned psuedo-randomly from the source identifier, so removal of a paricular source mask is not expected to have any specific effect of semantically related articles. This is in contrast to what is observed in gradient-based unlearning methods. In the facts we tested, removing a single source permanently matched preserved decreased the Truth Ratio on neighboring facts by 0.05 (reflecting a degradation of around 1%, still well above he backbone-only model). Our Harry Potter experiments also showed a similar trend, with loss on other C4 clusters increasing by just 0.6% when that cluster was deleted.
As we note in our response to other reviewers, permanent deletion with multiple sources can cause sink-specific information to be lost. On the other hand, our routing based deletion allows any number of sources to be deleted without harming other sources.