- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper is concerned with using "active forgetting" . The basic goal is to use more "explicit" mechanisms to determine what systems can forget.
Critical strengths
I the the paper makes a fine argument as to what is missing from existing approaches to "forgetting" and so does a good enough job of pointing out the research gap that it will address.
Actual technical proposal seems straightforward enough, and could likely be reproduced.
Experiments seem reasonably convincing in a quantitative sense, though it's hard to tell the extent to which the numbers I'm looking at actually represent the state-of-the-art for this task.
Critical weaknesses
I couldn't really understand the contribution from the abstract and intro (or the figure). I sort of understand what the problem is (see strengths) but I don't follow at all what is happening in the examples, or what the intellectual contribution will be toward solving it. If this isn't understandable from the abstract + intro, it'll limit the readership of the paper.
Hard to tell if results are SoTA. They seem more like "reasonable baselines" but it is hard to get a sense of the gap between this and high-performing bespoke systems for these same benchmarks. Perhaps this is ignorance on my part and could be addressed by the authors.
Technical contribution is fine though perhaps a bit incremental. I think in these days of LLM papers (which I'm not sure whether this is or not) and 50k+ submissions it can be hard to get excited about ideas that seem straightforward unless the results are very clear and the intellectual contribution more compelling.
Questions for authors
See weaknesses above.