- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper adds an explicit editable memory to small transformer model, that is trained on synthetic "causal-reasoning" tasks. The memory is a set of slots that store small pieces of a structure, eg graph edges, and a router decides which slot each input token goes to. The memory can be edited directly. One of findings is that editing the stored structure, eg flipping signs, doesn't change the model's answers (a negative result).
Critical strengths
none
Critical weaknesses
The paper is difficult to follow, there’s a lot of invented jargon. For example: 'evidence type' (Sec. 3.1, where the six categories are listed but not defined), 'library-mediated features', 'block-structured routing prior', 'library invariants', and so on. None of these is defined precisely. The paper never says how the payload fields enter the forward pass, or what ŷ is (probability, logit?). Basic setup is also missing -- what a synthetic world and a query look like, what the 'behavioral battery' is, what the held-out probe measures.
The main finding is not explained. In Sec. 5, the authors give two possible reasons of why edits do nothing, but neither is tested.
Questions for authors
none