- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Associative Dreamer adds an associative memory to a recurrent world model. A reader retrieves information from earlier observations to help predict the consequences of an action, and an alignment loss teaches it which historical evidence to recover. The experiments use three visual tasks in which earlier events determine later outcomes.
Critical strengths
- The history interventions are well designed: changing an earlier event while holding the current image and future actions fixed directly tests whether the model uses the relevant history, and disabling memory reads provides a complementary check.
- On Transport and Power, evidence alignment substantially improves performance over the same memory architecture trained with prediction losses alone, showing that adding memory does not by itself yield useful retrieval. The paper is also clear that evaluation uses the training support and known retrieval times, while correspondence supervision is used only in the training loss and does not enter prediction.
Critical weaknesses
- The experiments show that the memory path is used and that alignment improves over FW within the same fast-weight memory. They do not establish an advantage unique to the associative architecture over other memory designs. The paper acknowledges that this claim needs alternative-memory controls, but none are reported. A parameter-matched alternative—a compressed history buffer, for example, or attention over a learned summary—would help test whether the gain over the ordinary recurrent model reflects associative retrieval or access to more history.
Questions for authors
- Please compare the fast-weight memory with a parameter-matched alternative, such as a compressed history buffer or attention over a learned summary, trained with the same alignment loss.