- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies world models that can update their internal state from information encountered online, without weight updates. To this end, the authors introduce SpikeWorld, a multimodal world model based on spiking neural networks. It maintains an external memory that is written to and read from at deployment time. The authors report clear improvements in prediction accuracy over the frozen base model when using this deployment-time memory. They also report prediction metrics and closed-loop control performance that match weight fine-tuning.
Critical strengths
- Interesting research question. How to use information obtained online to adapt a world model without weight updates is an interesting and timely research question.
Critical weaknesses
- Dense and often incomprehensible writing. Parts of the paper are extremely dense and technical and lack sufficient explanation. The following examples all come from a single paragraph of the introduction:
“Sensory streams predict the next spike-bearing slice”: spikes and “spike-bearing” have not been introduced at this point. Spike Transformer is mentioned in the preceding sentence, but no citation or explanation is given. Spiking neural networks, and why they are relevant here, should be introduced in a sentence or two. “action streams predict a later physical endpoint”: the paper does not explain what a “physical endpoint” is. “Controlled tests show that this predictive interface captures temporal organization beyond rate and order controls, predicts label-free future statistics better than random state, and supports bounded cross-modal composition”: the “rate and order controls” are not described, and it is unclear what “label-free future statistics” are. “Cross-modal composition” can be guessed, but “bounded” is again unclear in this context.
Similarly dense, cluttered sentences appear in several sections of the paper, and acronyms are used before they are introduced (e.g., “routed matrix RLS comparison”). This makes the paper very hard to parse and, in places, incomprehensible.
- Key parts of the method are underexplained. The method description is not detailed enough to judge the approach. Losses, key concepts and terminology are not properly introduced. Vague descriptions such as “the semantic head reads the present state” leave it unclear what the “state” of this model is. Is it, for example, a text description? In many places the reader is left to guess and fill in the gaps. As a result, I could not follow what the model actually does, and so I cannot verify whether the reported results support the paper’s claims. This is the main reason for my soundness and informativeness score.
Questions for authors
- Missing key motivation. Why is a spiking neural network the right tool for the task the authors consider?
- Unjustified constants in equations. Eqs. 3, 7 and 8 contain a factor of 1/39. It appears to be a common hyperparameter across these equations, but it is never introduced. Eq. 4 contains factors of 0.25 and 4. What is the justification or reasoning for these values?
- Undefined symbols. The loss in Eq. 4 contains , and , but none of these terms is introduced. What does each of them do? What are and in Eq. 6? Short natural-language descriptions of all quantities are crucial for understanding the method.
- Undefined key concepts. What are shear values? What are attenuation values?
- Byte counts. In several places, the paper computes and reports the size of matrices in bytes but does not explain why this is relevant. What does the byte count tell the reader?
Suggestions:
- Update low-quality figures. In Figures 1 and 2, labels overlap arrows and box outlines, and some labels extend beyond their boxes. Math symbols (e.g., h_t) are not typeset in math mode. Instead, both math and regular text use a Comic Sans-style font. Figure 1 in particular is not referenced in the text. What is it meant to contribute to the paper?