- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The authors introduce a new architecture which stores local and global representations inferred from training data. These stored representations serve as anchoring devices for predicting new data. This appears to help in the task of learning in low-data regimes.
Critical strengths
The results on table 3 suggest the authors have found a promising research direction.
Critical weaknesses
The presentation quality is not of a publishable standard. The paper lacks a coherent narrative structure. There should be a clear path from the problem introduction and motivation, current state of the problem, the paper’s contribution and claims, and evidence for those claims. Instead, the paper reads as an endless list of disjoint experiments with no clear takeaway for the reader. The writing style at the fine-grained level is extremely dense, difficult to parse, and often incoherent.
The writing quality suggests blatant mis-use of AI. I am not confident that the authors read their own manuscript before submission.
The results are underwhelming. Assuming the purpose is to show that the method (which is never explicitly stated as the contribution) does better on classification, the results in table (1) show that this method is beaten by ResNet-18. The results in table 3 are promising. But, why is ReseNet-18 not used there?
Dubious design decisions are not discussed My understanding is that the slots are filled with a FIFO queue of images. Does that mean during inference, the slots are taken up by whatever the last k images were seen during training? What are the consequences of just using the last k images you saw? Why not learn those memories in Hopfield fashion?
The Hopfield framing is misleading. The FIFO queue of slots does not reflect any sort of associative memory. The way in which the slots are used does not indicate an energy function, which the authors confer.
Questions for authors
I would not improve my score without a complete rewrite of the paper. I have expanded on my concerns with the writing below so that the authors may use this feedback in their next draft.
The poor structure of the paper is reflected in the abstract of the paper. The abstract is an endless list of passive research-coded phrases: “[We] experiment x”, “[we] investigate x”, “[we] examine x”, “the analysis …”. None of these statements constitute a contribution, claim, or a result. A contribution will begin with a phrase like "we introduce x". A claim has active phrasing like “x improves y”. If a number is included, that is a result which can be used to support the claim.
The method is explained in an flood of math without context or motivation. There is far too much shorthand and terms are used before they are defined.
Experimental setups and results are reported robotically while their motivation and consequences are under-discussed. Every question posed should have a clear answer. Instead of a conclusion, for some reason, every experimental subsection ends with disclaimers. Untethered disclaimers do not count as discussion.
The discussion and conclusion section contains neither a discussion nor a conclusion.
The authors use multi-syllabic phrases which are inappropriately stitched together into unwieldy sentences. I would advise against the authors using semi-colons in their next draft. Too much jargon is freely used without definition. Paragraphs contain unrelated sentences stacked on top of each other, rather than being complete modular blocks with singular arguments.
I would encourage the authors to write the first draft without any AI assistance.