- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes S²-Memory, a sparse concept key-value memory system that requires no additional training. The system uses a pretrained text encoder to map sentences into a sparse representation in a predefined concept space, and retrieves information through the similarity between concept activation vectors. Through experiments, the authors mainly analyze how concept activation truncation, concept center collinearity, and different concept selection strategies affect retrieval performance. They also discuss the interpretability and storage cost of sparse concept representations.
Critical strengths
None
Critical weaknesses
- The authors fail to establish a clear and coherent research objective. The abstract, introduction, stated contributions, and subsequent sections lack clear logical connections and fail to establish a coherent research narrative. This paper reads more like a technical report that gradually debugs and analyzes an experimental system, rather than an academic paper with a coherent technical contribution. The current organization also makes it hard for readers to understand what problem the authors want to solve and what the most important contribution of the paper is.
- At the same time, S²-Memory is built from existing text encoding, sparse representation, and similarity retrieval techniques. The paper does not propose a new representation learning mechanism, retrieval algorithm, or training method, and it does not provide theoretical results with sufficient novelty. The experiments mainly provide empirical observations about existing techniques and their parameter choices, rather than offering substantial scientific insights.
Questions for authors
1.What is the core scientific question and the main technical contribution of this paper? 2. What is the substantive novelty of the proposed method compared with existing sparse retrieval and representation learning methods?
Dear Reviewer,
This is a kind reminder that the discussion period will end in less than 24 hours. We would appreciate it if you could take a moment to review authors' responses and provide any further comments before the discussion period closes.
Thank you for your time and effort!