- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper extends a new variant of Vector Symbolic Architectures (VSAs), which store and process symbols (e.g., by means of a binding operation that acts as group multiplication) in a distributed vector representation format. The paper proposes Helical Reduced Representations (HeRR), a non-compact group Z. Binding is implemented as polynomial multiplication. Synthetic experimental results with random and correlated codebooks show better recall performance compared to the previous variants of VSAs.
Critical strengths
Proposing a VSA on the non-compact group Z, providing extra capacity budgets.
Critical weaknesses
-
The paper has barely touched on the crosstalk noise and its consequences. For practical use cases of VSA inside neural networks where codebooks and exact recovery methods are not typically available/applicable, the crosstalk noise is the dominant factor. The cosine similarity sharply drops with 1/sqrt(K), independent of D. Could HeRR binding provide any improvement here?
-
On reducing the crosstalk effect, the state-of-the- art factorizers for distributed sparse block codes are missing (https://journals.sagepub.com/doi/10.3233/NAI-240713)
-
What is the computational and memory complexity of the proposed decoders? How does it compare with prior decoders?
-
The text of the paper seems to be heavily written by AI. Its language needs refinement to be more readable for humans.
Questions for authors
The paper is currently missing real-world experimental results to clarify its significance (if any). Here are some domains in which HeRR can be benchmarked against other VSA variants:
-
On abductive reasoning tasks, e.g., for solving Raven's progressive matrices (https://www.nature.com/articles/s42256-023-00630-8). The current reasoner is based on FHRR and fractional power encoding and runs in real time on CPU. It could be great to apply HeRR in this reasoner and cross-compare the quality and speed as well.
-
Neural network tasks like eXtreme multi-label classification (https://arxiv.org/pdf/2109.02157), which at that time was difficult for HRR. How does HeRR compare here?