- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper is proposing a unified framework designed to process heterogeneous invasive spike signals by: 1- Reconstructing masked spike tokens through a Context-conditioned Spatio-temporal Tokenization (CST) module to handle dataset variance across species, subjects, tasks, and sessions. 2- Capturing the spatio-temporal dependencies across local intervals and spatial brain areas using the Interval-Area Attention (IAA) block. 3- Capturing the general neural representations from unlabeled heterogeneous data byself-supervised masked spike reconstruction.
Critical strengths
The proposed framework was evaluated across various datasets for both classification and regression tasks. Additionally, extensive experiments were conducted to benchmark the approach against existing baseline methods. The results demonstrate that the model maintains high efficiency with a compact architecture, making it suitable for real-time applications.
Critical weaknesses
Mismatching in the dimension in the method equations which make it difficult to follow.
Questions for authors
1- Specify the dimension of (or ): While element-wise broadcast addition () works for and against a 3D tensor of shape , is described in the text as outputting . The ordering of axes between () and () is flipped, causing dimension inconsistency.
2- Specify whether positional embeddings () are applied before or after interval partitioning, as applying global positional embeddings prior to local interval-area attention can over-constrain local temporal dynamics (Eq 5)
3- In area-wise sliding window attention (Eq 9) : is additive masking ( ) or multiplicative masking ( )?
(1) We thank the reviewer for pointing out the inconsistency in the tensor dimensions and axis ordering. We have corrected the notation of Xemb∈RTnorm×A×d and the corresponding token representation in the manuscript to use a consistent axis ordering. We have also clarified how the element-wise broadcast addition with Tpos∈RTnorm×1×d and Apos∈R1×A×d is performed, ensuring that the positional embeddings are added along their intended axes.
(2) We appreciate the reviewer's observation regarding the potential interaction between global positional embeddings and local interval-area attention. In our implementation, Tpos is applied before interval partitioning. We have clarified this operation order in the method description and revised Eq. (5) accordingly. This operation makes the relationship between global temporal positions and local interval-area attention explicit.
(3) Thank you for pointing out the ambiguity in Eq. (9). In our implementation, the sliding-window mask is additive. Specifically, invalid attention positions are assigned −∞ before the softmax operation. The binary mask M∈0,1 is for masking signal tokens.
We thank the reviewer again for these constructive comments. These revisions improve the mathematical precision and reproducibility of the method description.