- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
- This paper proposes PrimateAlign, a unified framework for cross-species visual decoding and neural translation between human EEG and macaque MUA signals.
- The framework employs modality-specific neural encoders and shared visual representations, combining global semantic alignment with dense token-level matching through MaxSim and soft-target contrastive learning. It further introduces cross-species latent alignment and conditional decoders for bidirectional neural signal translation.
- Experiments on THINGS-EEG2 and THINGS-TVSD demonstrate improved zero-shot image retrieval, achieving 85.9% and 96.4% Top-1 accuracy, respectively. Additional experiments evaluate cross-species neural retrieval and translation, supported by component-wise ablations.
Critical strengths
- The paper addresses the underexplored problem of aligning human EEG and macaque MUA within a unified representation space. Extending neural decoding beyond individual species and enabling bidirectional neural translation introduces a potentially valuable research direction for computational neuroscience.
- PrimateAlign demonstrates substantial improvements in visual retrieval, particularly on macaque MUA, while achieving promising cross-species retrieval accuracy on unseen stimuli. The ablation studies further support the effectiveness of dense alignment and explicit cross-species coupling.
Critical weaknesses
- The cross-species experiments primarily compare against relatively simple PCA-based baselines, which may not adequately establish the advantages of the proposed framework. Furthermore, the modest signal correlations, particularly for human-to-macaque translation, leave uncertainty about whether the model captures meaningful neural dynamics beyond shared stimulus semantics.
- The framework largely integrates established components, including Mamba encoders, MaxSim matching, soft-target contrastive learning, and latent alignment. Although the ablations demonstrate component effectiveness, they do not sufficiently isolate the contributions of individual cross-species objectives or distinguish architectural gains from those arising from joint training and additional supervision.
Questions for authors
- Can the authors compare PrimateAlign against stronger cross-modal alignment methods trained with equivalent visual supervision to demonstrate that the observed improvements originate from the proposed cross-species learning mechanism?
- How do the authors interpret the relatively low Pearson correlation in human-to-macaque translation? Can they provide additional evidence that the reconstructed signals preserve meaningful neural dynamics rather than primarily stimulus-dependent statistical patterns?
- Can the authors separately ablate cross-species latent alignment and translation supervision to quantify their individual contributions to neural retrieval, signal translation, and within-species decoding?