- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes BEAT, a framework for EEG-based visual decoding that addresses the mismatch between visual and neural representations and the non-uniform distribution of temporal EEG information. It introduces a Brain-aligned Visual Encoder (BAE) to learn neural-compatible visual representations through multi-teacher distillation and contrastive learning, and an Adaptive Temporal Recalibration (ATR) module to emphasize informative EEG intervals. Experiments on THINGS-EEG and THINGS-MEG demonstrate competitive zero-shot visual decoding performance.
Critical strengths
-
The proposed BAE and ATR modules address two distinct challenges in EEG-based visual decoding. Their integration enables the simultaneous adaptation of visual representations and temporal EEG features, providing a coherent framework for cross-modal learning.
-
The authors provide extensive ablation studies across five EEG backbones, along with analyses of visual distillation, temporal attention, and representation dimensionality.
Critical weaknesses
-
Although BEAT combines multi-teacher distillation, cross-modal contrastive learning, and Transformer-based temporal modeling, these techniques are well established. The authors should clarify the methodological novelty beyond integrating existing components.
-
The claim that BAE learns brain-aligned visual representations is mainly supported by retrieval accuracy, UMAP, and PCA analyses, which do not directly establish neural consistency. The authors should provide stronger evidence to validate this claim.
-
Although BEAT achieves the best average performance, it underperforms some baselines on several subjects. The authors should analyze these inconsistencies, particularly in the inter-subject setting.
-
The authors should further analyze subject-level failure cases to identify the limitations of BEAT in cross-subject generalization.
Questions for authors
In addition to the concerns listed in the Weaknesses section, I have the following questions:
-
ATR independently models temporal dependencies within each EEG channel. The authors should clarify whether ignoring cross-channel interactions limits its ability to capture spatially distributed neural responses.
-
The contrastive and distillation losses are assigned equal weights. The authors should investigate how different loss weights affect decoding performance.