- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents UniMind, a unified multi-task brain decoding framework that reformulates heterogeneous EEG decoding tasks as multimodal-language question-answering problems. The proposed framework integrates a pretrained EEG encoder with a Task-aware Query Selector (TQS), a Neuro-Language Connector (NLC), and an LLM-based autoregressive decoder. The TQS dynamically selects task-relevant spatial and temporal queries, while the NLC extracts and projects neural representations into the LLM embedding space.
The authors evaluate UniMind on ten EEG datasets spanning five task domains, reporting an average improvement of 8.94 percentage points in balanced accuracy over NeuroLM. Additional experiments demonstrate cross-dataset generalization on an unseen sleep dataset and explore the transfer of EEG-adapted language representations to intracortical spike decoding.
Critical strengths
- The paper addresses an important limitation of existing EEG foundation models: the reliance on separately optimized task-specific prediction heads. The proposed framework provides a coherent approach to heterogeneous neural decoding, supported by experiments across ten datasets and five task domains.
- Convincing empirical performance. UniMind consistently outperforms NeuroLM across all ten datasets and achieves competitive performance against task-specific methods. The comparison between individual and joint multi-task training further supports the effectiveness of shared representations across different EEG tasks.
- Reasonably comprehensive ablation studies. The authors investigate the contributions of TQS and NLC, the effects of different query configurations, and the comparison with contrastive EEG-text alignment. These experiments provide useful evidence supporting the architectural design choices.
- Encouraging generalization results. The evaluation on the unseen SHHS dataset provides additional evidence for cross-dataset transfer. The extension to intracortical decoding is also an interesting attempt to investigate whether the learned representation space can benefit other neural recording modalities.
Critical weaknesses
- The evidence for cross-modality transfer is still preliminary. The intracortical experiments are conducted using recordings from a single non-human primate, and the improvements are not consistent across the two tasks. I know that non-human data is hard to access. In particular, performance decreases on center-out reaching. Furthermore, the auxiliary language modeling loss predicts the reaching task category, so it would be useful to compare against a conventional auxiliary task-classification objective to better isolate the contribution of the EEG-adapted LLM representation space.
- Missing Visual Language Model (VLM) Baselines. The paper evaluates UniMind on several clinically relevant EEG benchmarks, including TUEV, TUSL, and TUAB, where discriminative information is often directly observable from conventional EEG waveform visualizations. However, the experimental comparison does not include VLM-based approaches that interpret EEG signals through rendered waveform images. Given the recent progress of VLMs in visual pattern recognition, it would be valuable to compare UniMind against a strong pretrained VLM (e.g., Qwen3-VL) using standardized multichannel EEG visualizations under the same evaluation protocols. Such a comparison would help determine whether the proposed neural-language alignment framework offers advantages over directly leveraging the visual understanding capabilities of existing multimodal LLMs [1].
[1] Pan, J., Wang, Y., Zhang, E., Lu, B., Zheng, W., & Li, D. (2026). Visualizing the Invisible: Generative Visual Grounding Empowers Universal EEG Understanding in MLLMs. ArXiv, abs/2605.18172.
Questions for authors
See weaknesses. Problem2 is not a neccessity but I am glad to see a comparsion on at least TUEV.
Thank you for your additional experiments. I'm not sure why the other reviewers didn't follow up, but I'd like to express my concerns. Essentially, I am quite skeptical as to why EEG-LLM uses auxiliary loss rather than model weights (distillation learning or fine-tuning) to assist in spike decoding? Just using an auxiliary loss method is too indirect. Could it lack scientificity? I still believe that the conclusion of this transfer decoding task is not very reliable. The amount of data in the downstream dataset is too small, which makes it prone to overfitting. Moreover, I think "our claim that the EEG-adapted LLM provides auxiliary supervision for spike decoding does not depend on a specific data format," if this supervision does not depend on a specific data format, then it actually requires evidence to support it, rather than simply drawing this conclusion based on a downstream dataset. I suggest that the authors do not consider this transfer decoding as the main contribution, unless it has been fully verified.
In addition, the multi-task performance is good. It is necessary to check whether the parameter quantities are matched. If it is only because the number of trainable parameters is larger during multi-task fine-tuning, then the performance comparison of multi-task is actually unfair.