- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
- This paper proposes Sample-AdaptiVe Expert Routing (SAVER) for EEG-based visual decoding. Unlike existing methods that employ globally fixed visual alignment targets, SAVER dynamically selects visual representations conditioned on individual EEG embeddings.
- The method integrates multiple visual backbones, encoder layers, and image blur levels into an expert pool. Two EEG-conditioned routers adaptively aggregate these representations, while expert alignment and router guidance objectives improve representation learning and routing.
- Experiments on THINGS-EEG2 and THINGS-MEG demonstrate competitive improvements in zero-shot image retrieval across intra-subject, inter-subject, and cross-modality settings. Ablation studies further examine the contributions of adaptive routing and auxiliary objectives.
Critical strengths
- Well-motivated sample-adaptive alignment. The paper identifies an important limitation of globally fixed EEG-visual alignment targets and introduces a coherent framework for selecting representations according to individual neural responses. This provides a meaningful methodological extension to existing EEG visual decoding approaches.
- Strong empirical performance across evaluation settings. SAVER consistently improves retrieval accuracy over competitive baselines, particularly in the challenging inter-subject setting. The ablation studies also provide evidence that dynamic routing and auxiliary supervision contribute to the observed improvements.
Critical weaknesses
- Insufficient isolation of the benefits of adaptive routing. Although the ablations compare different routing schemes, the substantial gains introduced by router guidance make it difficult to determine how much improvement originates from genuinely sample-specific representation selection rather than additional supervision. More carefully controlled experiments are needed to substantiate the proposed mechanism.
- Limited evaluation of robustness and computational efficiency. The framework relies on 720 visual experts constructed from five pretrained backbones, introducing considerable representational and computational complexity. However, computational costs are not compared with competing methods. Moreover, the experiments use repetition-averaged neural signals and report mean accuracy over only three random seeds without uncertainty estimates, limiting the evidence for practical robustness and statistical reliability.
Questions for authors
- Can the authors provide additional controlled comparisons that isolate the contribution of EEG-conditioned routing from router guidance and increased model capacity, ideally under matched supervision and computational budgets?
- What are the training and inference costs of SAVER compared with the strongest baselines, particularly considering the 720 visual experts and query-dependent routing?
- How does SAVER perform on single-trial neural recordings rather than repetition-averaged signals? Can the authors also report standard deviations or confidence intervals to establish the reliability of the improvements?
Thank you for your response. Overall, I believe the experimental results of this paper are trustworthy. However, my concern is that, as this paper is already conducting exhaustive searches to find as many visual features as possible for bidirectional alignment with brain embeddings, technically, multi-model distillation or fusion itself can already achieve good alignment results. Therefore, MoE might be unnecessary. Switching to the same parameter quantity would still work, and this would weaken the technical contribution of this paper. By the way, the MLP baseline submitted by the author in the Rebuttal is too weak. I don't think it is a strong baseline, so it still cannot prove the capability of MoE. Additionally, I think the technical contribution of this paper is too weak. Even if the performance is good, this paper does not provide any new technical insights or scientific insights. MoE is not a new concept in the ML community. Even the method in this paper, due to blending multiple visual features together, may prevent the brain signals from reconstructing images, which also undermines the interpretability of this method. I welcome the author to further discuss with me.