- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes NEXUS, an EEG-to-text framework which first retrieves semantic units and similar sentences from EEG, and then uses a frozen LLM to reconstruct text. The authors identify two sources of semantic ambiguity in unit retrieval: within and cross-sample ambiguity. They address them by separating shared contextual semantics from query-specific evidence and calibrating biased semantic matching.
Critical strengths
- The paper addresses EEG-to-text decoding, an important and challenging problem for non-invasive BCI.
- The experiments cover three datasets that span two languages (English and Chinese) and two paradigms (natural reading and imagined speech).
Critical weaknesses
- The writing of this paper is very poor and difficult to follow.
- Standard metrics such as BLEU and ROUGE are missing, which makes comparison with prior work difficult. The experiment does not compare with latest published EEG-to-text works, such as [1]. In addition, the paper shows no examples of decoded sentences. Together, these limitations make the reported decoding performance less convincing.
- The hubness calibration is similar to QB-Norm [2], which makes the contribution seem incremental. Please specify the differences. Besides, Its gain in retrieval accuracy is also marginal (Table 2(b)).
- The inference gallery appears to be dataset-wide. Could the retrieved sentences include the ground truth?
[1] Assembling the Mind’s Mosaic: Towards EEG Semantic Intent Decoding.
[2] Cross Modal Retrieval with Querybank Normalisation.
Questions for authors
Please see weaknesses.
3 comments
W3. Distinction from QB-Norm and effectiveness of hubness calibration We appreciate the reviewer's observation that QB-Norm [2] also addresses hubness in cross-modal retrieval. While both approaches share the motivation of reducing hub-dominated matching, NEXUS differs from QB-Norm in its optimization mechanism, calibration scope, and integration with semantic-unit learning.
(1) Post-hoc similarity normalization vs. training-time semantic optimization. QB-Norm is a retrieval-time normalization method that adjusts query-gallery similarity scores using a querybank, without modifying the learned representations or requiring model retraining.
In contrast, our NBI and WTI modules operate during training and directly influence the optimization of EEG Unit representations. Specifically, NEXUS minimizes a combined objective involving semantic-unit alignment and hubness-aware supervision. At inference, we use raw cosine similarity without any memory-dependent score correction, as explicitly described in Appendix D.3.
Thus, our method aims to improve the learned semantic matching behavior rather than applying a post-hoc correction to retrieval scores.
(2) Candidate-side correction vs. dual-sided calibration.
QB-Norm primarily addresses the tendency of certain gallery candidates to become hubs. NEXUS additionally considers the centrality of EEG queries themselves.
Our candidate-side NBI estimates the background affinity of semantic-key prototypes using a memory bank of training EEG queries. Unlike direct score normalization, this estimate is used to construct adaptive supervision targets over non-ground-truth neighbors, influencing how the Unit decoder learns to distinguish semantically ambiguous candidates.
Meanwhile, query-side WTI estimates the intra-modal centrality of EEG queries and adaptively reweights their semantic alignment losses. This addresses query-dependent susceptibility to ambiguous matching, which is not explicitly modeled by candidate-side normalization alone.
The two components therefore provide complementary training signals from both the candidate and query perspectives, rather than merely extending a querybank-based similarity correction.
(3) Interpreting the reported retrieval gains.
We agree that the improvement in Unit retrieval ranking is limited, and we would like to clarify the primary objective of hubness calibration.
As shown in the revised Table 2(b), NBI+WTI reduces CR10 from 93.53% to 82.56% and increases the effective number of retrieved candidates from 4.90 to 8.82 compared with anchor-only training. These changes indicate substantially less concentration of erroneous matches among a small number of hub candidates.
At the same time, Unit MRR changes from 0.06585 to 0.06272, revealing a modest trade-off between hubness reduction and local retrieval ranking. We do not claim that hubness calibration universally improves MRR; rather, its purpose is to mitigate systematic cross-sample overmatching that conventional alignment objectives do not explicitly address. Furthermore, the overall novelty of NEXUS does not rest solely on hubness calibration. Our framework identifies and jointly addresses two distinct sources of semantic ambiguity: within-sample context-induced query convergence and cross-sample hubness-induced overmatching.
As shown in Table 2(a), shared-residual supervision reduces query cosine similarity from 0.99996 to 0.30178 and increases effective rank from 1.00044 to 2.66065, demonstrating substantially improved within-sample semantic differentiation. Taken together, these components constitute a unified semantic disambiguation framework for EEG-to-text reconstruction, rather than a direct application of QB-Norm.
W4. Inference gallery construction and additional verification against data leakage
We thank the reviewer for raising this important concern. We acknowledge that the original submission used a dataset-wide inference gallery, which could include held-out target sentences and contextualized Unit representations. Although the original pipeline incorporated safeguards against direct copying, we agree that the gallery construction required a stricter evaluation protocol.
We have therefore made substantive change to address this concern.
In the revised manuscript, both the sentence retrieval gallery and semantic-key prototype gallery are constructed exclusively from the training partition.
Specifically, the sentence gallery contains only training text embeddings, while semantic-key prototypes are constructed solely from training Unit annotations. Validation and test sentences, together with their contextualized Unit targets, are explicitly excluded from gallery construction.
The revised sentence/Unit gallery sizes are: • ZuCo1: 788 / 4,161 • ZuCo2: 515 / 2,675 • Chisco: 5,581 / 5,578
Furthermore, training, validation, and test partitions use disjoint text IDs. Ground-truth semantic keys that are absent from the training gallery are treated as unretrieved during evaluation, rather than being added from the test set.
These revisions remove the original concern that a ground-truth test sentence or its test-derived contextualized Unit representation could be retrieved directly from the inference gallery. The results in the revised manuscript are reported under this stricter protocol, as detailed in Appendix E.1 and F.1.
We thank the reviewer for the constructive feedback and for recognizing the importance of EEG-to-text decoding and the diversity of our experimental settings. We have carefully revisited the concerns and made substantive revisions, particularly to the inference gallery construction and evaluation protocol. We address the main points below.
W1. Presentation and clarity We acknowledge that the original presentation could be clearer. We will further reorganize the methodology to explicitly distinguish the three components of NEXUS: (1) within-sample disambiguation through shared-residual decomposition, (2) cross-sample disambiguation through centrality-aware Unit learning, and (3) compositional reconstruction using delexicalized structural priors. We will also make the training and inference protocols more explicit to clarify the purpose and interaction of each component.
W2. Evaluation metrics and comparison with recent EEG-to-text methods Regarding BLEU and ROUGE, we respectfully argue that lexical-overlap metrics are not well suited as primary measures of EEG-to-text semantic reconstruction.
Unlike conventional machine translation, EEG-to-text decoding attempts to reconstruct linguistic meaning from noisy, indirect neural measurements. EEG signals do not provide a deterministic encoding of the exact lexical realization of a sentence. Consequently, semantically faithful reconstructions may differ substantially from the reference in word choice, syntax, or expression. BLEU and ROUGE predominantly measure surface-level n-gram overlap. As a result, they can penalize semantically equivalent paraphrases while rewarding frequent lexical patterns that do not necessarily reflect the target-specific information encoded in EEG signals. This concern is especially relevant to our framework, which explicitly separates fine-grained semantic evidence from lexicalized sentence structures.
The limitations of lexical-overlap evaluation in EEG-to-text decoding have also been recognized in recent work, such as Escaping the BLEU Trap (Wang et al., 2026), which discusses how high-frequency lexical patterns can inflate conventional scores without establishing genuine signal-grounded semantic recovery.
To ensure comparability with existing methods, we already report BERTScore F1 under a consistent evaluation protocol. BERTScore evaluates contextual semantic similarity rather than relying solely on exact lexical matches, making it more closely aligned with our objective of semantic reconstruction. Importantly, NEXUS and the baselines are evaluated using the same BERTScore configuration and aggregation procedure within each dataset.
As reported in the revised Table 1, NEXUS achieves BERTScore F1 values of 0.8457, 0.8483, and 0.5882 on ZuCo1, ZuCo2, and Chisco, respectively, outperforming the evaluated baselines. We additionally report RSRA50 and Groundedness to assess target-specific semantic recovery and unsupported generated content, since semantic similarity alone cannot establish EEG grounding. We would also like to clarify that the reviewer's suggested work [1], Assembling the Mind's Mosaic: Towards EEG Semantic Intent Decoding, is already included as SID (Li et al., 2026) in our comparisons on all three datasets. Our evaluation uses a common scoring protocol, and the SID implementation employs the same text embedding model and generation backbone as NEXUS. We will explicitly identify SID by its full paper title to avoid further ambiguity.
Therefore, our metric selection is motivated by the need to distinguish semantic fidelity from superficial lexical similarity, rather than by the omission of conventional evaluation or relevant prior work.