- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies whole-brain fMRI prediction from EEG using a method called GLAFE. The main idea is to separate BOLD signals into global and local components. The authors use pretrained REVE to extract EEG features and ROI-specific cross-attention to predict local signals. They also use BrainLM for autoregressive correction based on previous fMRI predictions. The method is evaluated on three simultaneous EEG-fMRI datasets, covering resting-state, auditory-task, and neurofeedback data. The results show that GLAFE generally outperforms several baselines in BOLD prediction and functional connectivity reconstruction. The authors also provide ablation studies and attention map visualizations to analyze different components of the method. Overall, the paper combines global-local modeling, ROI-specific attention, and autoregressive correction for EEG-to-fMRI prediction, with experiments across different datasets and settings.
Critical strengths
- The global-local decomposition provides a reasonable way to separately model shared brain activity and ROI-specific fluctuations. I think this is an interesting design for EEG-to-fMRI prediction, especially when both temporal dynamics and functional connectivity need to be considered.
- The experimental evaluation is relatively comprehensive. The authors test GLAFE on three EEG-fMRI datasets covering resting-state, auditory tasks, and neurofeedback, rather than relying on a single dataset. They also consider different ROI parcellations, multiple subject-disjoint splits, and cross-dataset transfer, including zero-shot evaluation. I particularly appreciate the use of multiple subject splits, since simultaneous EEG-fMRI datasets usually contain relatively few subjects, and the results can be sensitive to how the data is divided. They also compare with NeuroBOLT, UnEBOLT, REVE, and BIOT.
Critical weaknesses
- My first concern is whether the reported results really reflect ROI-specific brain activity. Since BOLD signals contain a shared global component, predicting this component well may improve temporal R and partly explain the FC results. I wonder how GLAFE and the baselines would perform if the global signal were regressed out from both predictions and ground truth. This would help clarify how much local information the model actually recovers. Since the central claim is that GLAFE recovers ROI-specific dynamics and connectivity, this evaluation is necessary to support the main contribution.
- I also have some doubts about the contribution of the proposed components. In Section 5.1, removing the global-local decomposition reduces temporal R by 0.056 and FC R by 0.042. From Table 6, this gives approximately 0.393 and 0.477, which are actually lower than the fine-tuned REVE baseline. This makes me wonder whether the improvement mainly comes from the global-local decomposition rather than the more complex cross-attention and BrainLM modules. I would be interested to see how a simpler REVE model with the same decomposition performs. Also, the improvements over the strongest baselines are sometimes small. As a result, two of the three proposed components are not shown to outperform a simpler baseline in the authors’ own ablation, which makes the methodological contribution unclear.
Questions for authors
- I am particularly interested in how well GLAFE recovers the local component of fMRI signals. Since the global signal is shared across ROIs, it may contribute substantially to both temporal prediction and FC reconstruction. Could the authors report temporal R and FC metrics after removing the global component from both predicted and ground-truth fMRI, and evaluate all baselines in the same way? I think this would help clarify whether the improvements mainly come from recovering the shared global activity or the ROI-specific fluctuations. It would also be useful to compare with simple baselines, such as predicting only the global signal or using the average FC matrix from the training set.
- I find the global-local decomposition interesting, but the current ablation also changes the supervision and prediction targets. Could the authors clarify how much of the improvement comes from the decomposition itself rather than the additional local supervision or loss functions? Also, would the same improvement hold across different subject splits and ROI parcellations?
- The autoregressive correction uses pretrained BrainLM and previous fMRI predictions, but removing this module only decreases temporal R by 0.025 and FC R by 0.009. Have the authors compared it with a simpler temporal model or the same module without BrainLM pretraining? I wonder how much of the improvement comes from BOLD temporal autocorrelation rather than the pretrained representations. Also, the fine-tuned REVE baseline already achieves FC R = 0.500 at 64 ROIs, compared with 0.521 for GLAFE. This makes me curious about how much of GLAFE's advantage comes from the pretrained REVE features rather than the proposed components.
- The FC losses are calculated using only 20 TRs per patch, even when there are 128 or 256 ROIs. Could the authors explain how reliable these short-window FC estimates are? Would using longer windows for the FC loss, while keeping the BrainLM patch structure unchanged, affect the results?
- I find the ROI-EEG attention maps in Figure 4 interesting, especially the HRF-like temporal pattern. However, I wonder whether the attention scores really reflect the importance of individual electrodes. Have the authors considered masking high-attention and low-attention electrodes at inference time to see how much the prediction performance changes?
5 comments
Q3. The autoregressive correction uses pretrained BrainLM and previous fMRI predictions, but removing this module only decreases temporal R by 0.025 and FC R by 0.009. Have the authors compared it with a simpler temporal model or the same module without BrainLM pretraining? I wonder how much of the improvement comes from BOLD temporal autocorrelation rather than the pretrained representations. Also, the fine-tuned REVE baseline already achieves FC R = 0.500 at 64 ROIs, compared with 0.521 for GLAFE. This makes me curious about how much of GLAFE's advantage comes from the pretrained REVE features rather than the proposed components.
We have expanded the autoregression-removal ablation to all three atlas sizes and subject splits (Appendix B). Full GLAFE achieves higher full-signal and local temporal R at every atlas size, averaged over splits. Moreover, neither causal moving-average nor Gaussian smoothing on the ablated model’s predictions recover the autoregression removal decrease in full and local temporal R (Tables 4-5).
Following the reviewer’s suggestion, we also compared pretrained and randomly initialized BrainLM. The following table shows the relative change when replacing pretrained weights with random initialization.
| Atlas size (ROIs) | Temporal R ↑ | FC R ↑ | FC MSE ↓ |
|---|---|---|---|
| 64 | +0.02% | -0.14% | +0.92% |
| 128 | -0.09% | -0.26% | -0.91% |
| 256 | -0.22% | +0.51% | +0.62% |
The results show no consistent advantage to pretrained initialization, suggesting the correction architecture can achieve comparable performance under the same training without the pretrained checkpoints. Pretraining improved performance in our early experiments, but the correction mechanism has changed substantially since, and we thank the reviewer for prompting us to revisit this assumption. We are currently conducting further experiments to assess the finding’s robustness, and will update the explanatory claims accordingly in the final paper.
Regarding the contribution of the pretrained REVE features, GLAFE improves on fine-tuned REVE in 8/9 comparisons (Table 1), including 10.2–11.2% higher full signal temporal R and 20.9–33.9% higher local temporal R across all atlas sizes. Moreover, these temporal gains are statistically significant (p<0.05) across all atlas sizes (Appendix F). REVE provides strong EEG features and competitive FC reconstruction. However, GLAFE’s central objective is to reconstruct whole-brain fMRI time series while preserving correct connectivity. GLAFE’s temporal advantage shows that it is significantly better at this task, while still improving on FC reconstruction.
Q4. The FC losses are calculated using only 20 TRs per patch, even when there are 128 or 256 ROIs. Could the authors explain how reliable these short-window FC estimates are? Would using longer windows for the FC loss, while keeping the BrainLM patch structure unchanged, affect the results?
We thank the reviewer for highlighting an error in Appendix B.2, now corrected: Stage-2 FC losses use two concatenated patches (40 TRs), while Stage-1 uses 20 TRs. BrainLM’s patch structure remains 20 TRs throughout. We selected these horizons empirically to balance the trade-off between FC-estimate stability and sampling diversity, both subject to computational constraints.
Following the reviewer’s suggestion, we evaluated a version of GLAFE with 60-TR FC-loss horizons in both stages, retaining BrainLM’s structure. The three-split averages below show improved FC metrics but substantially lower temporal R at 128 and 256 ROIs, illustrating a trade-off between temporal and connectivity fidelity.
| Atlas size (ROIs) | Model | Temporal R ↑ | FC R ↑ | FC MSE ↓ |
|---|---|---|---|---|
| 64 | Full GLAFE | 0.352 ± 0.142 | 0.521 ± 0.116 | 0.111 ± 0.064 |
| 64 | 60-TR horizon | 0.353 ± 0.146 | 0.512 ± 0.122 | 0.157 ± 0.068 |
| 128 | Full GLAFE | 0.341 ± 0.136 | 0.520 ± 0.117 | 0.141 ± 0.071 |
| 128 | 60-TR horizon | 0.277 ± 0.114 | 0.525 ± 0.112 | 0.099 ± 0.056 |
| 256 | Full GLAFE | 0.303 ± 0.130 | 0.562 ± 0.102 | 0.169 ± 0.064 |
| 256 | 60-TR horizon | 0.268 ± 0.124 | 0.569 ± 0.118 | 0.144 ± 0.048 |
Q5. I find the ROI-EEG attention maps in Figure 4 interesting, especially the HRF-like temporal pattern. However, I wonder whether the attention scores really reflect the importance of individual electrodes. Have the authors considered masking high-attention and low-attention electrodes at inference time to see how much the prediction performance changes?
We thank the reviewer for this suggestion. As a proof of concept, we conducted an exploratory inference-time electrode-selection experiment on the NeuroBOLT resting state dataset for one split at 64 ROIs. For each ROI, we retained only three of the 26 electrodes, selected using the electrodes attention scores from GLAFE’s spatio-temporal block. We compared the highest- and lowest-scoring eligble electrode triplets against five random triplets, applying spatial-separation and signal-correlation constraints to account for redudancy between electrodes.
For each inference run, predictions were evaluated for the ROI corresponding to the retained electrodes. We used the pretrained checkpoint from Table 1, without retraining. The following table shows the change in metrics beween the top and bottom triplets compared to the average result on the random triplets.
| Selection vs. random | Full temporal R change | Global temporal R change | Local temporal R change |
|---|---|---|---|
| Top-ranked | −4.53 ± 3.76% | −4.59 ± 4.02% | +9.43 ± 18.97% |
| Bottom-ranked | −5.08 ± 2.80% | −4.42 ± 3.31% | −1.07 ± 41.22% |
Retaining top-ranked electrodes increased local temporal R by 9.43% relative to random selection, whereas bottom-ranked electrodes decreased local temporal R by 1.07%. Both selections performed worse than random on the global and full signals, possibly due to the need for large variation in the EEG signal to reconstruct the global signal.
We thank the reviewer for their time, effort and insights. We address each of the weaknesses and questions as follows.
W1. My first concern is whether the reported results really reflect ROI-specific brain activity… I wonder how GLAFE and the baselines would perform if the global signal were regressed out from both predictions and ground truth… Since the central claim is that GLAFE recovers ROI-specific dynamics and connectivity, this evaluation is necessary to support the main contribution.
We evaluated all methods after regressing out the global signal from predicted and ground-truth ROI time series separately. GLAFE’s predictions of the local component consistently outperform all four baselines across all atlas sizes and evaluation metrics (temporal R, FC R, FC MSE). Its advantage therefore persists after removing the shared global component. Detailed global and local results appear in Tables 2, 10 and 11.
W2. I also have some doubts about the contribution of the proposed components… This makes me wonder whether the improvement mainly comes from the global-local decomposition rather than the more complex cross-attention and BrainLM modules. I would be interested to see how a simpler REVE model with the same decomposition performs…
We conducted a comprehensive ablation study, showing the contribution of each component. Following the reviewer’s suggestion, we evaluated a simpler model, retaining the global-local decomposition and REVE features, while replacing the cross-attention with a simple MLP and removing the autoregression correction module (Appendix B).
Compared to the ablated model, GLAFE achieves higher temporal R and FC MSE, alongside higher temporal R for both the local and global signal components separately. These results indicate that the cross-attention and autoregression mechanisms have a real contribution beyond the global-local decomposition.
Q1. I am particularly interested in how well GLAFE recovers the local component of fMRI signals… Could the authors report temporal R and FC metrics after removing the global component from both predicted and ground-truth fMRI, and evaluate all baselines in the same way… It would also be useful to compare with simple baselines, such as predicting only the global signal or using the average FC matrix from the training set.
As discussed in W1 above, GLAFE outperforms all baselines in the reconstruction of the local signals in both temporal and FC metrics. We further evaluated the two suggested heuristic baselines: a global signal-only baseline and a training-set population-average FC matrix (Table 9 Appendix D). Compared to the global signal alone, GLAFE’s full predictions achieve higher temporal R at every atlas size. This suggests that although the global component is the main driver of the dynamics, GLAFE can reconstruct local temporal information. Moreover, the global signal baseline naturally fails to reconstruct any connectivity pattern.
The population-average FC baseline achieves better FC metrics (FC R, FC MSE) than all prediction models, reflecting the substantial connectivity structure shared across individuals. However, predicting a static FC matrix is a considerably simpler task than reconstructing correlated time series that preserve such structure. Furthermore, To test whether GLAFE captures individual information beyond shared connectivity, we compared the FC R between predicted scans and their ground truth scans, to the FC R between the predicted scans and other subjects’ scans. Correlation with the corresponding scan was 10.87% higher on average, supporting the presence of individual information in GLAFE’s predictions beyond population average. See W4 in our comment to reviewer TVaj05.
Q2. I find the global-local decomposition interesting, but the current ablation also changes the supervision and prediction targets. Could the authors clarify how much of the improvement comes from the decomposition itself rather than the additional local supervision or loss functions? Also, would the same improvement hold across different subject splits and ROI parcellations?
We thank the reviewer for this clarification. We designed a new ablation, replacing the decomposed architecture with a single cross-attention pathway, while retaining the supervision unchanged. We applied the different components losses to the decomposed predicted full signal (Appendix B).
Compared to the new decomposition ablation, GLAFE achieves higher full-signal temporal R and local FC R at all three atlas sizes, while the ablation achieves lower full-signal FC MSE. These results support the contribution of explicit decomposition beyond retaining component supervision alone. Please see Tables 2, 10 and 11 for the full evaluation.