- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The authors present an approach to analyse EEG-fMRI data that integrates a number of neurophysiological insights and appears to yield better performance in some experiments. The work is embedded well in the existing literature and the experiments compare with some other approaches. Some more clarity on the experiments and notation could help to strengthen the manuscript.
Critical strengths
Great that there seems to be error bars given in some of the results (e.g. in table 1) but it could be explained better what the metrics here refer to.
The model appears to integrate a number of interesting angles on neural and hemodynamic coupling.
Critical weaknesses
Fig 1 is great and helpful for providing a broad overview of the approach, but some of the basic assumptions appear a bit strong and could be explained better. The fact that spiking activity is reflected EEG or fMRI in a way that can be / is captured with such a spatial resolution that it requires the proposed model for instance sounds physiologically implausible. The authors allude to empirical evidence, but to support the claims made in the experimental section these connections could be elaborated on a bit more.
Another strong assumption is that of spatio-temporal coupling and how it factorizes. There is evidence that the coupling is not as simple as a static spatial pattern would suggest, as used in the model.
The metrics could be explained better, for instance how exactly the MSE/PSNR are computed.
Comparisons with other models would be needed. Table 3 is helpful, but the variance across methods and approaches makes it difficult to assess which part of the approach yields an advantage. Most importantly, error bars must be provided for all metrics, maybe the authors could consider dropping some metrics in favour of error bars for the most relevant metric.
It would be helpful to provide more explanations on the exact preprocessing steps and how they relate to the difference in performance. Often in these kind of studies, preprocessing explains most of the advantages. It would be important that the authors clearly state that all preprocessing steps were kept constant across methods.
The approach assumes a static (across space and time) hemodynamic response function. Given the complexity of the model, it seems reasonable to assume (and there is evidence for that from several decades of research on hemodynamic coupling) that the model should maybe account for more complex hemodynamic coupling.
The cross-validation procedure could maybe run a full leave one/n-subject(s) out analysis and report variances across folds. It wasn’t clear whether that was done.
Questions for authors
were all preprocessing steps kept the same across all baseline methods?