- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors propose using measured population receptive-field maps as an attention bias in an fMRI-to-image decoder, to improve the spatial structure of reconstructed images.
Critical strengths
- The idea itself is simple and can be theoretically incorporated into fMRI-to-image decoders (probably more relevant with limited data)
- The paper is honest and reports negative results.
Critical weaknesses
- Underperforms prior methods: The paper proposes a method to improve fMRI-to-image decoding, but it underperforms prior methods on most metrics. It is worse on every metric in Table 3 than MindEye, the method it is built on.
- Insufficient evidence of usefulness: Overall, the evidence does not establish that the proposed method, or incorporating pRF information, is useful.
- Small, non-significant main results: In the main results (Table 2), the reported differences are very small and not statistically significant, or significant at all for that matter.
- Unclear role of the bias: The learned attention scores can override the pRF-based bias, so it is unclear how much the bias actually shapes the final results.
- Unjustified metrics: The proposed Spatial and Center metrics are not sufficiently justified. It is unclear why feature energy in a deep network layer is a good indicator of spatial accuracy. Decades of research in computer vision and human vision have produced established shape and position metrics, such as mask IoU/Dice, boundary F-score and contour distances, and the COCO annotations needed to compute them were available.
- Necessity of pRF measurements: It is unclear whether pRF-like information could be estimated directly from the training data, and whether separate pRF measurements are needed at all.
Questions for authors
I have no questions.