- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Authors are introducing BrainExplore, a framework for automated interpretable pattern discovery given fMRI activity during a passive viewing task. They work on the NSD dataset and propose a multi-stage approach, the fMRI activity within each ROI is decomposed via PCA, ICA or SAE into a set on key components, then linearly combined to estimate the real per-image activity. They took the images most active for each pattern and pass them to VLM to formulate pattern hypothesis and LLMs to validate them looking at what is shared across these images.
SAE gives the highest number of intepretable patterns that cross the agreement threshold and they also use universal brain encoder to augment the amount of data available by a large factor (x12).
The main contribution is how they automatize everything for large scale pattern discovery, which could be an useful tool for neuroscientific hypothesis generation
[EDIT] Given the substantial additional experimental evidence, I am inclined to revise my initial rating upward, while retaining some reservations about the interpretation of the results as novel neuroscientific discoveries.
Critical strengths
The study is conducted well, every passage is clear.
The depth of the appendix is remarkable and honestly anticipated many of questions (cross-subject map ROI explanation agreement, cross-dataset validation, ablation studies and impact of dimensionality of each technique used to decompose the signal).
The scale and the systematic comparison of decomposition methods under a common, automatic score are useful.
Discussion is honest about results and limitations.
Critical weaknesses
I think there are some weaknesses in this work, mainly linked to novelty and use of predicted fMRI data.
-
The first one about novelty is that the idea of exploring/finding brain patterns on this dataset was already explored by a bunch of other works like BrainDIVE, BrianScuba, "Bridging Brains and Concepts: Interpretable Visual Decoding" and "Evidence for compositionality in fMRI visual representations via Brain Algebra" published in 2024-2025, and probably more. Of course, the method is different and defensible, but at least I think it's important to mention these works and explain why the author think this work is adding something. Please don't take it wrong, but my general impression is that this is just another way to do the same thing, but I'm happy to revise my opinion if authors can provide evidence of why their approach is better. In particular, I'd also like to see, when possible a comparison between patterns discovered in these and other works together with the patterns discovered by BrainExplore. This would strenghten the work a lot in my point of view.
-
What encoders can learn is in principle all but noise (except for a general noise structure). I'm not convinced by the results of fMRI predicted patterns. Most of these models were trained on the same NSD dataset, and it's hard to say that the benefits come from more syntehtic data rather than some form of denoising/data circularity. I trust more the results (even if more modest) on the original data themselves. I would narrow down each claim on the synthetic part.
2a. How much of the brain structure comes from the encoder? Big jump can be seen fro any decomposition technique when you use it, but I think you are mostly capturing the feature geometry of the original image backbone projected in the brain space rather than true brain activity.
- The averaged score can be carried by the predicted pool. The final score averages measured and predicted pools, so a concept scoring 0.9 on predicted and 0.1 on measured passes the 0.5 threshold. The claim that “all interpretations are evaluated and verified on measured fMRI” needs direct support. The authors should report, for models trained with augmentation, the measured-pool-only score on the evaluation half, and the fraction of headline concepts passing on measured data alone.
Questions for authors
-
The Beliy et al. encoder was trained on NSD responses from the same subjects. Were the evaluation-half images excluded from its training, or could the encoder have seen the responses later used to score patterns? More broadly, how do you separate the benefit of “moore data” from the encoder simply denoising responses toward its own learned structure?
-
Could you run the same pipeline on the encoder’s image-backbone features directly, with no brain readout and matched dimensionality, or on an encoder fit to permuted fMRI targets? If those yield a concept set comparable to the predicted-fMRI condition, how much of the large gain (e.g., ICA from 12 to >200 hypotheses) reflects brain activity rather than the backbone’s feature geometry projected into voxel space?
-
For decomposition trained on fMRI predicted, could you report score omputed only on the measured evaluation pool, without averaging with the predicted pool?
-
Without retraining (You have the re-training example on 1 subject of fMRI LAION) how similar are the patterns you find on NSD vs the one you can find on another dataset? fMRI-LAOIN works well here, or you can use BOLD5000 or GOD or Deeprecon or THINGS-fMRI. If you pick a pattern and look at the images that maximize that specific pattern on a different subject/different dataset, will they be similar? This would be the strongest leverage to claim you can identify some new pattern in the brain.
7 comments
W2. What encoders can learn is in principle all but noise (except for a general noise structure). I'm not convinced by the results of fMRI predicted patterns. Most of these models were trained on the same NSD dataset, and it's hard to say that the benefits come from more syntehtic data rather than some form of denoising/data circularity. I trust more the results (even if more modest) on the original data themselves. I would narrow down each claim on the synthetic part.
Response. We agree on the importance of validating discovered representations against measured brain activity, and we will clarify this distinction and narrow our claims accordingly. A key motivation for using predicted fMRI is that many fine-grained visual concepts are represented by very few images in the measured dataset, making reliable interpretability scoring difficult. However, a strong multi-subject image-to-fMRI encoder can leverage a much broader training distribution to predict brain responses for additional images containing these concepts. We therefore view representations discovered primarily through predicted fMRI as promising hypotheses for targeted follow-up experiments, rather than already strongly validated neural representations and will better clarify that.
To directly assess the support from measured fMRI, we conducted the additional measured-only evaluation suggested by the reviewer (W3/Q3). This analysis identifies interpretations supported by measured responses alone and distinguishes additional discoveries that lack measured-data support from those that remain inconclusive due to limited evaluation evidence.
W2.a/Q2. How much of the brain structure comes from the encoder? [...] Could you run the same pipeline on the encoder’s image-backbone features directly, with no brain readout and matched dimensionality, or on an encoder fit to permuted fMRI targets?
Response. To directly address the reviewer's concern, we conducted an additional control experiment. We trained two encoders with the same pretrained image backbone and brain-specific architecture, one using the original image–fMRI pairs and the other using randomly permuted correspondences. We then independently repeated SAE discovery using predictions for the same external images across three ROIs of NSD Subject 1. Shuffling reduced the number of discovered concepts from 247 to only 5 at the 0.5 threshold, and from 36 to 0 at the 0.8 threshold. Importantly, when evaluated on held-out measured fMRI alone, the corresponding numbers dropped from 110 to 1 and from 18 to 0.
These findings are further supported by several complementary analyses. The image-to-fMRI encoder used in BrainExplore has demonstrated strong generalization to unseen images (Beliy et al., 2024), supporting its ability to predict meaningful brain responses. Our analysis using alternative image-to-fMRI encoders (Appendix F.2) shows substantial consistency in discovered concepts across different architectures and image backbones. Furthermore, our randomized-activity controls (Appendix B.7) demonstrate that discoveries depend on structured brain activity. Together, these results provide strong evidence that our discoveries rely on learned image–brain relationships rather than simply arising from the pretrained image backbone. Additional experiments evaluate discoveries using measured fMRI alone (W3/Q3), and demonstrate cross-dataset concept consistency (Q4).
W3/Q3. The averaged score can be carried by the predicted pool. The final score averages measured and predicted pools, so a concept scoring 0.9 on predicted and 0.1 on measured passes the 0.5 threshold. The claim that “all interpretations are evaluated and verified on measured fMRI” needs direct support. The authors should report, for models trained with augmentation, the measured-pool-only score on the evaluation half, and the fraction of headline concepts passing on measured data alone. For decomposition trained on fMRI predicted, could you report score computed only on the measured evaluation pool, without averaging with the predicted pool?
Response. We thank the reviewer for raising this concern. To assess the measured-data support for interpretations discovered through augmentation, we repeated the original BrainExplore scoring procedure using only the measured evaluation pool, across all subjects and decomposition methods. We report the number of hypotheses passing the 0.5 and 0.8 thresholds for measured-only data in the Supported columns of the table below. We further examined hypotheses that passed the original combined measured and predicted score but did not pass the corresponding measured-only threshold. Importantly, failure to pass the measured-only threshold does not necessarily mean that a hypothesis is unsupported: the measured evaluation pool may contain too few examples of a particular concept to reliably assess its alignment.
To account for this, we introduced a minimum coverage requirement of 100 concept-positive measured images. Hypotheses below this requirement were classified as Insufficient coverage. For the remaining hypotheses, we assessed uncertainty using 5,000 paired image-level bootstrap resamples with multiple-comparison correction. We classified hypotheses as Not supported when the adjusted 95% upper confidence bound of the measured-only score fell below the corresponding threshold, or as Statistical uncertainty when the evidence was insufficient to establish this. The results are summarized in the table below, with full experimental details provided in Appendix J.8. A substantial amount of hypotheses pass measured-only evaluation, while relatively few additional discoveries are classified as not supported. Most remain inconclusive due to limited coverage or statistical uncertainty.
| Method | Supported (>0.5) | Not supported (>0.5) | Insufficient coverage (>0.5) | Statistical uncertainty (>0.5) | Supported (>0.8) | Not supported (>0.8) | Insufficient coverage (>0.8) | Statistical uncertainty (>0.8) |
|---|---|---|---|---|---|---|---|---|
| Voxels | 55 | 2 | 3 | 32 | 8 | 0 | 0 | 9 |
| PCA | 54 | 4 | 2 | 25 | 9 | 0 | 0 | 4 |
| NMF | 44 | 2 | 0 | 20 | 7 | 0 | 0 | 4 |
| ICA | 100 | 17 | 14 | 79 | 16 | 1 | 0 | 19 |
| SAE | 136 | 7 | 15 | 67 | 33 | 0 | 1 | 18 |
| SAE+ICA | 146 | 11 | 21 | 78 | 35 | 2 | 1 | 22 |
We thank the reviewer for their time, effort, and constructive feedback. We conducted additional experiments addressing their suggestions and responded to each point below. Full experimental details and results are provided in the temporary Appendix J for the reviewer's convenience and will be integrated into the relevant sections of the final paper.
W1. The idea of exploring/finding brain patterns on this dataset was already explored by a bunch of other works like BrainDIVE, BrianScuba, "Bridging Brains and Concepts: Interpretable Visual Decoding" and "Evidence for compositionality in fMRI visual representations via Brain Algebra"[...] I think it's important to mention these works and explain why the author think this work is adding something […] I'd also like to see, when possible a comparison between patterns discovered in these and other works together with the patterns discovered by BrainExplore.
Response. We thank the reviewer for highlighting these relevant works. We agree that the distinctions between BrainExplore and previous approaches were not sufficiently clear and will expand the related work and clarify our contributions throughout the paper. BrainExplore makes four main contributions: (i) Distributed representation discovery. We extend previous work on distributed fMRI representations into a large-scale automated discovery and interpretation framework, systematically exploring fine-grained patterns across brain regions and decomposition methods, rather than focusing on individual voxels or broad predefined ROIs. (ii) SAE decomposition. We introduce sparse autoencoders (SAEs) for fMRI decomposition, demonstrating their ability to recover substantially more interpretable patterns, including representations complementary to standard decomposition methods. (iii) Scalable Exploration. Our framework builds a brain-inspired dictionary of ~1,300 concepts and precomputes image–concept labels, enabling efficient evaluation of hundreds of thousands of patterns without costly VLM/LLM explanations for each, as required by previous approaches. (iv) Extensive evaluation and validation. We provide more extensive systematic evaluation, quantitatively comparing discovered representations across decomposition methods, brain regions, and subjects, alongside validation on held-out measured fMRI, alignment with established neuroscience, and generalization across encoders and datasets (e.g. LAION-fMRI).
In comparison, BrainSCUBA and LaVCa focus on individual voxels, with LaVCa scalability limited by per-voxel VLM/LLM interpretation. BrainDiVE explores predefined functional regions through image synthesis limiting the scope and scale of systematic discovery. Bridging Brains and Concepts starts with image-defined concepts and learns to predict them from fMRI through a decoder, rather than discovering representations directly from brain activity. Brain Algebra investigates compositionality using patterns constructed for only 12 predefined concepts. Both primarily focus their evaluation on image reconstruction rather than systematically validating the semantic selectivity of brain representations on held-out measured fMRI. In contrast, BrainExplore combines SAE-based decomposition with scalable interpretation and extensive quantitative validation, enabling the discovery and evaluation of substantially more brain representations.
New quantitative comparison. To further address the reviewer's request, we conducted an additional comparison with two methods for which it was feasible: BrainSCUBA and LaVCa, using NSD Subject 1 across EBA, FFA, and PPA. We mapped their voxel captions to our concept dictionary and evaluated all methods using the same held-out measured fMRI scoring procedure. BrainExplore (SAE+ICA) recovered 239/62 concepts at alignment thresholds of 0.5/0.8, compared with 86/12 for direct voxel search, 51/10 for LaVCa, and 31/1 for BrainSCUBA. While this comparison is approximate due to methodological differences and necessary implementation adaptations, it provides additional evidence of broader concept recovery by BrainExplore.