- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper addresses confounding in visual regions of the brain tied to specific concepts. Using NSD, which is full of the typical confounds of naturalistic images, lots of prior research has come out to try to map what the fMRI data says about how the brain represents concepts. Much of this research is tricked by confounds and is likely noise. This paper aims to tighten up the methodology and analysis by looking at context-preserving / manipulations that look for regions of the brain that would respond, e.g. equally to a concept and the same environment without that concept. This would mean, while older methods (activation maximisation) would incorrectly label an area as responsive to a concept, the proposed method would be able to detect this and falsify the claim. The proposed method is BrainTRACE. The paper largely confirms what's been said in other papers and I think slightly tries to oversell its contributions (perhaps in a defensible way and my own reading of certain sentences expected too much, e.g. that newly acquired fMRI data was used to confirm hypotheses). There should have been a Limitations section in here because the Conclusions section doesn't talk about any interesting useful findings and it's largely centred around limitations, not actually concluding much at all except restating the importance of the analysis (which I don't disagree with). Overall, while not maybe providing solid new insights, it does provide some extra scientific analysis to support regions that other papers have found, which we now know survive a strong counterfactual analysis.
Critical strengths
- Tackles a real and important problem (I like papers that take a stance on attacking looser methodology seen elsewhere)
- The motivation is sound and the literature is mostly well covered.
- Methodological care against double dipping: voxels are selected on a training split and evaluated on held-out images.
- I liked the conservative scoring on taking the most difficult / tricky potential edits and using those to derive scores
- Good application of standard stats expected in the field, verifies my confidence a team actively working in the field did this
- Sanity checks included to verify data quality were applied
Critical weaknesses
- I had so many questions about the image-to-fMRi encoder and was shocked to see it not referenced in the main paper but banished to the appendices (I appredciate there are space concerns) but I felt it was important to talk more about that to better understand how a potentially confounded model, on same subjects and dataset, might also reveal confounding problems. I'm not 100% satisfied I have fully been able to convince myself there is no issue here with this potential circularity (this is not a criticism, just a concern I couldn't do away with after reading the paper).
- The abstract implies the new approach is supported by new fMRI data, but no new fMRI data is collected, everything is based on the image-to-fMRI encoder predictions, so without that verification I also have a problem with the paper title (testing of visual representations in the human brain) -- yes, it's NSD, yes, the theories can be applied to the human brain but that's not what actually happens in this paper, so I feel there is a bit of overselling going on
- I fundamentally didn't get any new insights about representations in the brain from this, though. We've all seen variations on these plots before, flatmaps of the same NSD areas and the associated pictures, large coarse-grained categories. The goal of the paper was to support strengthened conclusions (which was good) but the part of the paper saying about human hands, legs, feet, tools being somewhat 'fine-grained visual concepts' is not something I'd say I agree with.
- Conclusion really was underselling the main aim of the paper and reminded the reader of all the caution that is warranted with an approach that relies on another model and no actual fMRI data to support the new conclusions (I'm guessing that's coming, and that would be a very interesting addition).
Questions for authors
- In the image-to-fMRI model, I'm a bit wary about the cross-over between the encoder model seeing images and fMRI data later used separately to derive your own conclusions about it. Your submission is quite weak in not always specifying the details on this (however, I appreciate the space concerns you are under). Can you tell me about how you effectively rationalised over this issue and what steps you took to make sure it didn't weaken your analysis in any way?
2.The failed semantic negatives, is this just a comment on the fact the pipeline failed in those instances or were they used in the analysis and then discovered post-hoc? I didn't quite get that bit.
- Are there plans to continue any experiments and collect fMRI data based on this?
3 comments
W3. I fundamentally didn't get any new insights about representations in the brain from this, though. We've all seen variations on these plots before, flatmaps of the same NSD areas and the associated pictures, large coarse-grained categories. The goal of the paper was to support strengthened conclusions (which was good) but the part of the paper saying about human hands, legs, feet, tools being somewhat 'fine-grained visual concepts' is not something I'd say I agree with.
We agree that the main contribution of BrainTRACE is not necessarily the discovery of entirely new visual representations, but rather providing a systematic framework for evaluating and strengthening conclusions about their localization. One of our main findings is that many regions identified by activation-based methods fail counterfactual-specificity testing, demonstrating why stronger evidence is needed before interpreting high activation as concept representation. We use the term fine-grained to describe two complementary aspects of BrainTRACE: (i) More precise localization of concept-specific representations, rather than the broad regions of highly activated voxels typically identified by activation-based methods, as discussed in Appendix C.1. (ii) Better differentiation between closely related concepts, such as different human body parts, which often activate overlapping brain regions. By testing semantic alternatives and counterfactual edits, BrainTRACE helps distinguish representations that would otherwise be difficult to separate.
W4. Conclusion really was underselling the main aim of the paper and reminded the reader of all the caution that is warranted with an approach that relies on another model and no actual fMRI data to support the new conclusions (I'm guessing that's coming, and that would be a very interesting addition).
We agree and have strengthened the conclusion to better emphasize BrainTRACE’s main findings, particularly the importance of specificity testing for identifying more reliable candidate representations. We also clarify the dependence on the coverage of existing measured fMRI data and the use of predicted fMRI.
Q1. In the image-to-fMRI model, I'm a bit wary about the cross-over between the encoder model seeing images and fMRI data later used separately to derive your own conclusions about it. Your submission is quite weak in not always specifying the details on this (however, I appreciate the space concerns you are under). Can you tell me about how you effectively rationalised over this issue and what steps you took to make sure it didn't weaken your analysis in any way?
Please see our response to W1.
Q2. The failed semantic negatives, is this just a comment on the fact the pipeline failed in those instances or were they used in the analysis and then discovered post-hoc? I didn't quite get that bit.
The failed semantic negatives were included in the reported analysis and identified only post hoc, when we investigated cases where BrainTRACE still produced false positives. These examples were not excluded or corrected after inspection, but are discussed as a limitation of the current pipeline.
Q3. Are there plans to continue any experiments and collect fMRI data based on this?
We certainly plan to continue this work. We are already in contact with several groups, both within and outside our institution, sharing our method and findings and discussing potential fMRI experiments. These include targeted follow-up experiments to validate representations already explored by BrainTRACE, as well as discussions about which new concepts would be interesting to investigate using the pipeline.
Thank you
Thank you for the care and time taken to address my concerns. I'll +1 my rating as recognition of the work put in to adapt the submission into what I believe is a better and more honest version of the paper.
We thank the reviewer for their thoughtful feedback and the time devoted to reviewing our paper. We have made every effort to address each concern through additional experiments, clarifications, and revisions to the manuscript. The new experiments have been incorporated into the revised appendix and are discussed or referenced in the main paper where appropriate. All changes are highlighted in blue.
W1. I had so many questions about the image-to-fMRi encoder and was shocked to see it not referenced in the main paper but banished to the appendices (I appredciate there are space concerns) but I felt it was important to talk more about that to better understand how a potentially confounded model, on same subjects and dataset, might also reveal confounding problems. I'm not 100% satisfied I have fully been able to convince myself there is no issue here with this potential circularity (this is not a criticism, just a concern I couldn't do away with after reading the paper).
We agree that the image-to-fMRI encoder and its relationship to BrainTRACE’s evaluation deserve a clearer explanation. We have added a dedicated paragraph in Section 3 of the main paper and more detailed information in Appendix H.3. BrainTRACE uses the encoder of Beliy et al., trained jointly across all eight NSD subjects using only the BrainTRACE training splits, with shared NSD images across subjects excluded. Importantly, neither the validation images nor their measured responses are used for encoder training or representation discovery.
To further assess potential encoder-related biases, we evaluated BrainTRACE using an independently trained transformer encoder, obtaining highly consistent specificity maps (r = 0.868; Appendix D.1). We also added a new cross-dataset experiment using LAION-fMRI Subject 1, which differs from NSD in both its training-image distribution and measured fMRI responses. For each concept, BrainTRACE independently discovers a voxel set in each dataset and evaluates its specificity on held-out images. Despite the differences between brains, the specificity scores show strong agreement across 234 concepts (Spearman ρ = 0.80, computed across concepts rather than voxels), with 94.4% of strongly supported NSD concepts retaining positive specificity in LAION-fMRI (Appendix A).
W2. The abstract implies the new approach is supported by new fMRI data, but no new fMRI data is collected, everything is based on the image-to-fMRI encoder predictions, so without that verification I also have a problem with the paper title (testing of visual representations in the human brain) -- yes, it's NSD, yes, the theories can be applied to the human brain but that's not what actually happens in this paper, so I feel there is a bit of overselling going on
We would appreciate additional clarification to ensure that we fully understand your concern and make the necessary changes. BrainTRACE aims to explore and evaluate candidate visual representations in the brain using two complementary sources of evidence: predicted fMRI responses to generated positive images, semantic negatives, and counterfactual edits, and measured fMRI responses to positive and negative images retrieved from existing fMRI datasets. While counterfactual-specificity testing relies on encoder predictions, measured fMRI responses provide an independent evaluation of activation and semantic specificity. We acknowledge in the paper that existing measured data do not provide sufficient evidence for all concepts. Accordingly, BrainTRACE identifies these gaps and proposes targeted follow-up fMRI experiments to further test or extend its discoveries. To avoid suggesting that new fMRI data were collected, we have revised the abstract to replace "measured fMRI data" with "existing fMRI data". We hope this clarification addresses the reviewer’s concern and would be happy to make further revisions if needed, including changes to the abstract or rephrasing of the title.