- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
SAIL studies interpretable correspondences between multimodal language models and human visual cortex. It pools and reduces features from multiple language layers, trains one sparse autoencoder on their concatenation, and matches each voxel to several units using training-response cosine similarity. It evaluates preferred-image collections with SEED and optimal transport, assigns unit labels through caption-derived candidate prompts, and visualizes cortical semantics. Experiments cover four models and eight NSD subjects, with layerwise SAE comparisons, searchlight RSA, independent fLoc category responses, and an auxiliary CLIP-based encoding-model evaluation.
Critical strengths
-
The evaluation covers four models and eight subjects, fits preprocessing and SAE training within training folds, and includes controls for candidate-unit counts in the redundancy analysis and supplementary RSA (Appendices A, D, and F.5). These choices provide meaningful support for the reported response-profile differences.
-
The fLoc analysis tests fixed NSD-derived correspondences against category responses from an independent experiment (Section 6 and Appendix I). This is useful evidence that the correspondence is informative beyond the NSD stimulus set, although it does not isolate the benefit of the proposed components.
Critical weaknesses
1.The evidence does not establish that the additional matched units provide more informative semantic explanations of individual voxels.
Section 3 measures redundancy across the candidate dictionary using the maximum similarity between unit response profiles. It does not evaluate semantic redundancy or coverage among the units actually selected for each voxel. Equation (3) selects these units by separate similarities to the voxel, without testing whether they contribute distinct information.
The labeling procedure also leaves a substantial interpretive gap. Appendix H extracts candidates from the captions of one maximally activating image, keeps that image fixed, and selects the candidate producing the largest target-unit activation for the complete image-text input. This tests candidate prompts on one selected stimulus; it does not establish that the assigned label predicts the unit's or voxel's preference across other images, independently of co-occurring content. The authors acknowledge this ambiguity in the Discussion.
Neither the SEED/OT image-collection score nor the auxiliary predicted ROI responses in Appendix J directly evaluate label validity or the additional information supplied by multiple labels. The fLoc measurements are valuable, but Table 1 and Appendix I report only SAIL, without layerwise SAE or single-unit comparisons. Their category-wise cosine similarities also lack a cross-category comparison or a control for category-shared spatial response components. Figure 5a supplies a body/place contrast visualization, but does not establish a quantitative component advantage across subjects. Thus, the results support response correspondence and broad category organization, while the central claim of better voxel-level multi-semantic interpretation remains unverified. Direct validation of distinct label preferences and their incremental information is necessary for that claim.
2.The comparisons do not sufficiently isolate the contribution of the proposed representation relative to existing interpretable mapping approaches.
Multi-semantic voxel mapping is already addressed by CLIP-MSM [1] and BrainLMM [3], while SAEs-BrainMap [2] establishes SAE-based brain alignment. SAIL therefore needs to demonstrate what its unified dictionary and multiple matches add to these capabilities. Figures 2 and 3 provide evidence in favor of the proposed integration, but the remaining controls do not resolve this issue.
Appendix F constructs RAW/PCA/ICA RDMs directly from image features, whereas SAIL and SAEs-BrainMap RDMs are constructed from predicted voxel responses using brain-derived correspondences. This changes the brain-response readout as well as the representation. Matching candidate dimensionality in Appendix F.5 does not remove that difference; its RAW control also uses the final language layer, whereas SAIL integrates multiple layers. Consequently, those results do not isolate the benefit of sparse decomposition over the same input information with the same fitted readout.
Similarly, the vision-tower and projector comparisons in Section 4 change the feature-extraction stage as well as access to captions. They do not substitute for image-only, caption-only, or shuffled-caption controls at the same language layers. The benefit attributed to multimodal representations consequently remains confounded with these changes.
The auxiliary validation in Appendix J relies on one CLIP ViT-based voxelwise encoding model. Appendix J does not specify its brain-response readout architecture, and no alternative encoding model is reported. It therefore remains unclear whether the preferred-image ranking is robust to the choice of response predictor. This limits the robustness of that model-based validation, although the independent fLoc measurements remain valid evidence.
Finally, candidate-count matching does not establish comparable reconstruction fidelity and activation sparsity, neither of which is reported alongside the redundancy comparison. There is also no direct comparison with the cited multi-semantic mapping methods on interpretation quality. These omissions limit the conclusion to improvement over the particular reported configurations, rather than establishing a substantive advance in reliable multi-semantic explanation.
References
[1] Yang, G., Xue, M., Mao, Z., Zheng, H., Xu, J., Sheng, D., … Li, X. (2025). CLIP-MSM: A multi-semantic mapping brain representation for human high-level visual cortex. Proceedings of the AAAI Conference on Artificial Intelligence, 39(9), 9184-9192. https://doi.org/10.1609/aaai.v39i9.32994
[2] Mao, Z., Xu, J., Pan, W., Xue, M., Jin, Y., & Yang, G. (2026). SAEs-BrainMap: Unveiling the emergence of specialized concepts in deep models via brain alignment. In Proceedings of the 43rd International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 306, pp. 86540-86565). https://proceedings.mlr.press/v306/mao26h.html
[3] Gao, T., Xue, M., Zheng, H., Lv, S., Xu, J., Sheng, D., … Yang, G. (2026). BrainLMM: A label-free framework for mapping multi-semantic representation in the human visual cortex. Proceedings of the AAAI Conference on Artificial Intelligence, 40(6), 4176-4184. https://doi.org/10.1609/aaai.v40i6.42413
Questions for authors
Please refer to Critical Weaknesses
4 comments
Thanks for the additional experiments. The new fLoc comparisons and label controls are useful, but the label-based prediction R² remains very low, and I am still not convinced that the additional labels provide distinct and reliable voxel-level semantic explanations rather than capturing correlated concepts. I also share MVa4's broader concern about the semantic validity of voxel–unit matching, while the current comparisons still do not clearly isolate the contribution of the unified cross-layer SAE. These are my main concerns about the paper's novelty and interpretability, so I will keep my score at 2.
Thank you for further explaining your remaining concerns. We apologize for not sufficiently explaining the design and scope of the previous label prediction experiment. To address this, we conducted a new experiment (https://anonymous.4open.science/r/iclr_reubttal-BAB0/r/3/10.pdf), described below .
1. Label prediction and additional semantic information
The original experiment represented each concept only by its presence or absence, without capturing its prominence within an image. When two concepts co-occurred, both were encoded as 1, even if one was central and the other appeared only in the background. Although the readout could learn different weights for different labels, these fixed weights could not recover changes in concept prominence across images. The readout also relied on linear combinations of at most five label features to predict continuous voxel responses. These limitations may contribute to the relatively low R² values.
To further assess label validity and the incremental information provided by multiple labels, we conducted a label-based image retrieval experiment across four models and eight subjects, without fitting a brain response readout. We retained the voxel–unit matches established on the training set and their associated labels, and evaluated images not used for label generation. For each voxel, we used the first labels, where , and normalized the original matching scores of their corresponding units within the selected set so that the weights summed to one. We then computed cosine similarities between the CLIP text embeddings of the labels and the CLIP image embeddings of the test images, combined these similarities using the normalized weights, and retrieved the ten highest-scoring images.
We evaluated the measured voxel responses elicited by these images. Each response was standardized by subtracting the voxel’s mean response across all test images and dividing by its response standard deviation. We averaged these standardized responses over the ten retrieved images and then across the evaluated voxels. As a control, we retained the first actual label and replaced the remaining labels with frequency-matched random labels, applying the same evaluation procedure and averaging over 20 repetitions.
This experiment directly tests whether multiple labels more effectively retrieve other images that elicit higher voxel responses than a single label or random label extensions, thereby assessing whether additional labels provide useful semantic information beyond a single label.
2. Meaning and semantic validity of voxel–unit matching
Equation (3) compares the responses of one SAE unit and one voxel across the same images, rather than directly comparing two independently learned feature spaces. Under our encoder formulation, the -th row of contains the encoding weights for unit . Each image–caption representation produces one scalar activation for this unit, while the voxel provides one response value for the corresponding image [1].
For example, an SAE unit might have activations , while a voxel has responses across the same three images. Equation (3) computes cosine similarity between these vectors, whose corresponding entries refer to the same image. Their correspondence is determined by image identity, not by the ordering or semantic meanings of SAE units and voxels.
This explains why the response profiles can be compared without prior feature-space alignment. We recognize, however, that response similarity alone does not establish semantic validity. The conditional label analysis and independent fLoc experiments provide complementary evidence concerning semantic interpretation and functional response correspondence.
3. Contribution of the unified cross-layer SAE
We will distinguish the roles of our comparisons more clearly. Comparing SAIL-Single with the layerwise single-unit baseline examines dictionary construction while retaining single-unit matching. Comparing SAIL with SAIL-Single examines multiple matching within the same unified dictionary. These comparisons provide evidence concerning the separate design choices, but we will not present them as eliminating every difference in capacity or training configuration.
We will incorporate these clarifications, additional experiments, and their scope into the paper so that all reviewers can assess the updated evidence. We appreciate the reviewer’s careful consideration and constructive feedback.
Reference
[1] Allen, E. J., St-Yves, G., Wu, Y., Breedlove, J. L., Prince, J. S., Dowdle, L. T., Nau, M., Caron, B., Pestilli, F., Charest, I., et al. (2022). A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence. Nature Neuroscience, 25(1), 116–126.
Thank you again for your thoughtful feedback. We have further addressed your concerns and updated the paper accordingly. We would greatly appreciate it if you could take another look at the revised results. Thank you for your time and consideration!
We sincerely thank the reviewer for the constructive feedback.
W1:
(1) We evaluated voxel-level label semantic redundancy. As our labels primarily consist of individual words or short phrases, we used pretrained fastText word vectors and the same redundancy metric as in the main text. With matched label counts per voxel, SAIL consistently achieves lower semantic redundancy than SAEs-BrainMap (https://anonymous.4open.science/r/iclr_reubttal-BAB0/r/3/1.pdf).
(2) We tested whether the labels predict brain responses to other images and whether additional labels improve prediction across four models and eight subjects. We fixed the voxel–unit matches established on the training set and split the held-out images into separate sets for label generation and evaluation. For each evaluation image, we checked whether each label appeared in its corresponding COCO captions, assigning a binary value of 1 if the label was mentioned and 0 otherwise. We used the first one to five labels to predict measured voxel responses through ridge regression with five-fold cross-validation. For the five-label comparison, we retained the first label and replaced the other four with frequency-matched random labels, repeating this control 20 times. Prediction R² generally increased with more labels, and five labels outperformed the random control (https://anonymous.4open.science/r/iclr_reubttal-BAB0/r/3/2.pdf). These results support the ability of the label sets to predict brain responses to other images and suggest that additional labels provide predictive information beyond a single label.
(3) Figure 4 projects the text embeddings of the labels into a UMAP semantic space and maps the resulting multi-label representations onto the cortical surface using color. The spatial distributions of person, scene, and food related semantics correspond to established category selective regions, providing evidence for label validity at the regional level.
(4) We added SAIL-Single and layerwise SAE controls across four MLLMs and eight subjects. Both controls used the same fLoc stimuli and cosine similarity metric (https://anonymous.4open.science/r/iclr_reubttal-BAB0/r/3/3.pdf).
(5) We conducted two additional analyses using Qwen across 8 subjects. First, we compared the predicted response for each category with the measured responses for all eight categories, constructing a cross-category similarity matrix (https://anonymous.4open.science/r/iclr_reubttal-BAB0/r/3/4.pdf). Second, we subtracted the mean response across all eight categories at each voxel, separately for predicted and measured responses, before recomputing their similarity. This removes the shared spatial component represented by the mean response map across categories. Positive correspondence persisted across categories after removing the shared spatial component (https://anonymous.4open.science/r/iclr_reubttal-BAB0/r/3/5.pdf).
(6) Using Qwen, we assessed how well each method reproduced the voxelwise body–place response contrast. For both predicted and measured responses, we calculated each voxel’s mean response to body images minus its mean response to place images, then computed the cosine similarity between the two contrast vectors across voxels. SAIL achieved higher similarity than both baselines in all eight subjects (https://anonymous.4open.science/r/iclr_reubttal-BAB0/r/3/6.pdf).
W2:
(1) We compared SAIL, BrainLMM, and CLIP-MSM on Subject S5 using Qwen. We identified predicted regions based on the semantic similarity between voxel labels and the corresponding categories, then measured their spatial overlap with the reference ROIs. SAIL achieved higher overlap than BrainLMM and CLIP-MSM across all five ROIs, indicating greater spatial consistency between its label descriptions and the semantic functions of these regions (https://anonymous.4open.science/r/iclr_reubttal-BAB0/r/3/7.pdf).
(2) RSA compares brain–model correspondence across the complete pipelines of the evaluated methods, rather than isolating the contribution of sparse decomposition.
(3) We conducted additional image-only (https://anonymous.4open.science/r/iclr_reubttal-BAB0/r/1/1.pdf) and fixed-text (https://anonymous.4open.science/r/iclr_reubttal-BAB0/r/1/2.pdf) control experiments using SAIL at the same language layers across four models and eight subjects.
(4) Appendix J tests whether highly activating images selected by different methods elicit higher predicted responses in the target ROIs, rather than evaluating ranking stability across encoding models.
(5) We added reconstruction fidelity and activation sparsity results for Qwen across 8 subjects. Compared with the layerwise SAE baseline, SAIL achieved higher reconstruction quality with a lower proportion of active units (https://anonymous.4open.science/r/iclr_reubttal-BAB0/r/3/8.pdf).
Once again, we appreciate the reviewer's thoughtful comments.