- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Augmented Sparse Encoding Models, which combine sparse autoencoder (SAE) features from language models with an explicit surprisal predictor to interpret brain responses to language. Using a 7T fMRI dataset, the authors investigate voxel-level semantic tuning, feature sharing across language regions and participants, and the predictive contributions of different levels of the Matryoshka SAE hierarchy. Additional datasets support several findings. The study addresses an important question, but concerns remain regarding the independence of the voxel-to-voxel generalization analysis and the robustness of the Ghost subgroup findings.
Critical strengths
- The framework connects brain-response prediction with interpretable linguistic features, providing more informative explanations than model–brain correlation scores alone.
- The paper includes substantial supporting analyses, including nested cross-validation, split-half stability analysis, an additional model layer, and replication of selected findings on independent datasets.
Critical weaknesses
- Appendix C states that source-voxel features and their signs are selected using all stimuli before cross-validation on target voxels. This leaves uncertainty about generalization to unseen stimuli, particularly when source and target responses are correlated. Selecting source features within each outer training fold would provide a stronger test of the reported feature sharing.
- The criterion for identifying the 32-voxel subgroup in Figure 3A is unclear. The subsequent LTPJ enrichment also depends on several selection thresholds whose sensitivity is not assessed. Clarifying the subgroup-selection procedure and testing reasonable alternative thresholds are important for establishing the robustness of this central finding.
Questions for authors
- Please clarify how the 32-voxel Ghost subgroup in Figure 3A was identified: through a predefined clustering rule, a predictivity threshold, or visual inspection of the heatmap. Report the relevant settings and assess the subgroup’s stability.
- The LTPJ enrichment analysis uses several thresholds: normalized predictivity above 0.5, agreement with at least seven of ten feature directions, and more than three aligned voxels per participant. Please justify these choices and examine whether the enrichment remains stable under reasonable alternative thresholds. Participant-level counts would also help clarify the reported percentages.
- The authors acknowledge that features 44 and 71 track token count through first-token activation and mean pooling. Please test whether the main feature-sharing and hierarchy findings remain consistent after explicitly controlling for token count or changing the pooling procedure.
- The feature interpretations rely mainly on manually summarized Neuronpedia examples. Please describe the annotation procedure and provide supporting examples or independent semantic ratings from the study’s own stimuli, particularly for the “people-centered” interpretation.
- Several details require correction: the main text states an NCSNR threshold above 0.4, whereas Appendix A allows relaxation to 0.2 for some subtypes; “2028–8192” in Figure 5B should be checked; and the Figure 1B caption should define surprisal as mean negative log probability, consistent with the main text.
- Do the voxel-to-voxel generalization findings remain consistent when source-feature selection is performed exclusively within each outer training fold?
- Please clarify that “drive” and “suppress” refer to positive and negative regression associations rather than causal neural effects. Given possible correlations among predictors, the stability of the main coefficient signs should also be discussed.