- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work proposes Brain-LM crosscoders. The proposed method decomposes brain responses and LM representations into a common set of features and labels each feature. Feature categories can be shared, brain-specific candidates, or LM-specific candidates, depending on their predictive contribution to brain responses and LM representations. Experiments show the design advances.
Critical strengths
None
Critical weaknesses
- Experimental issues.
- Reproduction issues.
Questions for authors
- The reasoning in the BRAIN-LM PREDOMINANCE section should be further proofread.
- Furthermore, classify features as shared, brain-specific candidates, or LM-specific candidates. Citations should be added. The paper does not prove that its formulated threshold yields reliable three classification assignments.
- Go on with cmt 2, the sensitivity analyses are insufficiently validated.
- The interpretability is not convincing.
- The baseline comparison should add more SOTA methods.
- No opensource code.
- Fewer implementation details.
3 comments
I will maintain my original rating.
Just to confirm, do you have any remaining concerns? We believe we have addressed all of your comments, but if anything is still unresolved, please let us know it. Thank you!
Thank you for your review. We respond to each comment below.
W1. "Experimental issues."
Please see our responses to Q2–Q5.
W2. "Reproduction issues."
Please see our responses to Q6 and Q7.
Q1. "The reasoning in the BRAIN-LM PREDOMINANCE section should be further proofread."
We wrote this section as clearly as we could. If you tell us which part needs improvement, we will gladly revise it.
Q2. "Classify features as shared, brain-specific candidates, or LM-specific candidates. Citations should be added. The paper does not prove that its formulated threshold yields reliable three classification assignments."Q3. "The sensitivity analyses are insufficiently validated."
We set the threshold of 0.9 for convenience in the case study, and we agree that the threshold should rest on a criterion. We now set the threshold so that fewer than 5% of the features of a control crosscoder trained on circularly shifted data (section 4.6) are classified as shared. This threshold should keep the proportion of features wrongly classified as shared below 5%. We set it separately for each subject–LM pair. Section 3.3 reflects this change.
Q4. "The interpretability is not convincing."
We ask you to consider that this study is exploratory and aims to generate hypotheses. As the introduction states, the explanations "pose hypotheses for future intervention experiments" (L104–106), and rigorous verification is outside the scope of the paper. This is why the paper calls these features specific candidates throughout.
Q5. "The baseline comparison should add more SOTA methods."
To our knowledge, the task of this paper has no established benchmark, so no method is clearly the state of the art. We chose ShIndICA as a comparable method "because its approach is similar to that of crosscoders" (L309–310). If you know of other methods that we should compare, please tell us.
Q6. "No opensource code."
The reproducibility statement (L554–555) already gives the link to our code. We repeat it here: https://anonymous.4open.science/r/brain-lm-crosscoder-dev-67E8
Q7. "Fewer implementation details."
The main text gives priority to an overall understanding of the method over technical details, so the implementation details that our method shares with prior work appear in Appendices B–G (preprocessing, architecture, explained variance, layer selection, detection accuracy, statistical testing).