- Rating
- 3
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper examines how audio pretraining domains affect neural predictivity across zebra finches, squirrel monkeys, and humans. Models achieve similar best-layer performance on animal datasets but diverge more on human datasets. Representation similarity and input-sensitivity analyses suggest that pretraining-related structure is expressed differently in predictors fitted to human versus animal responses.
Critical strengths
Combining prediction accuracy, representation similarity, and input sensitivity offers a useful approach to understanding model–brain correspondence beyond performance rankings. Multiple datasets, subspace-rank checks, and the nonspeech fMRI analysis provide complementary support for the reported patterns.
Critical weaknesses
- Species is confounded with recording modality, stimulus distribution, and other dataset characteristics. Animal spiking data versus human EEG/fMRI therefore do not isolate a species-specific effect.
- Comparing activation uCKA with input-gradient subspace overlap does not directly demonstrate that speech-related information is “filtered out.” The absence of a speech-model cluster is insufficient evidence of information loss, particularly without uncertainty estimates for the central clustering results.
Questions for authors
What existing controls distinguish species effects from recording modality and other dataset differences? Are the speech-model clustering results robust to subject/stimulus resampling and controls using shuffled neural targets? Was best-layer selection independent of the data used for final performance evaluation?
Dear reviewer, Please respond to the authors when you get a moment. (They have just posted an update) Thanks! The AC