- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The manuscript explores four types of neuroscience analogies in LLM. It emphasizes that the focus of the development of AI neuroscience lies not in the absence of phenomena, but in the insufficiency of comparable measurements and control.
Critical strengths
-
The article points out that the stability of the world map's decoding lies in its pure decoding process, absence of single neuron screening, and no intervention operation points. The article considers "where to believe and where to be skeptical", but does not directly provide a very definite answer. This approach takes into account the different thinking groups.
-
The manuscript has made the JSON files related to it public, enhancing the credibility of the article's methods. The manuscript focused on "how to measure correctly". Subsequently, some methods can be applied to the new model for experiments.
Critical weaknesses
-
The manuscript takes a new perspective, but fails to set a determination threshold for the establishment criteria of the neuroscience parallel. This may cause readers to have uncertain judgments. It is recommended to clearly define the criteria.
-
The manuscript assumes that the fixed c is a functionally comparable dose across different models. However, the increase in residual norm does not imply that the semantic space, attention dynamics, and inter-layer information flow are comparable. The article uses the inverted-U and layer dependence to illustrate the sensitivity of the operation point, but it fails to conduct a "cross-model equivalence verification under the same c".
-
The author acknowledges that direction is not threshold-dependent but proportion is threshold-dependent. However, using the "The number is n" prompt within the range of 1-40 might also induce logarithmic/segmented structures. The article should also provide stability data for different numerical ranges and different prompt templates.
-
The article does not explain the reasons for choosing these four specific paradigms, nor does it systematically describe which type of neuroscience parallel they represent, nor does it clarify whether they cover the main types of representation.
-
The charts mentioned in the text description (such as Figure 2 and Figure 4) lack detailed annotations. It is recommended that all charts be clearly labeled in the main text with explanations of the meanings of the horizontal and vertical axes, legends, etc. Additionally, it is suggested that the icons be given more detailed descriptions to highlight the experimental results.
Questions for authors
The manuscript reveals the ubiquity of artifact measurement in artificial intelligence neuroscience, preventing the misidentification of methodological flaws as cognitive parallels. Secondly, the experiments span five model families, 17 checkpoints, with scales ranging from 0.6B to 72B. The experiments are relatively comprehensive, but revisions are needed to address the aforementioned weaknesses.