- Rating
- 3
- Confidence
- 4(+1)
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper investigates a fundamental yet often overlooked blind spot in systems neuroscience and machine learning: traditional population-level decoding and alignment metrics tend to be dominated by a small subset of high-responding neurons and are insensitive to changes in the internal functional organization (encoding manifold) topology. The authors propose combining encoding manifolds with the Gromov-Wasserstein (GW) distance as a complementary diagnostic tool beyond traditional "behavioral alignment." Across multiple biological datasets, diverse deep learning architectures, and rigorous controlled MNIST causal experiments, the paper convincingly demonstrates that high decoding alignment does not imply identical internal functional organization or computational mechanisms.
Critical strengths
-
The paper directly points out the limitations of the current neuro-AI field's over-reliance on single scalar alignment metrics, revealing the profound fact that "behavioral alignment does not equal functional alignment."
-
The authors not only analyze complex biological electrophysiological datasets but also widely test various modern deep learning models, enhancing the generality of the conclusions.
Critical weaknesses
-
The differences in regional sampling (High-PC vs. Low-PC) are primarily driven by neuronal response amplitudes. While this exposes the flaw of Euclidean distance metrics, the discussion remains thin on how to completely strip away amplitude effects to measure tuning organization purely. Furthermore, would employing different distance metrics, such as cosine similarity or angular distance, make the metrics less susceptible to response amplitude? Discussing or evaluating whether alternative metrics can isolate tuning topology from amplitude would greatly strengthen the diagnostic framework.
-
The controlled experiments are based solely on a relatively shallow CNN architecture. For over-parameterized modern visual foundation models or large language models trained on complex natural images (e.g., ImageNet), it remains to be validated whether this causal decoupling still holds.
-
The GW distance matches structures by comparing internal pairwise distances. Theoretically, if two populations share internal geometric structures but encode completely unrelated semantic contents, false positive matches (spurious alignment) could occur. The quantitative boundaries of such extreme failure modes are underexplored.
Questions for authors
-
When dealing with new datasets, the specific selection criteria or rationale for the NTF decomposition order R and the IAN neighborhood parameters lack clear guidelines or explanation. The authors need to explicitly elaborate on how these hyperparameters are chosen and discuss their potential impact on the analysis results.
-
In the Procrustes distance calculation detailed in Appendix B.2.1, when the number of neurons in a subpopulation is K < 15, the spatial dimension P is set to k, and the smaller manifold is zero-padded to 15 dimensions prior to alignment. To what extent does this zero-padding operation affect the final analysis results?
4 comments
Response Part 2
Q2 — Zero-padding in Procrustes
"To what extent does this zero-padding operation affect the final analysis results?"
Padding only affects subpopulations with fewer than 15 neurons (below 2.4% of the smallest dataset), i.e. only the leftmost points in Figure 2. Zero columns do not add shape, so the padded R² is never higher than when both sides are truncated to k dimensions. Padding can therefore only lower the score and works against our claims. The difference is at most 0.01 for k = 13 (App. B.2.1, Table 21).
Summary. The reviewer’s concerns were the role of response amplitude, the restriction of the controlled experiment to a shallow CNN, and false-positive matches under GW. With per-neuron normalization, the FPS result holds, and the advantage of high-PC1 subpopulations in Section 4.2 is an amplitude effect on raw responses. The comparison of 20 layers of naturally trained models with mouse V1 shows that GW orders layers differently from CKA and RSA, although a causal test in large models remains open. The false-positive case occurs when stimuli are relabeled identically for all neurons, and fused GW detects it when the systems share a stimulus set. We hope these results strengthen the reviewer’s assessment and would be grateful if the reviewer would consider raising the score.
I thank the authors for their thorough and thoughtful responses. The additional experiments and clarifications have addressed my concerns regarding response amplitude, the generalizability of the proposed framework, and the potential limitations of GW. I also appreciate the additional analyses on hyperparameter selection and zero-padding. While some limitations remain open for future investigation, I believe the authors have adequately addressed the key concerns raised in my review. I will maintain my Weak Accept recommendation and increase my confidence in the assessment.
We thank the reviewer for the helpful review. We appreciate the positive assessment of our work and increasing the confidence after the rebuttal.
Response Part 1
We thank the reviewer for summarizing the paper’s point that “high decoding alignment does not imply identical internal functional organization.” Following the reviewer’s question on false-positive matches, we quantified this blind spot of GW. It is complementary to the blind spots of RSA/CKA/Procrustes, which is why we propose GW alongside these metrics rather than as a replacement. We also compared naturally trained models with mouse V1 and address the comments on response amplitude, hyperparameters and zero-padding below.
W1 — Amplitude vs. tuning; cosine and angular distances
We recomputed the decoding metrics after per-neuron normalization (max-normalization, the normalization of the encoding pipeline, z-scoring) and RSA with correlation distance (App. A.5). The FPS results of Section 4.3 hold under all of them. For Section 4.2, high-PC1 subpopulations still decode better than low-PC1 ones, but at 5–10% they no longer match random subsets, as the normalization removes the amplitude advantage of the few neurons that dominate the decoding metrics on raw responses. We now state this in the paper. Correlation distance normalizes each stimulus pattern rather than each neuron, and we only tested it on the FPS contrast, where the results are unchanged. The encoding manifold removes amplitude by construction, since each neuron is normalized relative to its preferred stimulus, which is why we use it to measure the organization of tuning.
W2 — Deeper, naturally trained models
A causal test in large foundation models is beyond the scope of this paper, and we state this as a limitation. We added two analyses in this direction. First, we compared 20 layers of seven naturally trained vision and video models with mouse V1 (Section 4.5, App. A.8). GW orders the layers robustly differently from CKA and RSA and separates layers with practically the same CKA. Second, on MNIST we tested ten ordinary changes of architecture, objective and regularization, including an MLP instead of the CNN (App. A.10). None of these changes targets how tuning is arranged across units. GW stays stable while the decoding metrics change, so the dissociation in Section 4.4 is specific to rearrangements of tuning.
W3 — False positives of GW
We agree and now quantify this failure mode (App. A.11). If the stimuli are relabeled in the same way for all neurons, GW stays exactly at 1. RSA and CKA detect permuted stimuli, but barely a global shift of the directions. If a shared stimulus set exists, fused GW detects both kinds of differences. Conversely, RSA, CKA and Procrustes are invariant to rotations of the neuron axis, which change the encoding manifold. The blind spots are thus complementary, which is why we propose GW as a complement to the existing metrics and not as a replacement. We removed the sentence that called this failure mode unlikely.
Q1 — NTF rank R and IAN parameters
R is chosen as the rank beyond which the reconstruction error does not improve substantially (Dyballa et al., 2024; 8–17 here). IAN has no neighborhood-size parameter, since it infers the kernel scale of each point from the data (Dyballa & Zucker, 2023). The encoding topology is stable for R ∈ {10, 15, 20} and for 50–100% of the neurons (Figure 9). We added these guidelines to App. B.3.