- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper introduces Relative Jacobian Nonlinearity (RJN), a measure of how an encoding model’s local feature sensitivity varies across stimuli. RJN compares geometry-weighted Jacobians using a pairwise discrepancy normalized by the combined sensitivity of each pair. It provides an additive decomposition into magnitude disparity and weighted directional disagreement, together with stimulus-level scores whose average recovers the overall measure.
The evaluation uses neural encoding models for four NSD participants, two visual representations, and twelve layers. The main findings concern regional differences, stimulus rankings beyond response amplitude, and the dependence of the relationship between predictive fit and mapping variation on the chosen perturbation geometry.
Critical strengths
- Explicit treatment of relative Jacobian variation. RJN normalizes each pairwise Jacobian discrepancy by the combined sensitivity of the two mappings before aggregation. This provides a useful alternative to normalization at the level of the entire Jacobian field and makes the scale of each comparison explicit.
- Useful decomposition of mapping variation. Decomposing the score into magnitude disparity and weighted directional disagreement provides a helpful framework for interpreting how local mappings change across stimuli. The additive structure connects these components to the overall score and supports more informative analyses than a single scalar summary.
- Distinct stimulus-level results with improved rank stability. Despite nearly identical voxel rankings, RJN and (V_C) produce different stimulus-level rankings. RJN also shows higher overall rank consistency across the evaluated refits, suggesting that pair-relative normalization provides a complementary and potentially more reproducible view of how mapping variation is distributed across images.
Critical weaknesses
Major weaknesses
- The directional term remains coupled to relative norm imbalance.. For positive Jacobian norms, writing , gives . Thus, the directional term depends on both angular and norm difference. The authors explicitly acknowledge this weighting, and the decomposition is mathematically valid. However, a contrast carried by the directional term does not alone establish a difference in angular variability independently of norm difference.
- After reading the paper, I think the new interpretive value that RJN can provide is not very clear. As the paper acknowledges, (V_C) also supports magnitude/direction decomposition and a mean-conserving stimulus allocation. Empirically, RJN and this baseline have mean voxelwise Pearson and Spearman correlations above 0.999, and the energy baseline reproduces the principal regional ordering, including the FFA contrast. The distinction is more apparent at the stimulus level: total-score rankings have median Spearman correlation 0.921 and top-100 overlap 0.84. RJN also improves median refit rank correlation from 0.898 to 0.931, although both methods have median top-100 overlap of 0.76. These are positive differences, but the paper could more clearly demonstrate what substantive interpretation becomes available through the changed ranking. A focused example explaining the significance of images selected differently by the two methods would strengthen the contribution. This does not require RJN to universally outperform (V_C), but it does require a clearer account of when the distinction matters.
Minor weaknesses:
- The results section is difficult to follow in places. Text placement around figures and tables sometimes interrupts the reading order, making it difficult to locate the continuation of an argument. Several paragraphs also have many numerical results without a sufficiently explicit takeaway. A clearer progression from question to comparison to conclusion, together with a brief concluding sentence in each subsection, would improve readability.
- Figure 4 needs more explainations.
- The legend texts in figure 5G overlap with panel above and are partially clipped.
Questions for authors
Questions
- Which substantive conclusion or stimulus-level interpretation is enabled by pair-relative normalization but is not recovered by the corresponding energy allocation?
- Does the FFA-2 versus FFA-1 difference persist for unweighted angular disagreement ( as mentioned above, solely angular difference) when comparing pairs with similar norm ratios?
Overall assessment
I am currently leaning toward weak rejection, although I consider this a borderline paper. The construction appears technically coherent, the presentation is careful, and the empirical controls are a strength. My main reservation is the significance of the contribution beyond the closely related energy baseline, together with the limited interpretive validation of the differences between them.