- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates whether visual learning improves number sense beyond the emergence of numerosity-selective units. Using dot-array stimuli, it analyzes the population-level geometry of numerosity and proportion representations across network training conditions. The authors report that structured visual learning separates these representations and relate this separation to improved decoding, conflict resolution, cross-condition generalization, and robustness to cross-quantity ablation.
Critical strengths
-
The paper addresses an interesting, well-motivated question and moves beyond single-unit selectivity toward population-level organization and functional readouts. The behavioral motivation provides a useful perspective on what visual learning might contribute to numerical representations.
-
The experimental coverage is substantial, including supervised and self-supervised learning, shuffled-label controls, and several synthetic-image distributions. Replication across multiple initializations, together with supplementary ResNet-50 geometry results, strengthens the descriptive findings.
Critical weaknesses
-
The angle–ablation relationship is sensitive to unexplained exclusions. Figure 6d excludes the noise-trained and label-shuffled networks. Recomputing the correlation from the rounded means in Tables 1 and 3 reproduces approximately (r=-0.88) for the selected states, but only (r=-0.30) when all ten states are included. Low baseline decoding performance could motivate excluding these conditions, but an explicit criterion and sensitivity analysis accounting for baseline decodability are needed before interpreting this relationship as evidence of functional independence.
-
The connection between the motivating conflict task and the geometric analysis needs clarification. Geometry is defined using total numerosity, (N=W+B), whereas the hard proportion task defines congruency using white-dot count (W) and proportion (P). Figure 6b instead evaluates restricted total-numerosity comparisons under (N/P) conflict (Appendix A.6; Figure S2). These are distinct tests, so the reported correlation does not directly explain the behavioral effect used to motivate the paper. Matched geometry–behavior analyses, explicit restriction thresholds, and joint consideration of congruent and incongruent performance would strengthen the interpretation.
-
The ablation lacks controls for nonspecific perturbation effects. Appendix A.7 explicitly removes the opposite quantity’s subspace from raw activations without recentering, while keeping the affine decoder fixed. This removes the projected activation mean as well as quantity-dependent variation, potentially shifting decoder outputs independently of information loss. A mean-preserving or analytically bias-corrected ablation, together with matched-rank random-subspace controls, is needed to distinguish representational interference from sensitivity to the intervention.
Questions for authors
See weakness
4 comments
Thanks for the reply! I appreciate the explanation from the authors. However, I think my essential concerns cannot be fully addressed by the reply. Perhaps some careful polishing and rewriting would make this work more ready for publication.
Best,
Reviewer BEth
Thank you for your constructive feedback. We acknowledge that our previous response did not fully address your central concerns. In this further revision, we have made every effort to address these points more directly and thoroughly.
In particular, we have added and substantially revised figures and explanations to clarify:
(1) the explicit exclusion criterion requiring pre-ablation decoding performance to exceed that of a constant predictor (Q1),
(2) the distinction between the and conflict conditions (Q2), and
(3) the importance of mean preservation in the ablation analysis (Q3).
We believe these clarifications will also be valuable to other researchers working on related problems, and we sincerely appreciate your feedback, which has helped us improve the clarity and rigor of our work.
[Q1] The angle–ablation relationship is sensitive to unexplained exclusions. Figure 6d excludes the noise-trained and label-shuffled networks. Recomputing the correlation from the rounded means in Tables 1 and 3 reproduces approximately (r=-0.88) for the selected states, but only (r=-0.30) when all ten states are included. Low baseline decoding performance could motivate excluding these conditions, but an explicit criterion and sensitivity analysis accounting for baseline decodability are needed before interpreting this relationship as evidence of functional independence.
Answer
We agree that our original exclusion criteria were not sufficiently justified. As the reviewer pointed out, assessing ablation-induced damage requires sufficiently high baseline decoding performance for a meaningful decrease to be observed. Based on this rationale, we excluded the noise-trained and label-shuffled conditions because their pre-ablation errors (MAEs) were substantially higher than those of the other conditions.
In the revised manuscript, we have established an explicit exclusion criterion based on a constant predictor that always outputs a fixed value. Specifically, we exclude conditions whose pre-ablation MAE exceeds that of the constant predictor, as ablation-induced damage cannot be meaningfully interpreted when the original decoder already performs worse than this baseline. Under this criterion, the noise-trained and label-shuffled conditions are excluded (Fig. S3, line 902-908).
Finally, to improve transparency and avoid confusion, we have substantially expanded the tables 1-4 to report the numerical values underlying all figures, allowing readers to examine the results directly.
[Q3] The ablation lacks controls for nonspecific perturbation effects. Appendix A.7 explicitly removes the opposite quantity’s subspace from raw activations without recentering, while keeping the affine decoder fixed. This removes the projected activation mean as well as quantity-dependent variation, potentially shifting decoder outputs independently of information loss. A mean-preserving or analytically bias-corrected ablation, together with matched-rank random-subspace controls, is needed to distinguish representational interference from sensitivity to the intervention.
Answer
We acknowledge that our original ablation analysis overlooked the importance of preserving the activation mean, and we sincerely appreciate your valuable feedback.
In the revised manuscript, we introduced mean-preserving ablation to avoid unintended shifts in the activation mean and added matched-rank random-subspace controls to distinguish the effects of removing quantity-related information from nonspecific perturbation effects (Fig. S3 and Appendix A.8).
Furthermore, we have substantially expanded Fig. S3 and Appendix A.8 to explain the differences between ablation methods, their potential confounds, and the importance of appropriate controls. We hope these clarifications will also benefit researchers in cognitive neuroscience who employ similar representational ablation analyses.
[Q2] The connection between the motivating conflict task and the geometric analysis needs clarification. Geometry is defined using total numerosity, (N=W+B), whereas the hard proportion task defines congruency using white-dot count (W) and proportion (P). Figure 6b instead evaluates restricted total-numerosity comparisons under (N/P) conflict (Appendix A.6; Figure S2). These are distinct tests, so the reported correlation does not directly explain the behavioral effect used to motivate the paper. Matched geometry–behavior analyses, explicit restriction thresholds, and joint consideration of congruent and incongruent performance would strengthen the interpretation.
Answer
We agree that our original manuscript did not clearly distinguish the conflict conditions, which may have caused confusion about the connection between the behavioral and geometric analyses.
In the original manuscript, we used conflict in Fig. 2d to align with the experimental paradigm of Hamamouche and Cordes (2023; Fig. 2c), whereas subsequent analyses used conflict. We acknowledge that this distinction was not sufficiently explained.
In the revised manuscript, we now present both and conflict conditions in Fig. 2d, showing that they yield similar trends. We consistently use conflict in subsequent analyses because it provides a more general criterion based on total numerosity (), directly matching the quantity used in our geometric analyses. Specifically, conflict occurs when the image with greater total numerosity has a lower proportion of white dots (), or vice versa. We have added Fig. S7 to illustrate these definitions and their relationships. We have also directly addressed the three specific points raised in your review:
(1) Matched geometry–behavior analyses:
We have expanded our analyses to include comparisons across architectures as well as training conditions (Fig. 7). We now examine how representational geometry relates to two main functional measures: conflict hard-task performance (Fig. 2d), and ablation-induced damage. These expanded analyses allow us to evaluate the geometry–behavior relationships more consistently across different models and training conditions.
(2) Explicit restriction thresholds:
We have clarified the definition of the hard task, consistently applied across the relevant analyses. Numerosity () takes discrete values from 1 to 30, with a step size of 1, while proportion () has a step size of (0.167). The hard task compares image pairs differing by exactly one step in both and . In contrast, the other comparison tasks randomly sample image pairs from the full range of (line 236).
(3) Joint consideration of congruent and incongruent performance:
We have clarified why these conditions must be examined separately. Although pretrained models achieve higher overall accuracy than untrained models, both perform well on congruent pairs (Fig. S6). The advantage of pretraining becomes apparent primarily on conflict pairs, where numerosity and proportion favor opposite answers. Thus, overall accuracy can obscure the benefit of pretraining, whereas conflict performance more directly reveals differences in the ability to make correct judgments when competing quantity cues disagree. We have emphasized this distinction in the revised manuscript (Fig. S6).
Furthermore, we have standardized the terminology throughout the manuscript: consistently denotes the white-dot proportion () (line 126, 225), and we consistently use "conflict" after initially defining it as equivalent to "incongruent" (line 228).
Although space limitations prevent us from plotting every combination of the expanded analyses, we have substantially expanded Tables 1–4 to report all numerical results, allowing readers to examine these relationships directly.
We sincerely appreciate your feedback, which helped us clarify the experimental conditions and strengthen the connection between our behavioral and geometric analyses.
Inclusion of all training states, conflict-task clarification, and corrected ablation with direct manipulation.
[Weakness 1] The angle–ablation relationship is sensitive to unexplained exclusions. Figure 6d excludes the noise-trained and label-shuffled networks. Recomputing the correlation from the rounded means in Tables 1 and 3 reproduces approximately (r=-0.88) for the selected states, but only (r=-0.30) when all ten states are included. [...]
- We included all ten training states in the revised angle–ablation analysis and confirmed that the correlation remained significant (Figures 7d, S9; lines 452–454; see Q3 for details of the revised ablation method).
We thank the reviewer for identifying the unexplained exclusions. Following the concern raised in Weakness 3, we replaced the original ablation protocol with a corrected mean-preserving method to avoid shifts in activation means. Using this revised protocol, we repeated the angle–ablation analysis across all ten training states, including Noise-trained and Label-shuffled. The correlation was significant (r = -0.86, p = 0.0014; Figure 7d), providing a more appropriate assessment of the relationship between subspace orientation and cross-quantity interference.
The two states were originally excluded because their baseline numerosity decoding was near chance (Noise-trained: 5.9%; Label-shuffled: 4.9%; chance: 3.3%), substantially below the other conditions (18.7–29.2%). Their baseline errors were also no better than those of a constant-median predictor (Figure S9d,e). We were concerned that such poor baseline decodability would make ablation damage difficult to interpret. However, we acknowledge that this was not an objective exclusion criterion. The revised analysis therefore includes all ten states, and we explicitly report their poor baseline decodability while interpreting the correlation as supporting rather than causal evidence. X [Weakness 2] The connection between the motivating conflict task and the geometric analysis needs clarification. Geometry is defined using total numerosity, (N=W+B), whereas the hard proportion task defines congruency using white-dot count (W) and proportion (P). [...]
- We clarified the relationship between NW/P and N/P conflict and confirmed pretraining-induced separation under both, while focusing subsequent analyses on the more general N/P framework (Figures 2d, S3; lines 223–235).
Thank you for raising this important point. We clarified that the motivating task defines conflict between white-dot count (NW) and proportion (P), whereas our principal geometric analysis uses total numerosity (N) and P. Since NW=NP, NW/P-incongruent pairs are a subset of N/P-incongruent pairs, but the two tests are not equivalent (Figure S3a).
We now compare pretraining effects under both conflict definitions (Figure 2d) and report the corresponding NW/P and N/P geometries (Figure S3b). Both conflict tasks show a qualitative pretraining advantage, and both geometric analyses show greater separation after pretraining. The task definitions and pair-sampling procedures are described in Appendix A.6, with congruent and incongruent performance reported in Table 1. Together, these analyses clarify the relationship between the motivating NW/P conflict task and the broader N/P representational framework, while showing consistent pretraining effects under both definitions. X [Weakness 3] The ablation lacks controls for nonspecific perturbation effects. Appendix A.7 explicitly removes the opposite quantity’s subspace from raw activations without recentering, while keeping the affine decoder fixed. [...] A mean-preserving or analytically bias-corrected ablation, together with matched-rank random-subspace controls, is needed to distinguish representational interference from sensitivity to the intervention.
- We corrected the ablation protocol to preserve activation means and added matched-rank random-subspace controls (Figures 4, S6, S7, line 149-157)
Thank you for the thoughtful comments. We agree that removing raw projected activity could shift decoder outputs by also removing the projected activation mean. We therefore replaced this procedure with mean-preserving ablation, which removes stimulus-dependent variation along the opposite quantity subspace while preserving the activation mean. We held the decoder fixed and included matched-rank random-subspace ablations as controls (Appendix A.8; Figures S6, S7).
Using this corrected protocol, we further tested functional relevance by manipulating principal angle and representational overlap in pretrained networks across 12 architectures (Figure 4; Appendix A.7). Increasing the angle reduced cross-quantity ablation damage with little effect on decoding accuracy, whereas increasing overlap reduced accuracy and increased damage. Together, these analyses address the methodological concerns about ablation while providing direct functional evidence for the role of representational geometry in quantity readout.