- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors trains a recurrent neural network to predict upcoming views from self-motion and current view. The training is done on either 1, 5, 20, or 40 environments generated with RatInABox (George et al., 2024) and RatVision (Abrate, 2026). The main findings are:
- The prediction loss improve on seen and unseen environments when increasing the number of training environments
- A selection of 25 ring units are more uniformly distributed in the models trained on more environments
- Place units tends to rotate with the ring units
Critical strengths
The question of how spatial representation remaps across environments is an important question.
Critical weaknesses
- Positioning relative to prior work and novelty
Prior work is only briefly covered in the introduction section, which makes it hard to asses the contributions. This work appears closely related to Abrate et al. (2026). As I understand, it uses the same data generation tools RatInABox (George et al., 2024) and RatVision (Abrate, 2026) to train the same architecture, with the same unit classification pipeline. The paper acknowledges this connection, for example by describing the model as “similar to that of Abrate et al. (2026)”. However, it would help to explicitly state how much of the pipeline is inherited and to highlight the contributions that arises from building upon it.
As I understand it, the main difference is the training data generated. Abrate et al. (2026) generated different training groups based on different locomotor development phases in a single environment, whereas this work replaced that with a fix set of environments explored with a single trajectory type. Another difference is that the model is trained to autoregressively predict the next five visual observations, which I assume follows Levenstein et al. (2024) whose setup is also similar. However, because this work does not properly situated itself relative to prior work, the motivations, differences and novelty are not clear.
- The main generalization result has previously been discussed
One of the main contributions is that training on more environments improve performance on held-out environments generated by the same procedure (i.e. from the same distribution space), compared with model that were trained on a smaller subset of that space. This finding is consistent with a substantial body of prior work, for example [1-6]. The paper would benefit from discussing these results and clarifying what this finding adds to previous work.
[1] Baxter, J. (2000). A model of inductive bias learning. Journal of artificial intelligence research, 12, 149-198.
[2] Maurer, A., Pontil, M., & Romera-Paredes, B. (2016). The benefit of multitask representation learning. Journal of Machine Learning Research, 17(81), 1-32.
[3] Cobbe, K., Klimov, O., Hesse, C., Kim, T., & Schulman, J. (2019, May). Quantifying generalization in reinforcement learning. In International conference on machine learning (pp. 1282-1289). PMLR.
[4] Zhang, C., Vinyals, O., Munos, R., & Bengio, S. (2018). A study on overfitting in deep reinforcement learning. arXiv preprint arXiv:1804.06893.
[5] Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners. OpenAI blog, 1(8), 9.
[6] Raventós, A., Paul, M., Chen, F., & Ganguli, S. (2023). Pretraining task diversity and the emergence of non-bayesian in-context learning for regression. Advances in neural information processing systems, 36, 14228-14246.
- Ring unit analyses would benefit from further support
Ring units are defined as the 25 directional units with the highest co-rotation score. However, Figure 4b shows a continuous spectrum of co-rotation score with not clear separation at this cutoff. To better support that the results follow from this property and not this particular cutofff, all ring-based results should be repeated for different set sizes, e.g. top 10%, 10-20%, etc or by range of co-rotation score (1-0.9, 0.9-0.8, etc.). As of now, it is unknown if the results are robust beyond trends shown for only 25 units. Moreover, Ring units are also drawn from directional units, defined with a less stringent criterion than the head direction units also used in the paper. It would be informative to see whether the results hold when ring units are selected using that standard criterion. Furthermore, the common population rotation is estimated by the mode. Showing the distribution of changes in preferred direction across directional units would confirm that it is unimodal and that the mode is an appropriate summary.
Questions for authors
Section 2 states that the training environment of each arm where "drawn at random from the pool of 50 for each seed, and the remaining environments were unseen and used only for testing.". Does that mean the test set differs across arms? Is my understanding correct that model trained on 1 environment are tested the other 49 environments, and those trained on 40 environment tested on 10? Could the arms be compared on a fixed common held-out set, exact same environments excluded for every arm? This would ensure that the comparison is not influenced by a difference in test environments.
Appendix D mentions that “fields were grown with a threshold rising from 0.1 in steps of 0.05”, but it does not precise how those increasing threshold are applied. Could the authors describe the procedure in more detail?
3 comments
Following up on the common held-out set: all 20 networks were scored on one fresh set that no network had seen. The gaps were 79%, 40%, 16% and 2% after 1, 5, 20 and 40 environments (paper: 89%, 50%, 22%, 3%), and 3% for the matched-data networks, so the ordering is unchanged. Details are in our follow-up general comment and the revised PDF (Appendix G, Fig. A9).
I appreciate that the revision improves the positioning of the paper relative to prior work. Beyond that, however, the responses to my concerns were unfortunately too incomplete to resolve them. The paper’s central result, that training on a more complete subset of data from a generator improves performance on held-out data from the same generator, is expected from prior work. My concerns about the ring unit analyses were only partially addressed. For example, the new results vary the ring size from the top 10-50 units instead of examining disjoint bands across the full score spectrum, which would show that the results follow from co-rotation and not from an arbitrary cut-off of a few top units. Moreover, these new results show that the difference in tiling between training arms weakens for the top 10-15 units, which increases this concern. Therefore, I will unfortunately maintain my score.
Response to Reviewer oeAu
We thank the reviewer for concrete suggestions, all of which we have taken up.
A new table (Appendix B) does this. Our network belongs to a well-established class of predictive models of hippocampal function (Recanatesi et al., 2021; Uria et al., 2020; Levenstein et al., 2024). Inherited from Abrate et al. (2026): its single-layer form, the RatInABox trajectories and the classification thresholds. Adapted: the five-step rollout (following Levenstein et al., 2024, as the reviewer surmises), a self-motion embedding, a carried hidden state, and the RatVision renderer (Abrate, 2026), which we substantially extended to generate procedural environments. New: the procedurally generated environments, training arms that vary the number of environments, the matched-data control, and the ring, clamping and field-frame analyses. The question also differs: what transfers to unseen environments, rather than how locomotor development shapes coding.
Agreed, and thank you for the references, now discussed in Section 1. We present the setting, not the effect, as new. The paper adds that the effect reflects diversity rather than the amount of data (the increase in prediction error from seen to unseen environments was 5% after training in 40 environments, against 50% in five, with the total amount of training data matched), and shows which parts of the representation carry over: a coherent directional ring forms with any training, but its even tiling needs diversity. It also makes a testable prediction for place cells, a fundamental component of the hippocampal cognitive map, now supported by a causal test: clamping the ring weakens place maps' alignment with it (Fig. A8).
All three are done (Appendix G):
Repeating the clamping and place-field analyses for each ring definition needs new runs, so these are not yet done; we would be glad to add them for the camera-ready if the reviewers find them useful.
Your reading is correct: the held-out sets differ (49, 45, 30 and 10 environments for networks trained in 1, 5, 20 and 40), though all come from the same generator and the gap is relative to each network's own seen environments. We are generating a fresh set that no network has seen, as part of the out-of-distribution tests, and will report every network on it during the discussion.
We have rewritten it step by step (now Appendix E). Each rate map is min–max normalised; bins above 0.1 form candidate regions (at least 10 bins, peak at least 0.5); each is grown by raising the threshold in steps of 0.05, following regions that split; the field is the lowest threshold that covers at most half the map with split-half stability of at least 0.25.
We hope these revisions address the reviewer's concerns, and we would be glad to answer further questions.