- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper explores how fast-adaptation of input/output mappings can adapt a meta-trained recurrent integrator to shifts in both input distribution and output targets. The authors demonstrate that the representations learned by the integrator are designed to facilitate fast-adaptation. Furthermore, the framework is shown to be robust to noisy feedback, and capable of adapting to contingency-reversal and cross-day representational drift in real neural data.
This paper should be rejected foremost because 1) the absence of many methodological and experimental details hampers any assessment of the claimed results and 2) there are abundant issues with the presentation.
Critical strengths
None
Critical weaknesses
The most pressing omissions involve the following:
● The description of problem setting is so general that it gives no insight into the actual data scheme (153). For example, do the test-time target actions (Eq. 7) relate to the training labels trained in the outer-loop (Eq. 6)?
● A main result of the paper is the relationship between the query geometry and fast-weight updates. However, the relevant equation (Eq. 11) describes a quantity (\Delta \ell^\text{fast}) which is never defined. As a result, it is unknown how the RHS was arrived at, but it is likely missing factors of \lambda^{j-i} or similar.
● The function of \tau_C for the adaptation to representation drift is never explained, nor its set value justified (297). Furthermore, the object “V” in the equation for the interface (Eq. 16) is never specified.
● No description of the training scheme or model hyperparameter settings is given for any experiment.
● The experiments and figures refer to a variety of interventions (365), alternative adaptation schemes (376), one-hot feedback (403), and supervised tuning schemes (423) that are either inadequately described in the main text or, more often, not described at all - sometimes even including the appendices.
● The neural data for the contingency-reversal experiment is never described, nor is the specific data used for the adaptation results (416) explained. As a result, the scope of the claimed adaptability to representation drift is not clear - can the model adapt to reversed-contingencies given neural activity from the reversed setting or the original setting?
● The main text fails to mention, let alone describe, the second data set used for the neural representation drift experiments (429). Furthermore, the training data for the model is described in the appendices as including imaging FOV and recording dates (772) without justification, as well as an unspecified “offline analysis variable” (787).
Issues with presentation includes the following:
● The comparison of the proposed model to alternatives (Fig. 3) and the main text discussion (403) reference an unknown value K. In addition, the scalar values labeled “feedback corruption” are never explained (Fig. 3).
● The main text claims a relationship between query representations and stimulus identity (355) that is not evident from the data as presented (Fig. 2). In particular, no explanation is given for what the observed block structure of the learned queries (Fig. 2b) corresponds to. As an aside, why do random queries result in high overlaps?
● The interpretation of the connection between the query geometry and the plasticity reads as nonsensical (260)
● The contingency reversal results (Fig. 4) mention “ALM activity” without explanation (395), and include multiple plots that are never discussed (panel B, and the middle and right plots of C and D)
Questions for authors
Abstract:
● description of framework is unclear - how does the “query” relate to the interface?
● last sentence summarizing results seems vacuous
Introduction:
● italicized question is ambiguous - are you asking if such a system can be constructed, what properties of an architecture allow for such modularity, or something else?
● it would be helpful to clarify that “query” = “task representation”
● the first two points in the summary of contributions are almost identical (094, 097)
● Repeated references to “learned representations” are vague
Related work:
● the connection between the current work and the referenced literature is often weak
● reference to motor memories (140) seems irrelevant
Method:
● Description of problem setting gives no insight into the actual data scheme (153)
● In the training data, do the test-time target actions (Eq. 7) relate to the training labels trained in the outer-loop (Eq. 6)?
● Eq 10: write z_n and d_n explicitly to highlight the “three factor” structure
● Eq. 10: why choose to set the write and forget rates independently?
● Eq. 11: \Delta \ell^\text{fast} is not defined. It is not clear how the RHS was arrived at, but it appears to be missing factors of \lambda^{j-i} or similar
● Unclear interpretation of the query geometry (260)
● The description of the input representation shift is unnecessarily vague (266)
● Fig. 1a,b: could be replaced by an illustration of the general concept
● Fig. 1c: uses notation that is inconsistent with the maintext
● Fig. 2b: What are “read” and “write” trials? In the demonstrated block structure, what delineates blocks? Why does “random” show high overlap?
● Fig. 2 caption: Introduces unseen notation of B_t, and “post-support”
● The spike statistics \mu_s and \sigma_s are not defined (296)
● \tau_C and its set value are never explained (297)
● Eq. 15: The description of V is insufficient: what is the “source-only activity basis” that makes up V? Is V a matrix?
● The description of the input-adaptive update is overly complex and could be greatly simplified (320-323)
● Fig 3: What is K here? Is this the same K as in Sec. 3.6?
● Fig 3: What do the scalar values for “feedback corruption” correspond to?
Experiments:
● An overview of the training scheme and hyperparameter settings should be provided
● The claimed stimulus-related query geometry is not obvious from the presentation of the data in Figure 2 (355-358)
● The last two interventions are insufficiently detailed, and the figure shows an additional 2 interventions not mentioned in the maintext (365-370)
● The alternative adaptation schemes need a maintext description
● One-hot feedback is mentioned but never described (403)
● The discussion of corrupted feedback needs to reference Fig. 3c (407-412)
● Need to include a description of the dataset and setting in which it was recorded (416). It is unclear what data is used for both training and evaluation of the adaptation - is the model adapting to reversed contingencies given neural activity from the reversed-contingency setting, or the training data? This is important for interpreting the results.
● Fig 4: A discussion of the reward-noise robustness results is completely absent from the main text
● Fig 4: What is “ALM”? The caption is also missing an explanation of the middle and right panels.
● No description of the dataset used for neural population drift analyses (429)
● Fig 5c: No description of the 7 supervised tuning schemes shown on x-axis
● No explanation of the referenced numbers (453)
Discussion:
● Indecipherable explanation of plasticity compatibility (469)
● Why would training the model to map neural recordings to action outputs imply anything about the biological plausibility of the model itself? (481)
Appendix:
● The data-generating scheme for the synthetic data has a level of complexity that needs to be motivated
● The description of how the dataset was constructed from the neural recordings is completely unclear - why is imaging FOV and date included (772)? The choice of “offline analysis variable” for the target is completely unclear (787).
Dear AC and Reviewers,
Thank you for your careful evaluation and constructive feedback. Your comments have helped us identify important directions for clarifying the paper’s positioning and strengthening its theoretical and experimental support. Given the scope of the revisions and additional validation needed, we cannot address these points thoroughly within the two-week rebuttal period. We have therefore decided to withdraw the submission and undertake a comprehensive revision. We sincerely appreciate your time and thoughtful suggestions, which will guide the next stage of this work. We look forward to sharing a substantially revised and strengthened version in the future.
Best regards.