- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes a theoretical account of representational drift in early sensory cortex. Starting with an efficient coding objective (inspired by Ganguli and Simoncelli) they derive differential Hebbian upate rules that perform stochastic gradient ascent on the expected log Fisher information. The update rule depends on pre- and post-synaptic activation as well as an uncertainty-dependent signal that varies per stimulus, U(s), and additive Gaussian noise. They compare this rule to existing similarity matching objectives that also claim to account for representational drift. The authors show that single neuron tuning drifts, while the population fisher information (FI) profile stays constant over time. The similarity matching network (SM) also drifts but has an uncorrelated FI profile. In both cases, the RSM is preserved, complicating its use as a signature of theoretical models of drift. The authors then analyze existing data from auditory and visual cortex in mice and report drifting tuning with stable FI and RSMs, which they claim supports efficient coding over SM models of drift.
Critical strengths
The paper overall is clearly written and easy to follow. The framework is experimentally testable and fits in well with existing efficient coding models. The three-factor update rule is normative and the time-derivative version adequately addresses the issue of locality for the pre and post derivatives. The authors also validate their findings in nonlinear networks and with time derivatives, strengthening their derivations. The data analysis done is across two sensory modalities which also strengthens the broad applicability of their work, and the limitations of the work are well addressed.
Critical weaknesses
1.The data analysis doesn't adequately establish that the efficient coding/differential Hebbian rule are the source of drift. In part because the theory/simulation design doesn't closely match the data. For example, the equation on line 163 imples that static stimuli produce no learning at all, since the weight updates are driven by changes in the stimulus through v^2. The data considered are from experiments with pure tones or fixed direction gratings that are static in the encoded dimension of interest, so it doesn't seem like this update rule would account for the mechanism in the recordings. The observed data in the drift could instead come from habituation, behavioral state, etc. Moreover, the data analysis could be more airtight. The metric the authors use to measure the FI stability is the pearson correlation, which is blind to changes in amplitude, and the data do clearly show changes in amplitude over time (see fig. 3D especially). The authors don't address this instead saying that FI is conserved over days. The model's FI also decays slightly, but the source of this theoretical decay isn't discussed or linked to the decay in the data. Moreover, the population vector (in)stability isn't shown, which is the most commonly used metric of representational drift in populations to my understanding. Cross-day decoding is also absent for the data and the model. Finally, the paper does not adequately rule out similarity matching in terms of the FI metric. The correlation in FI for the SM model being ~ 0 does not show that similarity matching fails to preserve FI. The authors note that the FI of the output is inherited from the input for this model (section 2.5) The input units have identical tuning so the input FI should be approximately flat, modulo some noise. If this is the case then you would expect that the pearson correlation of two flat lines should be ~ 0. The authors therefore fail to show whether this is inherited from the input or the SM itself. The data are clearly non zero, but in the brain the input would almost certainly not be flat.
- The claims in the paper are too strong for what is actually shown, and should be toned down. The paper claims to have a novel normative theory of drift, but the drift mechanism is noise driven diffusion on a solution manifold, which has been discussed in previous work by Pashakhanloo & Koulakov, 2023. The claims in this paper would be significantly strenghtened if the differences between this work and Pashakhanloo & Koulakov were discussed. The normative contribution of the paper instead seems to be in the learning rule; the authors, however, do not establish whether the drift is driven by this learning rule or by the additive noise in the learning rule. For example, does drift still occur if \sigma_w = 0? The paper spends considerable time discussing that the model results show that the efficient coding perspective and learning rule explain early sensory coding over the similarity matching objective. However, the results in Qin et al 2023 are meant to describe drift in the PPC and hippocampus, not in sensory areas, making it seem a bit like a strawman argument; showing that SM fails in auditory and visual areas is interesting, but these claims should be more measured. Moreover, drift in the olfactory cortex, which is quite well studied and even cited in the paper introduction (Schoonover et al., 2021), is not addressed here. It is not clear how the model would account for non-continuous stimuli. Also, one of the central results in Schoonover et al., 2021 is that more frequent stimuli drift more slowly in the model -- this is a hallmark of representational drift that is not addressed in the paper, and one which an overarching theory of drift in early sensory areas should address. Finally, the plausibility of the U(s) signal is overstated. The cited papers don't show that ACh fluctuates in the stimulus-specific trial-by-trial way that the theory requires, in particular during passive exposure.
Questions for authors
- A.2 assumes that the learned solution W has a fixed peak and w \propto 1/d (like in Ganguli an dSimoncelli) but this is not checked. Please check that width is proportional to stimulus density.
- How does the Gaussian additive noise assumption change the results from the Ganguli and Simoncelli paper, which used Poisson noise? Do the results from the Gaussian derivation hold for Poisson noise?
- Inputs are assumed to be noiseless, which is not biologically plausible even for early sensory areas. How does input noise affect results?
- The model relies on a learning signal U(s) which in turn requires current knowledge of the drifting tuning curves that is assumed to be calculated downstream. This is a circular assumption, given that tracking this tuning is precisely the problem of drift. Could you discuss this, and show robustness to U(s) which is either lagged or bias or inexact?
- The simulations rely on \dot{y} which is ill defined for small \delta t - this should be noted.
- Certain hyperparameters are missing (\sigma_w, SM learnign rates).
- Typos in the text often show e.g. "equation equation 3" (line 190).
- Are the drift rates between the SM and efficient coding models matched? It would be good to re-run simulations with matched drift rates s/t the RSM and FI changes are on more equal footing.
- What is the dependence of the model on M and N? M > N necessarily adds degeneracy. Does drift increase as M increases relative to N?
- The simulations rely on continuous and smoothly varying stimuli. How would this model apply to non-continuous sensory input (like in the olfactory cortex)? Moreover, the experiment used in the auditory dataset has different structure from the simulations (frequency is bounded, not circular) - could you discuss how this may affect your results?
- Does drift occur when \sigma_w is zero? How do drift and FI depend on \sigma_w? How does this account relate to the SGD-driven drift in Pashakhanloo & Koulakov, 2023?
- Do the population vector correlations and cross-day decoding show readout degradation despite stable FI in the data and the model?
- Suggest renaming v^2 to avoid confusion with v_t.
- V1 day ranges are different between fig 3 and fig 4. Could you add the later days to figure 3?
- Is there evidence for the environmental dependence of tuning width in early sensory cortex to motivate using the Ganguli and Simoncelli framework? If so, please cite, if not, please acknowledge.
- RSM changes are measured by Euclidean distance, which is not sensitive to noise. Could you also show how e.g. the Mahalanobis distance changes over learning?
- The exponent fit of 2 is only tested with one prior. Does that change if the prior is e.g. more sharply peaked?
3 comments
Checking in on our rebuttal
Thank you again for your helpful feedback. We wanted to check if you have had a chance to look at our revisions, and if there are any remaining questions or clarifications we can provide before the discussion period closes.
Checking in again
Dear reviewer qTBq, we wanted to check in once more since the discussion period ends today. We made extensive revisions to address your comments including a correction to the derivation in appendix A.2. Thanks again for your detailed feedback - we found them extremely helpful and we'd appreciate if you could take a look at the revisions and responses and let us know if there are pending concerns.
Response to reviewer qTBq
We thank the reviewer for detailed feedback. Below, we address the points not adequately covered in the general rebuttal (W: Weakness, Q: Question).
W1. Model/data mismatch. We agree the rule requires temporal variability in stimuli, and the Methods now state that we model natural sensory input rather than discrete stimuli. We interpret between-session drift as ongoing plasticity driven by natural experience. Yes, habituation and behavioural state may also contribute to drift but we focus on what population quantities remain stable despite drift and what plasticity rules might be driving that. We apologize this was not clear.
W2. Amplitude-blind metric. Please see general response 2 - we repeats the analysis with a scale-sensitive metric (Figure A22). The model’s apparent slight FI decay was an artifact of the comparison window whose earliest time point preceded learning convergence. It no longer decays when comparing time points after convergence.
W3. Population vectors and cross-day decoding. Both were found to decay and now reported including the corresponding ceiling/chance levels (Figure A14).
W4. Flat input FI. Thank you for this observation, please see general response 1. We now use heterogeneous input tuning for isotropic noise yielding a U-shaped FI profile (Figure A17), and rerun model comparisons with correlated noise (Figure 4).
W5. Strong claim about novel normative theory of drift. Please see general response 4. Drift occurs without synaptic noise, but slowly (Figure A6). We agree noise-driven diffusion on a solution manifold is not new, and the Discussion compares to Pashakhanloo and Koulakov.
W6. Qin et al. concerns PPC/hippocampus. The Discussion now states this and frames our focus as the solution space in the sensory cortex. We also state that our comparisons do not rule out similarity matching and suggest experiments to distinguish them.
W7. Olfactory cortex and non-continuous stimuli. Drift is slower for more frequent stimuli in our simulations (Figure A5). The Discussion now states that FI requires a continuous variable, so generalizing to olfaction would need a rule optimizing mutual information directly.
W8. U(s) plausibility overstated. We agree and have replaced biological plausibility with local in the abstract. Acetylcholine is presented as a candidate, and the Discussion states that U is computed from the normalized likelihood, which a downstream area might not have direct access to.
Q1. The width assumption. Thank you for this important question. The learned widths were uniform, so the width assumption of Ganguli and Simoncelli does not hold in our model. The weight budget constrains the integral of J, so the rederived optimum is J* proportional to p rather than p squared (Appendix A.2). The exponent of 2 in the original simulations arose from input tuning that was not sufficiently narrow which biases the Fisher information profile in small networks, and we mistook that the widths depended on density without checking. We apologize for the oversight. With sufficiently narrow input tuning, the exponent measured in our revised simulations is around 1 (Figure A2).
Q2. Poisson noise. Results hold for Poisson noise (Figure A4) because the optimum depends on the resource constraint which does not alter the response amplitude.
Q3. Input noise. Results hold when inputs have nominal noise (Figure A7).
Q4. Inexact U(s). Results are robust to biased/noisy U, but not to delay i.e., when U is estimated using drifted tuning curves which we discuss in the text (Figure A8).
Q5. Time derivative at small step sizes. A variant accumulating the derivative product in an eligibility trace removes the dependence on step size and reaches the same FI allocation (Appendix A.5, Figure A3).
Q6, Q7, Q13. We added hyperparameter values, fixed equation references, and velocity symbol.
Q8. Matched drift rates. All comparisons are now done with models calibrated to comparable drift rates (Figure A16).
Q9. M and N. FI profile and stability hold for M/N from 0.2 to 10 (Figure A9). Drift rate was independent of M because synaptic noise is N-dimensional for each neuron.
Q10. Bounded auditory axis. The model applies to bounded variables. For data, results were similar when ignoring the extreme tones or using one-sided differences at the extreme tones, so circularity was not assumed.
Q11. Please see W5 response.
Q12. Please see W3 response.
Q14. Data day ranges are now consistent across figures.
Q15. Evidence for environmental dependence of tuning width. As discussed in response to Q1, our findings do not hinge on that assumption.
Q16. Mahalanobis distance. Stability is comparable under both euclidean and Mahalanobis metrics (Figure A22) because the FI profile is exactly the near-diagonal band of the Mahalanobis matrix.
Q17. Sharper prior. FI profile and exponent hold across prior sharpness and network sizes (Figure A2).