- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
From my understanding, I believed this is what the author has done in a simplified explanation (in my own words): there are five elements to the system:
- visual input: sequences of images (input)
- motion prediction: model's estimate of optical flow (output)
- neural connections are fixed.
- model parameters: to be trained to adjust parameters such as synaptic gains, neural time constants
- calcium image recording: these are external evidence for comparing's model's "internal" (like the neural activation) predictions with responses measured in a fly.
The paper has two main steps:
Firstly, several connectome constrained networks re trained on the same optic-flow prediction tasks. The connectivity if fixed, but the model parameter is learned.
Secondly, the authors chooses which experiment would best distinguish those networks by jointly select which cell type to record and which visual stems to present. The resulting calcium recording can be compared with each model's predicted recording to update which models are better supported by the evidence.
Critical strengths
I believe the author has a clear motivation, the connectom constrained networks with similar task performance can make incompatible predictions about the neural activity. Simply put, the same input/same output may have very different "internal" representation. So the paper propose method to see which recording would distinguish them.
The paper was written generally quite clear. Although the area of focus is different from a typical submissions into ICLR, however, in my view, this is good thing for ICLR to have a diverse topics.
The paper also shows a detailed evaluation and practical constraints, for example the 91 trained network.
Critical weaknesses
My main concern is that the paper provides a potentially valuable contribution to neuroscience. However, the techniques used in this paper, such as expected information gain (EIG), “Bayesian experimental design” and “measurement-aware Bayesian experimental design" are established techniques, and the methodological advance primarily lies in combining measurement modeling, joint target–stimulus selection, and experimental constraints for connectome-constrained networks.
Also, I believe “Bayesian experimental design” is an established term. However, the full phrase “measurement-aware Bayesian experimental design” appears to be the authors’ own proposed terminology. What is the need to invent such a term?
I found that the methodologies from this paper, has no broader machine learning insights. The applicability beyond this setting are not clear to me. I am not sure if this paper is a good fit for ICLR, but instead, can make a good paper in neuroscience literature.
Questions for authors
n/a