- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces Connectome-as-Policy, a reinforcement learning framework that uses the connectome derived from C. elegans to define a fixed topology for the policy network, with standard reinforcement learning algorithms learning the synaptic weights and the parameters of the neural dynamics (membrane capacitance and potentials). The author benchmarked this algorithm on a chemotactic task plus several standard RL environments and compare it to standard alternatives (mlp, lstm).
Critical strengths
None
Critical weaknesses
In my opinion this paper does not meet the standard of acceptance in several ways.
- The authors failed to delineate a clear problem their algorithm is trying to solve, the claim that "an experimentally identified connectome can function directly as a trainable reinforcement learning policy therefore remains largely unexplored" appears unjustified given the same literature the authors cite (Sakamoto et al. (2021); Churchland & Garcia-Ojalvo 2026; Chung & Kim 2026) where many prior works explore connectome-constrained training, including in a RL setting.
- Even assuming the stated motivation, the proposed experiments do no support meaningful advancements: in the main-text Figure 2,3,4 author explore standard reinforcement learning algorithm (all yielding equivalent performances), a comparison that is completely independent of the proposed contribution since all share the same fixed topology. In the one test the author offer against other possible strategies (Fig.5 in the Appendix) the proposed worm-based strategy yields equal-or-inferior performances to the other baselines (e.g random sparse) but the author themselves state that two runs are insufficient "to claim statistical superiority of any topology", which makes the inclusion of this result confusing in the first place.
- One of the authors' claimed contributions is to "enable circuit-level interpretability", however the only related analysis (Appendix B, Fig. 2) fails to support such claim as it is limited to a visualisation of a small fraction of neuron, with little to no interpretation or discussion of what exactly this method is offering in terms of interpretability of the circuit-performed computation.
- The motivation behind applying a worm-derived fixed connectome on generic RL tasks (that include controlling a lunar lander) is puzzling.
- The paper is often imprecise and unpolished, with many overlapping/cut labels (e.g. Figure 2; Appendix Fig. 4,5,7 ) or very small/illegible panels (e.g. Fig. 3, Appendix Fig. 6).
Questions for authors
In general, the experiments do not provide convincing evidence for the merit of the proposed algorithm and I disclose that a substantial redesign of the manuscript would be needed to affect my assessment. Some quantitative questions include:
- What is the takeaway message of Figure 2? All explored RL algorithm appear roughly equivalent. And how do the authors justify the fact that performances seem to degrade over iteration/episode (decreasing avg. rewards and increasing errors)?
- How is the Connectome-as-Policy applied to generic, i.e. non worm-related, RL environments?
- Several of the reported returns in Fig. 6a show heavily non-monotonic trends, irrespective of the method: does this indicate a failure of training? There seems to be inconsistency between the reported values of Fig.6b and the traces in Fig.6a, for example LunarLander reports positive peak returns while the corresponding panel a shows strictly negative (< -100) values.
- How do the authors assess whether the claimed robustness (Fig. 5) of their technique relates to other approaches? What counts as a robust strategy in the first place?
- What is the mechanistic insight offered by the proposed method that other alternatives lack?
- The authors used a much simplified C. elegans connectome (~300 parameters), while recent work have used the exact full connectome (~3000 synapses): why was the simplified connectome chosen when the complete one is available? Do the result change in a meaningful why by scaling the connectome?