- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper builds a closed-loop environment for language-model agents in a whole-brain LIF model of adult Drosophila (FlyWire connectome), with dopamine-gated plasticity at KC→MBON synapses. Three tasks—teach (open-loop), diagnose (closed-loop), and erase—reveal three substrate properties (odor self-recruits dopamine via KC→DAN synapses; learning alters that dopamine; memories cannot be truly erased), and are used to benchmark agents including threshold rules, an approximate Bayesian player, Claude Sonnet 5 (zero-shot), and Qwen3-32B (zero-shot and multi-round GRPO).
Critical strengths
-
The novelty of the environment is solid: this is the first closed-loop environment built on a genuine whole-brain spiking connectome model (as opposed to text-based or probabilistic generative environments) in which LLM agents can manipulate the system through experiments, with outcomes exactly scored by the simulator.
-
The experimental design is complete: it includes three controls—shuffled features, Morgan molecular fingerprints, and character n-grams. After the preregistered test failed (median rank of 45/111 for the key compound), the exploratory follow-up (letting the model name the compound first, then having the fly smell it; median rank of 1) cleanly explains the mechanism—the interface operates through the model's chemical knowledge rather than a representation shared with the fly. The logical loop is fully closed.
Critical weaknesses
-
The evaluation scale is small, and several key comparisons fail to reach statistical significance. Only 60 test flies, 74 teaching configurations, and 7 odors are used; the authors themselves concede that "a difference of 0.04 is at the edge of the resolution of this sample size."
-
The evidence for the scale and stability of the RPO training is insufficient: only 30 steps and a single training run; the brain-model reward training for the teach task was terminated early at steps 59/12/16 ("when we moved to the closed-loop tasks," Appendix C); and the first GRPO run for the diagnose task was discarded after 5 steps due to temperature and learning-rate issues (Appendix D). The claim that "30 steps of GRPO elevates Qwen3-32B to Claude's zero-shot level" is one of the highlights of the paper, yet it is supported by neither multi-seed training variance nor convergence analysis, leaving the robustness of the conclusion unclear.
Questions for authors
See weaknesses.
Thank you for raising the question of scale. The seven-odour panel is small, but it lets us cover every single teaching target and every ordered pair with one odour to move up and one to move down. Those cases and 18 three-target cases make up the 74 profiles. The clearest teaching result is what happened to the protocols selected by search. The surrogate predicted a success rate of 0.988 for them. When we ran those same protocols on the spiking model, they scored 0.749.
In diagnosis, the 60 flies leave considerable uncertainty around Sonnet’s 0.039 lead over the threshold rule (paired 95% CI −0.002 to +0.079). We can say more about how they made their decisions. Sonnet always respected the instruction that at most two odours had been trained. Giving the rule the same cap reduced false alarms from 102 to 34 among the 111 untrained odour–fly pairs whose responses had shifted. On 60 fresh flies the cap again reduced false alarms, though it also missed more trained odours. The balanced score on those flies was 0.797 with the cap and 0.819 without it.
For GRPO, Appendix C reports the shorter teaching runs. The diagnosis run in Appendix D used 240 training flies. We stopped an initial five-step pilot on the basis of its training behaviour, before testing its trained policy. In the subsequent run, we evaluated each checkpoint on the same 60 held-out flies. At steps 0, 10, 20 and 30, Qwen named too many odours as trained on 42, 32, 20 and 14 flies, respectively. Its balanced score rose from 0.765 to 0.830 (paired gain 0.065, 95% CI 0.013 to 0.121). We will describe the result in the abstract as a gain from 0.765 to 0.830 in one 30-step training run. Sonnet’s zero-shot score of 0.832 gives readers a reference on those same flies.