- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates how neural circuits accumulate evidence during activity-silent decision-making. The authors train recurrent neural networks with STP and show that STP promotes step-like decision dynamics. Through circuit analysis and a simplified theoretical model, they propose that evidence can accumulate in synaptic efficacy, eventually triggering a rapid transition to a decision state. The results also suggest potential benefits for energy-efficient neural computation.
Critical strengths
-
The paper addresses an interesting question that is how can neural circuits accumulate evidence when neuronal activity remains low before a decision.
-
The comparison with static RNNs shows that STP leads to more step-like decision dynamics, even without explicitly encouraging this behavior during training.
-
The authors use choice-tuning, connection pruning, and neuronal silencing to identify the neural populations and connections involved in decision-making.
-
The simplified dynamical model provides a clear explanation for abrupt decision transitions through changes in network stability. The spike-count analysis also suggests potential energy-efficiency benefits.
Critical weaknesses
-
The central claim that evidence accumulates in synaptic efficacy is not directly demonstrated in the trained RNNs, as the main mechanistic explanation comes from a separately constructed theoretical model.
-
Step-like activity also occurs in static RNNs, suggesting that STP is not necessary for activity-silent decision-making.
-
The STP RNNs achieve lower validation accuracy than the static baselines, raising concerns about the trade-off between decision dynamics and task performance.
-
Silencing high-STP neurons also removes their connections and other computational contributions, making it difficult to isolate the causal role of STP itself.
-
The energy-efficiency analysis relies on expected spike counts in a simplified model rather than actual energy measurements, and the compared models differ in their decision times.
-
The experiments focus on a single binary motion-discrimination task with relatively small networks, leaving the generalizability of the proposed mechanism to more complex tasks unclear.
Questions for authors
-
Can the authors provide more direct evidence that synaptic efficacy is responsible for evidence accumulation in the trained RNNs? For example, what happens to decision accuracy and step-like dynamics if STP is frozen during inference while the learned weights remain unchanged?
-
How robust is the reported energy-efficiency advantage under a more controlled comparison? Since the STP and static models differ in reaction times and neuronal time constants, would the reduction in expected spike counts still hold if these factors were matched, and synaptic transmission costs were considered?
4 comments
Authors reply: Reviewer UHuR (part 2/2)
4. Controlled activity-cost comparison (W5, Q2)
Thanks for your comments. Action potentials and postsynaptic signaling account for major components of neural energy use, so integrated firing rate is a biologically motivated activity proxy (Attwell and Laughlin, 2001; Howarth et al., 2012). Moreover, metabolic costs are difficult to quantify. The variables u and x represent release probability and available synaptic resources, respectively. Neurotransmitter release and vesicle recycling occur at the biological synapses represented by both Static and STP conditions and incur metabolic costs in both (Tsodyks and Wu, 2013); these costs are not quantified here.
Besides, a fair energy comparison should match behavioral performance, particularly accuracy and reaction time, rather than internal parameters like neuronal time constant. Because STP changes circuit dynamics, imposing the same neuronal time constant on the STP and Static models produces different behavior. To compare activity cost at comparable decision performance, we matched accuracy and reaction time while allowing each model's internal parameters to be calibrated separately. This comparison was performed at three behavioral tiers; each entry below is reported as STP / Static:
| Target-accuracy tier | Observed accuracy | Mean reaction time (ms) | Expected spikes per trial; reduction with STP (95% CI) |
|---|---|---|---|
| 85% | 84.24% / 83.80% | 264.9 / 266.6 | 4.723 / 6.567; 28.08% (27.72%–28.46%) |
| 90% | 89.01% / 88.70% | 410.2 / 414.8 | 7.675 / 10.269; 25.26% (24.84%–25.70%) |
| 95% | 94.45% / 94.83% | 747.4 / 748.9 | 15.160 / 18.472; 17.93% (17.69%–18.17%) |
Across the three tiers, accuracy differed by at most 0.44 percentage points and mean reaction time by only 0.19%–1.10%; STP nevertheless required fewer expected decision-period spikes at every tier. Thus, across closely matched behavioral operating points, STP achieved comparable accuracy and decision speed with consistently lower spiking activity. Thank you again for the valuable question and we will add the controlled sweep to the revised manuscript.
5. Generalization beyond the present task (W6)
Thank you for this suggestion. Our study focuses on perceptual decision-making, and we therefore added the variable-stimulus-duration task of Song et al. (2016). The reaction-time and variable-stimulus-duration tasks are two canonical perceptual decision-making paradigms rather than tasks selected for simplicity. In the variable-stimulus-duration task, STP strength increased during training, and activity-silent output dynamics were more prevalent in all three paired networks (STP 0.851±0.025 versus Static 0.645±0.010). Thus, this second paradigm reproduces the central findings that task optimization recruits stronger STP and promotes activity-silent decision dynamics. We will add the results to the revised manuscript.
Thank you again for your insightful review. We hope this answers your questions, and we are happy to clarify anything further.
Thank you for your detailed response. It has addressed most of my concerns. I will maintain my original score.
Thank you for reviewing our response. We are glad that it has addressed most of your concerns. We have now incorporated the additional results and clarifications into the revised manuscript, with the main additions highlighted in red. In particular, the fixed-weight interventions and decoding comparisons provide direct trained-RNN evidence linking STP to decision performance and accumulated sensory input (W1, W4, Q1). The Static comparisons clarify STP’s role as an inductive bias toward activity-silent dynamics (W2), and the held-out evaluation shows fewer timeouts and more correct threshold crossings within the trial (W3). The controlled theoretical-model comparison also shows lower expected spike counts for STP at comparable accuracy and reaction time (W5, Q2). Additionally, we clarified the relationship between the trained RNNs and the theoretical model and improved the figures and explanations.
We believe that the additional experiments have strengthened the paper’s soundness, and the revised figures and explanations have also improved its presentation. We would therefore be grateful if you could reconsider your overall assessment, as well as the soundness and presentation ratings, in light of these improvements. If important concerns remain, we would appreciate knowing which ones most influence your assessment so that we can address them directly. Thank you again for engaging with our work and for giving its scientific contributions careful consideration in your final evaluation.
Authors reply: Reviewer UHuR (part 1/2)
Thank you again for your insightful review. We appreciate your positive assessment of the central question, circuit analysis, and stability-based explanation. To address your main concerns, we performed same-weight interventions, matched comparisons, and an additional perceptual decision task.
1. Direct evidence linking STP to evidence accumulation (W1, W4, Q1)
Thank you for this insightful question. In the trained RNNs, STP-mediated transmission contributes causally to decision performance and carries a decodable population-level evidence trace. We tested this in ten trained networks by setting effective synaptic efficacy q to one throughout inference while keeping the learned weights unchanged. Separately, we decoded cumulative left-minus-right sensory input from effective synaptic efficacy q, neuronal activity r, and their combination [q,r]:
The intervention on STP substantially reduced mean accuracy. Synaptic gain outperformed neuronal activity as a readout in all ten networks and reduced RMSE by 31.2±7.2%. Together, the intervention and decoding results link STP in the trained RNNs to evidence accumulation. We will add these results to the revised manuscript.
2. Activity-silent dynamics in Static RNNs (W2)
Thank you for your comment. A recurrent neural network is a highly expressive nonlinear dynamical system and can, in principle, approximate arbitrary finite-time trajectories, including activity-silent transitions (Funahashi and Nakamura, 1993). We therefore do not claim that STP is necessary. Our evidence instead identifies STP as a strong inductive bias. Across 10 seeds, activity-silent dynamics were more prevalent among choice-tuned neurons in RNNs with STP (52.2±16.2%) than in Static RNNs (36.2±7.0%). Step-like choice-output trajectories on correct-response trials were also more prevalent (58.7±4.0% versus 38.3±3.6%). The fixed-weight intervention and decoding results in our response to W1/Q1 address function: disrupting effective synaptic efficacy impaired decisions, while synaptic gain provided a more accessible readout of accumulated evidence than neuronal activity. Together, these results support STP as an inductive bias for activity-silent, evidence-based decisions, without claiming that it is necessary for step-like activity.
3. Validation accuracy and optimization budget (W3)
Thanks for raising this point. Although Static achieved slightly higher final-choice accuracy on the validation set in the original comparison, this endpoint argmax metric is not the same as the masked trajectory loss used to select checkpoints, nor does it account for timeouts or response timing. It also depends on the STP setting; with U×2 (doubling baseline utilization U), validation accuracy reached 95.14±1.13%, close to the Static value. We therefore also evaluated held-out behavior and decision dynamics across 10 seeds (mean ± SD):
The STP networks performed better on this held-out testing task stream. RNNs with STP had higher final-choice accuracy, fewer timeouts in all ten network pairs, and more correct threshold crossings, especially on weak-evidence trials. This identifies an online benefit for timely, well-separated commitment that final-output accuracy misses. Training also strengthened STP, and the higher step-like fractions indicate that learned STP is an inductive bias toward the activity-silent dynamics. Fixed-weight ablations in response to W1/W4/Q1 above further show that disrupting effective synaptic gain impairs decision performance. Complementary decoding shows that synaptic state carries a more accessible accumulated-evidence trace than neuronal activity. Together, these results support a role for STP in evidence processing and reliable within-trial commitment.