- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Neuromodulated Equilibrium Learning (NEL), a reward-based local learning rule that uses a single free equilibrium. After selecting an output action, a scalar reward generates a modulatory signal that propagates through transposed forward weights and combines with local neuronal activities to update synapses. NEL eliminates the additional nudged equilibria and contrastive updates used by EP and REP. Experiments on MNIST, Fashion-MNIST, and CIFAR-10 demonstrate successful reward-feedback classification, with increasing performance gaps in more complex architectures.
Critical strengths
-
Clear research question. The paper investigates whether equilibrium networks can learn from scalar rewards without additional reward-nudged relaxation, addressing a specific limitation of phase-separated learning.
-
Informative controls. DCF replaces sparse reward feedback with full supervised output error, while BPTT provides a gradient-based reference without additional nudged equilibria. These comparisons help distinguish supervision limitations from deficiencies in credit propagation.
-
Useful empirical characterization. Results cover six random seeds, with analyses of exploration, relaxation length, and update-direction alignment. The paper also acknowledges its performance limitations and does not claim mathematical equivalence to EP.
Critical weaknesses
-
Performance deteriorates with architectural complexity. The gap to three-phase REP increases from 0.79 percentage points on MNIST to 3.13 points on the deeper Fashion-MNIST network and 6.21 points on CIFAR-10. This limits evidence that the proposed credit-assignment mechanism scales effectively. The weak alignment with BPTT in early layers identifies a potential limitation but does not establish its cause or provide a solution.
-
A practical performance–cost advantage is not demonstrated. Using one equilibrium still requires many recurrent updates: MNIST uses 80 relaxation steps, and shortening relaxation substantially reduces accuracy. Without wall-clock, memory, or energy measurements, fewer equilibrium phases alone do not establish greater efficiency, particularly given the accuracy trade-off.
-
Relaxation budgets are not consistently matched. On CIFAR-10, NEL uses 80 free-relaxation steps, whereas REP, EP, and BPTT use 120. Consequently, performance differences mix the effects of the learning rule with differences in free-relaxation computation. Matched-budget comparisons are needed to isolate the contribution of eliminating nudged phases.
Questions for authors
See weakness