- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
Analog neuromorphic hardware can solve optimization problems that reduce to energy minimization with exceptional time and energy efficiency. Consequently, formulating generative models as energy minimization processes while rendering them backpropagation-free offers substantial efficiency benefits. This paper unifies Energy Matching, an energy-minimization-based generative framework, with predictive coding and equilibrium propagation. Specifically, it (i) computes the backprop-based potential gradient required for Energy Matching in a backprop-free manner via the prediction errors of a Predictive Coding Network (PCN), and (ii) eliminates backpropagation during training by adopting Equilibrium Propagation, which seamlessly aligns with PCN for local learning. In doing so, the authors replace the standard quadratic nudge with a linearized nudge to eliminate equilibrium displacement bias. Evaluation results show that the proposed model achieves high-fidelity generative modeling on CIFAR-10, matching the performance of backprop-trained baselines such as DDPM and Energy Matching.
Critical strengths
- Addresses a timely and compelling problem by designing a fully backpropagation-free generative framework while clearly demonstrating a practical application scenario where such a model provides tangible benefits.
- Successfully constructs the first generative model trained and sampled end-to-end via purely local dynamics, achieving performance on par with backpropagation-trained baselines.
Critical weaknesses
- The technical novelty appears limited, as the paper mainly focuses on unifying three existing, correlated concepts into a single framework. While novel components such as the linearized nudge and linear injection terms are introduced, they feel highly specialized to this specific setup rather than offering broader conceptual insights to the community.
- The paper is exceptionally dense and difficult to comprehend. The structure, phrasing, and overall prose strongly suggest heavy reliance on LLM generation at both the organizational and sentence levels. I strongly encourage the authors to revise the writing with human readers in mind to improve readability and flow.
Questions for authors
- Related Work section needs significant reinforcement. Currently, it only provides a brief overview of predictive coding and energy-based generative models. A much more comprehensive survey is critical, specifically covering prior attempts to integrate predictive coding with equilibrium propagation, other local learning rules applied to generative modeling, backpropagation-free generative frameworks in general, and recent advances in predictive coding itself. Do the authors plan to expand this section in a revision, or do they believe the current positioning is sufficient? If the latter, please justify why.
- The paper is exceptionally dense and severely hinders human comprehension. Was this intentional? If not, how do the authors plan to rewrite the paper to improve readability, clarity, and overall flow for the reader?
- Prior literature has already explored combining predictive coding with equilibrium propagation [1], as well as applying equilibrium propagation to generative models [2]. Isn't this work essentially an incremental interpolation of these existing building blocks? Could you clearly summarize what conceptual breakthroughs set this work apart?
- Is pixel-level generative modeling actually a primary or natural workload for neuromorphic substrates? For instance, biological brains do not perform dense pixel-level generation like diffusion models, but rather execute creative or generative tasks through action sequences and structured latent representations. Could you justify why hardware-constrained analog substrates are an appropriate platform for pixel-space image generation?
[1] Millidge, B., Song, Y., Salvatori, T., Lukasiewicz, T., & Bogacz, R. (2022). Backpropagation at the infinitesimal inference limit of energy-based models: Unifying predictive coding, equilibrium propagation, and contrastive hebbian learning. arXiv preprint arXiv:2206.02629. [2] Gower, A. (2026, August). FlowEqProp: Training Flow Matching Models with Gradient Equilibrium Propagation. In Proceedings of the International Conference on Neuromorphic Systems (pp. 60-66).
4 comments
Follow-up on our response
We would like to thank the reviewer again for their questions. As the discussion period closes soon, we wanted to check whether our response and the revised paper address their concerns about novelty, related work and readability. We would be happy to clarify anything further.
Thank you for the detailed response and revision. The expanded related work fully addresses my first question, and the added Figure 1 and conclusion improve readability.
However, my concern about novelty remains. As Appendix M acknowledges, PC equilibria carrying backpropagated errors is a known result. The injection term is closely related to an EP/PC nudge whose cost is the network output itself, read out at the input layer. The linearised nudge is adopted from Dual Propagation, and the new bias analysis is specific to GradEP with a quadratic loss. I recognize the empirical value of reaching CIFAR-10 at backpropagation quality, but the contribution lies mainly in combining and scaling existing components rather than in a new conceptual insight.
I will therefore maintain my score.
Thank you for your response
Thank you for engaging with our response and for re-reading the revision. We are glad the related work and readability now address your concerns. We agree that PC equilibria carrying an output error down through the network is known, and the paper credits this. Our view is that the injection term itself, a linear term on the network’s scalar output with no target, is new, as is its consequence: the PCN’s own energy becomes the generative potential, so sampling itself becomes a relaxation, which earlier analyses did not consider. We also appreciate the reviewer’s recognition of the empirical value of reaching CIFAR-10 at backpropagation quality, a level that backprop-free generation had not previously reached. Thank you again for a careful and constructive review, which has made the paper considerably stronger.
Response to Reviewer YTKD
We thank the reviewer for the detailed review and for recognising that the paper addresses "a timely and compelling problem" with "a practical application scenario where such a model provides tangible benefits". The questions have substantially improved the revision, and we answer each below.
Q1. Related work. Yes, we have substantially expanded the "Related work" section, covering each area the reviewer named:
Q2. Density. The density was not intentional or due to extensive use of AI. It came largely from compressing a draft that was originally 13 pages long into 9 pages. We have used the tenth page to revise the prose and improve clarity throughout, and added a new Figure 1 that explains the PotentialPCN visually and a conclusion that summarises our contributions.
Q3. Novelty relative to [1] and [2]. Until now, generative models trained without backpropagation have either stayed at MNIST scale or fallen well short of competitive quality. We respectfully see reaching CIFAR-10 at backpropagation's quality as a conceptual step rather than an interpolation. The key idea is to make generation itself a relaxation on a PC energy: one equilibrium state then provides the sampling velocity, replaces the backward pass, and is what EP trains. This gives three advances.
On generality: the injection applies to any scalar-output network, and Energy Matching unifies flow matching with energy-based modelling, so the construction applies wherever a generative model is expressed as a scalar potential. The linearised-nudge analysis applies to any use of GradEP with a quadratic loss. EP itself, a significant contribution to local learning, is a one-term modification of an energy combined with the implicit function theorem. Simple constructions can carry substantial consequences.
Q4. Why pixel space. We use "neuromorphic" in the sense of efficient physical computation rather than brain mimicry. Iterative image generation is a large and growing workload, and its hundreds of sequential velocity evaluations per sample are exactly what a physical relaxation could replace. We work in pixel space because Energy Matching does, which makes the correspondence and the quality comparison direct. Energy Matching has since been applied in a learned latent space (Barco et al., 2026), and latent generation is a natural next step (with a decoder also trained by EP) that would also reduce the number of nodes relaxing at each step (now noted in the "Discussion and limitations" section).
We hope these revisions address the reviewer's concerns. If so, we would be very grateful if the reviewer would consider revising their score.