PotentialEP: Backprop-Free Training of CIFAR-Scale Generative Models via Equilibrium Propagation

arXiv:2610.14409 · cs.LG, cs.ET, cs.NE · Submitted 2026-10-10 · Read on arXiv

Listen

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Today's paper: "PotentialEP: Backprop-Free Training of CIFAR-Scale Generative Models via Equilibrium Propagation".

Jane: The gist Generating an image with a diffusion or flow-matching model typically involves integrating a velocity field for hundreds of sequential steps,

Tom: First, who's behind it and why it matters.

Title and authors: Tom: So we're looking at this paper, "PotentialEP: Backprop-Free Training of CIFAR-Scale Generative Models via Equilibrium Propagation". It sounds pretty technical, and the main thing to get is that they're trying to train generative models without using backpropagation.

Jane: That’s what it’s about. The title suggests a method called Equilibrium Propagation is used for training these models, which usually needs backpropagation, but this paper claims it doesn't require it.

Lu: The core idea here is replacing the expensive backpropagation with an energy relaxation process, which is much better suited for analog neuromorphic hardware than traditional digital training.

Meng: So we’re talking about cutting out a whole step of computational cost during training by using this relaxation instead of gradient transport, which is what backpropagation does.

Lalam: Essentially, they are trying to get the same generative quality as models trained with backpropagation without having to do that expensive backward pass.

Tom: Right. I’m really interested in how they set up the mechanics here, because if you can skip that backward pass, it could drastically cut down on the energy and latency of generation when we deploy these things on analog hardware.

The paper's summary: Jane: They explain that this works by combining two main components. First, there's an Energy Matching model which is trained conventionally using backpropagation, but then you load it into a different network for sampling via relaxation.

Tom: So the energy matching model gets its training done the usual way, and then it becomes something you can sample from just by relaxing on a time-independent potential.

Lu: The key mechanism is a Predictive Coding Network or PCN, which when given an energy function, relaxes to an equilibrium state where the visible layer inherently carries that gradient information.

Meng: That means the velocity field you need for generation is actually read directly from the visible layer of this relaxed network without any explicit backpropagation step during sampling.

Lalam: And they show that when you add a single linear term of strength gamma to this energy, the states of this PotentialPCN relax to an equilibrium where that gradient information is present, with an error that goes to zero as gamma gets smaller.

Tom: So the paper claims you can generate images without needing any backward pass during the generation path itself. How does that translate into actual results when they test it on CIFAR-ten and ImageNet-thirty-two <ref:2610.14409#pg1>?

The paper's improvements: Jane: Well, the results are pretty compelling. They found that for CIFAR-ten and ImageNet-thirty-two scale, the velocities from this method agree with autograd’s to a cosine similarity of one to nine decimal places <ref:2610.14409#pg1>.

Tom: That level of agreement is significant. And they also found that the Fréchet Inception Distance, or FID score, of the generated samples matches within zero point zero four compared to backpropagation results for CIFAR-ten and ImageNet-thirty-two scale models.

Lu: What’s really interesting is that they didn't even need to retrain anything. This means you can take a model trained with backpropagation and just load it into this new network, and it works for sampling without any change to how the model was trained.

Meng: That’s huge for deployment on analog hardware. If generation latency is tied to that training cost, cutting out the backward pass saves a lot of life-cycle cost on those devices.

Lalam: And they also showed that training can happen on-chip using Equilibrium Propagation, which reads parameter updates from local measurements at equilibrium instead of needing global transport, and their resulting procedure, called PotentialEP, reproduces backpropagation’s updates with a cosine similarity of zero point nine nine nine eight at their operating point <ref:2610.14409#pg1>.

Tom: So they’re showing that you can use this method for both sampling and training without the traditional backpropagation bottleneck, which is a big deal for making these models practical on hardware.

Conclusion: Jane: So to wrap up, the main implication is that you can achieve competitive generative quality without needing backpropagation for training or sampling, provided you use this Energy Matching and Predictive Coding Network setup with Equilibrium Propagation.

Tom: It seems like they’ve managed to keep the fidelity high, showing a cosine similarity of one to nine decimal places for the velocities, and an FID score close to zero when compared to backpropagation results on CIFAR-ten <ref:2610.14409#pg1>.

Lu: They also showed that this works even with simpler architectures. They found that removing things like group normalization and attention doesn't cost much at this scale; a network of only convolutions and pointwise nonlinearities with UNet skips reached an FID of three point five one when trained by backpropagation, so it shows the method is quite flexible.

Meng: From my side, what matters is that the training procedure itself can be done on-chip using Equilibrium Propagation by reading local measurements at equilibrium, which means no need for a global transport step during training on those neuromorphic chips.

Lalam: They also addressed the correspondence itself, noting that their error comes from an O(gamma) correspondence bias, and they found that the usable region is a diagonal band where each decade lost in gamma is recovered by roughly a decade gained in beta.

Jane: So while it’s very promising for reducing deployment costs on analog hardware, they are focused specifically on CIFAR-ten and ImageNet-thirty-two for their main results, and they didn't train their checkpoints on ImageNet-thirty-two to verify the inference correspondence <ref:2610.14409#pg1>.

Tom: Yeah, so the paper "PotentialEP: Backprop-Free Training of CIFAR-Scale Generative Models via Equilibrium Propagation" shows a pathway to decouple generation from traditional backpropagation in a way that looks very plausible for real hardware.

University of Cambridge · Nokia Bell Labs

cs.LG, cs.ET, cs.NE

Submitted: 2026-10-10

Updated: 2026-10-14

Comments: Under review at ICLR 2027. Code: github.com/alexgower/EnergyMatchingEqProp

Code: https://github.com/alexgower/EnergyMatchingEqProp

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Importance score: 85/100

The gist: The gist Generating an image with a diffusion or flow-matching model typically involves integrating a velocity field for hundreds of sequential steps, and this paper introduces Equilibrium

Key concepts

Energy Matching Model: This is a generative model trained by minimizing an energy function, $V_{ heta}(x)$. It generates samples by performing gradient descent on this potential function. This setup allows the model to be sampled using a simple relaxation process, which is computationally efficient for analog hardware.
Predictive Coding Network (PCN): This network computes the velocity field needed for generation. It is constructed by adding a single linear term of strength $\gamma$ to its scalar output node, creating an energy-based PCN. The velocity field is then derived from this network's visible layer.
Equilibrium Propagation (EP): EP is an alternative learning algorithm to backpropagation for systems that settle into stationary points. It updates the model parameters by observing local measurements at equilibrium, effectively shifting the free equilibrium towards lower energy states, bypassing the need for global gradient transport.

Terminology

Generative Model — 1× in this paper · explained in 2 episodes
Generative Models — 1× in this paper · explained in 3 episodes

Summary

The gist Generating an image with a diffusion or flow-matching model typically involves integrating a velocity field for hundreds of sequential steps, and this paper introduces Equilibrium Propagation as a backpropagation-free training method that achieves competitive generative quality on CIFAR-10.

How it works

The core idea is to replace the computationally expensive backpropagation required by traditional training with an energy relaxation process, which is suitable for analog neuromorphic hardware The method relies on two key components: an Energy Matching model that generates by gradient descent on a potential Vθ(x), and a Predictive Coding Network (PCN) whose relaxation computes the velocity field The PCN is constructed by adding a single linear term of strength γ on the scalar output node, giving an energy EPCN The velocity is then read from the visible layer as vPCN(x) = − γ-1 ∇xEPCNx, h∗ (x)

Generation without a backward pass

An Energy Matching model trained conventionally by backpropagation can therefore be loaded into this network unchanged and sampled by relaxation At CIFAR-10 and ImageNet-32 scale the velocities agree with autograd’s to a cosine similarity of 1 to nine decimal places, and the FID of the generated samples matches to within 0.04 No retraining is required, so the energy and latency of generation — most of a deployed model’s lifetime cost — could be cut on analog hardware without any change to how the model is trained

Training without a backward pass

Training can move on-chip as well The PCN relaxes on an explicit energy, so it can be trained by Equilibrium Propagation (Scellier & Bengio, 2017), which reads parameter updates −∇θL from local measurements at equilibrium and so needs none of the global transport that makes backpropagation awkward in analog We call the resulting procedure PotentialEP Its parameter updates reproduce backpropagation’s to a cosine similarity of 0.9998 at our operating point (Section 4.2), and a model trained end to end with those updates reaches an FID of 3.64 on unconditional CIFAR-10, against 3.54 for backpropagation

The architecture

A backpropagation-free algorithm is of little use if the architecture it trains is itself hard to realise in analog We find that removing both group normalisation, which couples every channel through a shared statistic, and attention, whose pairwise products are not a fixed weighted sum costs nothing measurable at this scale—a network of only convolutions, pointwise nonlinearities and UNet skips reaches an FID of 3.51 when trained by backpropagation

Equilibrium Propagation

Equilibrium Propagation (EP) is an alternative learning algorithm to backpropagation for systems whose dynamics settle to stationary points, from which their outputs are read The update is ∆θ ∝ − 1/2β h ∂E/∂θ s∗+β − ∂E/∂θ s∗−β i−−−→ β→0 −∇θ C(s∗), which lowers the energy at s∗+β and raises it at s∗−β, so that the free equilibrium s∗ itself shifts towards lower cost

Equivalence Experiments

The correspondence itself is not the constraint, Where EP estimates the parameter gradient by a finite difference of two nudged equilibria, so its only error is the O(γ) correspondence bias of Section 4.1 The usable region is a diagonal band, where each decade lost in γ is recovered by roughly a decade gained in β

Hardware-Plausible Architectures

The norm- and attention-free architecture of Section 5.1 is wider than the reference, used a different schedule, and was trained and sampled feedforward only

Generated Samples

All four models share a sampling seed, so the panel in a given position starts from the same x0 in every figure

Conclusion

The paper establishes that EP training on CIFAR-10 only; at ImageNet-32 we verify the inference correspondence on the authors’ released checkpoints, but did not train