← Back to Red Deer Investments  ·  AI Library Home

5. The Neuron That Learns

The FitzHugh-Nagumo model is not a neuron. It is a mathematical abstraction — a pair of differential equations that capture the essential dynamics of a real biological neuron. It has two variables: one that represents the membrane potential (the voltage across the cell membrane) and one that represents the recovery variable (the tendency of the neuron to return to rest after firing).

The model was published in the early 1960s, independently by Richard FitzHugh (a biophysicist at the National Institutes of Health) and Nagumo and colleagues (engineers at the University of Tokyo). It simplified the much more complex Hodgkin-Huxley model of the squid giant axon — a model that had won the Nobel Prize — into something mathematically tractable.

For sixty years, the FitzHugh-Nagumo model has been used to study excitability, oscillations, and pattern formation in neural systems. It is one of the most studied models in computational neuroscience. But until Zyphra's 2026 paper, no one had shown that it could learn.

The technical achievement is this: equilibrium propagation requires the system to be "self-adjoint" — a mathematical property that ensures the gradient of the energy function can be computed from local information. The FitzHugh-Nagumo model is not self-adjoint. It is a skew-gradient system, meaning its dynamics are driven by a combination of gradient flow (toward lower energy) and symplectic flow (along constant-energy surfaces). This is a more complex, more realistic description of neural dynamics.

Zyphra showed that the FitzHugh-Nagumo model is "essentially self-adjoint" — it can be decomposed into self-adjoint components arranged in a way that preserves the EqProp property. The result is that a network of biologically realistic neurons can be trained using the same nudge-and-relax mechanism that works in simpler energy-based models.

This is not just a theoretical result. It has concrete implications for hardware. If learning can happen through local physical dynamics — through the natural evolution of the system's state — then specialized learning hardware is not necessary. The physics does the work. This is the same insight that drives neuromorphic computing: instead of simulating neural dynamics on general-purpose hardware, build hardware that embodies those dynamics.

The FitzHugh-Nagumo result is a bridge. It connects the abstract mathematics of equilibrium propagation to the messy reality of biological neurons. And it suggests that the search for a biologically plausible learning algorithm is converging on a specific class of solutions: learning through physical dynamics, with local update rules, no global error signals, and no separation between inference and learning.


← Previous Next →