It is shown that the gradient of a detailed neuron’s voltage with respect to a synaptic weight is itself a voltage, and that synaptic credit assignment can be implemented online by the voltage dynamics of detailed neurons.
Abstract
Credit assignment in neural networks is usually formulated as the computation of an abstract error gradient. Whether such a gradient can take a physical, causal form in biophysically detailed multi-compartment neuron models, and enable online, supervised learning, remains unclear. Here we show that the gradient of a detailed neuron’s voltage with respect to a synaptic weight is itself a voltage. Differentiating the discrete backward-Euler update solved by standard simulators yields equations of the same form as the original voltage dynamics, driven by gradient currents. Replaying weight-specific gradient currents forward in time reproduces the exact gradient with high fidelity in an L5 pyramidal neuron across diverse input regimes (R2 > 0.998). Pairing the replayed gradient voltage with a local learning signal yields a causal, online learning rule. A single L5 pyramidal neuron with active dendrites learns to reproduce target voltage trajectories containing calcium plateaus and bursts, and recurrent networks of detailed neurons learn to generate target temporal patterns, far outperforming a readout-only control. These results demonstrate that synaptic credit assignment can be implemented online by the voltage dynamics of detailed neurons, potentially suggesting a physical substrate for gradient-based supervised learning in the brain.
This work reformulates temporal credit assignment as a state separation problem: extracting task-required components induced by historical perturbations directly from the current neural state, which enables an online feedback learning framework for NMCs through a gradient tunneling algorithm and the lead-lag expansion...
Xiang-Nan Zhang, Jing-Xin Liu, Ran-Qi Lu et al.· 0 citations
Eligibility propagation (e-prop) is a biologically plausible learning rule for recurrent spiking neural networks (SNNs). It approximates gradients computed by backpropagation through time using online updates based on eligibility traces and learning signals. We reformulate the originally time-driven gradient calculatio...
A. Korcsak-Gorzo, Jesús A. Espinoza-Valverde, Jonas Stapmanns et al.· Neuromorphic Computing and E...· 0 citations
Across static, recurrent, attention-based, state-space, continuous-time, implicit, spiking, biologically plausible, and neuromorphic families, forward dynamics have diversified while the highest demonstrated scales remain concentrated in global or closely gradient-derived error-propagation mechanisms.
A key challenge in biophysically detailed modeling is determining functionally effective synaptic weights. Here, we introduce a dendritic voltage surrogate that couples passive dendritic transfer impedances with the exact active currents computed from the original model, yielding explicit, differentiable approximations...
Gan He, Meng-Di Zhao, Kai Du et al.· Neural Computation· 0 citations
Artificial neural networks trained with gradient descent (GD) are widely used to model brain learning, but GD allows synapses to switch between excitatory and inhibitory and produces weight distributions unlike those observed experimentally. We show that an alternative rule, exponentiated gradient (EG), avoids these pr...
Jonathan Cornford, Roman Pogodin, Arna Ghosh et al.· Neuron· 0 citations
Overall, these results link predictive coding to local circuit plasticity, show it does not require an explicit prediction error representation, and suggest a normative role for BCM-like plasticity in excitatory synapses.
Henrique Reis Aguiar, M. Hennig· bioRxiv· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.