Jonathan Cornford

Exponentiated gradient learning yields brain-like synaptic distributions.

Artificial neural networks trained with gradient descent (GD) are widely used to model brain learning, but GD allows synapses to switch between excitatory and inhibitory and produces weight distributions unlike those observed experimentally. We show that an alternative rule, exponentiated gradient (EG), avoids these pr...