Conditioned DFA (nDFA), a family that adapts established inverse-moment preconditioning to either side of this update, is studied, establishing practical benefits and important limits of conditioning learning with fixed random feedback.
Houman Safaai, V. Reddy, Bernardo L. Sabatini· arXiv.org· 1 citation
Direct feedback alignment (DFA) trains hidden layers through fixed random projections of output error. With tanh hidden units and independent sigmoid outputs, plain stochastic gradient descent can stall near the loss of a constant predictor of class frequencies. We trace this stall to the error's common mode, the compo...
V. Reddy, Bernardo L. Sabatini, Houman Safaai· 0 citations
DendriNet, a trainable framework that varies integration rule, morphology, synaptic allocation, divisor locality, and dendritic nonlinearities is introduced, a trainable framework that varies integration rule, morphology, synaptic allocation, divisor locality, and dendritic nonlinearities.
Houman Safaai, Maceo Richards, N. Khoshnevis et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.