Hong Zhao

Beyond Backpropagation: Monte Carlo Method Can Train Deep Neural Networks

This paper shows that indeed the simplest Monte Carlo algorithm implemented on a single GPU can practically train deep networks and may offer a complementary perspective for understanding the self-organization and learning mechanisms of neural networks, and also provides an alternative route for building physically inspired deep learning systems.