Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation?
Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation?
The backpropagation of error algorithm (BP) used to train deep neural networks has been fundamental to the successes of deep learning. However, it requires sequential backwards updates and non-local computations which make it challenging to parallelize at scale and is unlike how learning works in the brain. Neuroscience-inspired learning algorithms, …