Solving the Mystery of Backpropagation
Published in
5 min readFeb 24, 2019
The algorithm is quite the workhorse in the majority of widely used, human-level surpassing learning systems based on neural networks. It was popularised by the 1986 paper published in Nature authored by David Rumelhart, Geoffrey Hinton, and Ronald Williams.
The original paper concludes, “applying the procedure to various tasks shows that interesting internal representations can be constructed by…
