Hands-on Tutorials
Animations of Gradient Descent and Loss Landscapes of Neural Networks in Python
Published in
9 min readDec 21, 2020
During my journey of learning various machine learning algorithms, I came across loss landscapes of neural networks with their mountainous terrains, ridges and valleys. These loss landscapes were looking very different from the convex and smooth loss landscapes I encountered with linear and logistic regression. In the following article, we will create loss landscapes of neural networks and animate gradient descent using the MNIST-dataset.
