Photo by Shane Aldendorff on Unsplash

3 Common Problems with Neural Network Initialization

What are the impacts? And how can we avoid them?

A common machine learning modelling process goes by (1) weight initialization, (2) forward propagation, (3) loss (or cost) computation, (4) backpropagation, and (5) weight update using optimization algorithms. While weight initialization is usually as simple as one line, it is often easily…