Activation Functions For Neural Networks & Deep Learning

Explaining why neural networks can learn (nearly) anything and everything

Machine learning icons created by Becris — Flatico. https://www.flaticon.com/free-icons/machine-learning

Background

In my previous article, we introduced the multi-layer perceptron (MLP), which is just a set of stacked interconnected perceptrons. I highly recommend you check my previous post if you are unfamiliar with…