Activation Functions in Neural Networks
Why we need activation functions and what makes them so special
Published in
7 min readJun 15, 2020
What makes neural networks so special is their ability to model highly complex relationships between inputs and outputs. We cannot achieve these complex relations with linear models. Thus, neural networks need to be able to represent non-linearity. This is the reason why we use activation…