Activation Functions in Neural Networks

Why we need activation functions and what makes them so special

Soner Yıldırım
Towards Data Science
7 min readJun 15, 2020

--

Photo by Neil Thomas on Unsplash

What makes neural networks so special is their ability to model highly complex relationships between inputs and outputs. We cannot achieve these complex relations with linear models. Thus, neural networks need to be able to represent non-linearity. This is the reason why we use activation…

--

--