Gradient Descent, clearly explained in Python, Part 1: The troubling theory

Vagif Aliyev
Towards Data Science
7 min readAug 7, 2020

--

One of the first things that you are guaranteed to encounter when you first enter the field of Machine Learning and Data Science is Gradient Descent. But the question is, what exactly IS gradient descent? What does it do? Is it one thing, or are there different versions of Gradient Descent? By the end of this article, you will be able to answer all these questions.

Photo by Wikipedia

--

--