Gradient Descent

Pros and Cons of different variations of Gradient Descent for Machine Learning

Photo by Ines Álvarez Fdez on Unsplash

Introduction

Gradient Descent is a first order iterative optimization algorithm where optimization, often in Machine Learning refers to minimizing a cost function J(w) parameterized by the predictive model's parameters. Additionally, by first-order we mean that Gradient…