XGBoost: The Definitive Guide (Part 1)

A step-by-step derivation of the popular XGBoost algorithm including a detailed numerical illustration

Dr. Roi Yehoshua
Towards Data Science
15 min readAug 9, 2023

--

Photo by Sam Battaglieri on Unsplash

XGBoost (short for eXtreme Gradient Boosting) is an open-source library that provides an optimized and scalable implementation of gradient boosted decision trees. It incorporates various software and hardware optimization…

--

--

Teaching Professor for Data Science and ML at Northeastern University | Top Writer in AI | 200K+ Views on Medium | https://www.linkedin.com/in/roi-yehoshua/