Understanding L1 Regularisation in Gradient Boosted Decision Trees

A thorough look with an example in LightGBM and R

(image by author)

I find that hyperparameter tuning is generally one of the most interesting parts of modelling. Let’s be honest, the algorithm for the model itself was already written by other people, so the tuning and setup phase is when most of us get to make a difference…