Introduction to Entropy and Gini Index

Understanding how these measures help us quantify uncertainty in a dataset

Can you tell which are the purest and impurest carts? (Source: Image by Author)

Entropy and Gini Index are important machine learning concepts particularly helpful in decision tree algorithms to determine the quality of a split. Both of these metrics are calculated differently but ultimately used to quantify the same thing i.e. uncertainty (or impurity)…