Gini Index vs Information Entropy

Everything you need to know about impurity measurements and information gain

Andrew Hershy
Towards Data Science
7 min readJul 10, 2019

--

Source

Introduction:

Measures of impurity/information-gain, particularly Gini Index and Entropy, are interesting and practical concepts for data scientists to know. We will deep-dive into these concepts with easy-to-understand examples below.

--

--