Classifier calibration

The why, when and how of model calibration for classification tasks.

Photo by Christophe Hautier on Unsplash

When dealing with a classification problem, collecting only the predictions on a test set is hardly enough; more often than not we would like to compliment them with some level of confidence. To that end, we make use of the associated probability, meaning the likelihood calculated by the classifier, which…