A Low Variance Sample Estimator for Mutual Information

Competing with Correlation

Rohan Tangri
Towards Data Science
4 min readFeb 3, 2022

--

Photo by JESHOOTS.COM on Unsplash

This is a follow-on from my article on approximating KL divergence and follows the same ideas. I figured this deserves its own piece though because I’ve not really seen this specific idea anywhere else on the internet.

What is Mutual Information?

--

--