Decrease Neural Network Size and Maintain Accuracy: Knowledge Distillation

Some neural networks are too big to use. There is a way to make them smaller but keep their accuracy. Read on to find out how.

Wilson Wang
Towards Data Science
5 min readSep 12, 2021

--

Photo by Avery Evans on Unsplash

Practical machine learning is all about tradeoffs. We can get better accuracy from neural networks by making them bigger, but in…

--

--