A simple way to learn generally from a large training set: DINO

This post describes a self-supervised learning method: self-distillation with no Labels (DINO)

While the method (DINO [1]) itself is simple and straightforward, there are some prerequisites to understanding the method, i.e., 1) supervised learning, 2) self-supervised learning, 3) knowledge distillation, and 4) vision transformer. If you know all of it, you can skip to here.

Supervised Learning