A Deep Dive into the Code of the BERT Model

Breaking down the HuggingFace BERT Implementation

https://unsplash.com/@emilep

There are already many tutorials out there on how to create a simplified Bert model from scratch and how it works. In this article we are going to do something slightly different — we go through the actual Hugging face implementation of BERT breaking down all its components.