The Ultimate Guide to Training BERT from Scratch: The Tokenizer

From Text to Tokens: Your Step-by-Step Guide to BERT Tokenization

Photo by Glen Carrie on Unsplash

Part I, Part III, and Part IV of this story are now live.

Did you know that the way you tokenize text can make or break your language model? Have you ever wanted to tokenize documents in a rare language or a specialized…