A no-frills guide to most Natural Language Processing Models — The Pre-LSTM Ice-Age — (R)NNLM, GloVe, Word2Vec & fastText

A summary of the origins, the use-cases and the advantages/disadvantages of pre-LSTM language models: (R)NNLM, GloVe, Word2Vec & fastText.

Ilias Miraoui
Towards Data Science
6 min readFeb 13, 2020

--

As I learned more about Natural Language Processing (NLP), I realized that the information about recent models was particularly scattered and hard to reach. I hope to centralize a broad summary of the…

--

--