Fine tune GloVe embeddings using Mittens

Sivasurya Santhanam
Towards Data Science
3 min readApr 19, 2020

--

Photo by Alex on Unsplash

After 2013, Word embeddings got really popular even outside of NLP community. Word2vec and GloVe belong to the family of static word embeddings. Then came the series of dynamic embeddings BERT, ELMO, RoBERTa, ALBERT, XLNET.. All these embeddings depend upon the context words. In this post let’s see how we can fine tune the static embeddings.

--

--