BERT Model Embeddings aren’t as good as you think

Toward multilingual sentence embeddings

Original Photo by Gaurav Baya on Unsplash. Modified by Daulet Nurmanbetov

I wrote in the past about Facebook’s LASER embedding system, where sentences of similar meaning would have similar vector embeddings. What’s more, LASER embeddings are multilingual meaning sentences in different languages would map to the same vector!