Transformers: From NLP to Computer Vision

How Transformer architecture has been adapted to computer vision tasks

Photo by kyler trautner on Unsplash

Introduction

In 2017, the paper “Attention is all you need” [1] took the NLP research community by storm. Cited more than 100,000 times so far, its Transformer has become the cornerstone of most major NLP architectures nowadays. To learn about…